Jobs_Applier_AI_Agent icon indicating copy to clipboard operation
Jobs_Applier_AI_Agent copied to clipboard

[BUG]: Bot confabulates years of experience.

Open sloganking opened this issue 3 months ago • 3 comments

Describe the bug

When asked about years of experience, the bot generally makes things up completely.

Steps to reproduce

This was fixed in the past by https://github.com/feder-cr/Auto_Jobs_Applier_AIHawk/pull/609 which defaulted the years of experience to zero if it was not assigned manually in answers.json. which was a moderately acceptable workaround, given that the bot would make people look worse than they are, and not better, until users filled in their information, and then, most of the time (80-09% of answers are repeats), it would always answer accurately.

However that fix was reverted in https://github.com/feder-cr/Auto_Jobs_Applier_AIHawk/pull/623 by @akashbilgi who obviously desires different behavior.

How should we handle this issue going forward? if self.gpt_answerer.answer_question_numeric(question_text) were more accurate then there would be no need to hard code the result to zero if the bot did not know. However right now it is not accurate, and I do not feel comfortable having the bot say users have 3-4 years of experience (what it tends to default to today) in every area where they do not. And pulling numbers out of nowhere.

Expected behavior

No response

Actual behavior

No response

Branch

None

Branch name

No response

Python version

No response

LLM Used

No response

Model used

No response

Additional context

No response

sloganking avatar Oct 30 '24 23:10 sloganking