add upd · EvolvingLMMs-Lab/lmms-eval@d224794 (original) (raw)
Navigation Menu
- GitHub Copilot Write better code with AI
- GitHub Models New Manage and compare prompts
- GitHub Advanced Security Find and fix vulnerabilities
- Actions Automate any workflow
- Codespaces Instant dev environments
- Issues Plan and track work
- Code Review Manage code changes
- Discussions Collaborate outside of code
- Code Search Find more, search less
- Explore
- Pricing
Provide feedback
Saved searches
Use saved searches to filter your results more quickly
Appearance settings
Commit d224794
File tree
1 file changed
lines changed
1 file changed
lines changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -453,7 +453,7 @@ def extract_answer_from_item(self, item, gt_text, eval_type, question_type, upd_ | ||
| 453 | 453 | return ret, item['prediction'], answer_option |
| 454 | 454 | |
| 455 | 455 | while retry: |
| 456 | -ans = self.get_chat_response(prompt, temperature=0.9) | |
| 456 | +ans = self.get_chat_response(prompt, temperature=0.7) | |
| 457 | 457 | if 'Failed to obtain answer via API' in ans: |
| 458 | 458 | msg = 'GPT API failed to answer. ' |
| 459 | 459 | eval_logger.info(msg) |