Could anyone update on how to use extract answer

Open YerongLi opened this issue 1 year ago • 1 comments

[18:38:19] INFO     [root] MathVista: Extract Answers - Start                                                        
usage: extract_answer.py [-h] [--results_file_path RESULTS_FILE_PATH] [--response_label RESPONSE_LABEL]
                         [--max_num_problems MAX_NUM_PROBLEMS] [--quick_extract] [--rerun]
                         [--save_every SAVE_EVERY] [--azure_openai_api_endpoint AZURE_OPENAI_API_ENDPOINT]
                         [--azure_openai_api_key AZURE_OPENAI_API_KEY]
                         [--azure_openai_api_version AZURE_OPENAI_API_VERSION]
                         [--azure_openai_model AZURE_OPENAI_MODEL]

I don't have access to Azure but oganic OPENAI

Oct 26 '24 23:10 YerongLi

Current extract_answer.py uses AZURE which is so different from https://github.com/lupantech/MathVista/blob/f036866d1e4de05a8311e0e9216010555da39ea9/evaluation/extract_answer.py

Oct 27 '24 05:10 YerongLi