update vcr_wiki tasks in README.md · MichalCiesiolka/lmms-eval-llmzszl@cd050d4 (original) (raw)
`@@ -276,10 +276,22 @@ We also provide the raw data exported from Weights & Biases for the detailed res
`
276
276
`- TextVQA Validation (textvqa_val)
`
277
277
`- TextVQA Test (textvqa_test)
`
278
278
`- VCR-Wiki (vcr_wiki)
`
279
``
`-
- vcr English easy mode (vcr_wiki_en_easy)
`
280
``
`-
- vcr English hard mode (vcr_wiki_en_hard)
`
281
``
`-
- vcr Chinese easy mode (vcr_wiki_zh_easy)
`
282
``
`-
- vcr Chinese hard mode (vcr_wiki_zh_hard)
`
``
279
`+
- VCR English easy mode
`
``
280
`+
- VCR English easy mode full test set (vcr_wiki_en_easy)
`
``
281
`+
- VCR English easy mode test 100 (vcr_wiki_en_easy_100)
`
``
282
`+
- VCR English easy mode test 500 (vcr_wiki_en_easy_500)
`
``
283
`+
- VCR English hard mode
`
``
284
`+
- VCR English hard mode full test set (vcr_wiki_en_hard)
`
``
285
`+
- VCR English hard mode test 100 (vcr_wiki_en_hard_100)
`
``
286
`+
- VCR English hard mode test 500 (vcr_wiki_en_hard_500)
`
``
287
`+
- VCR Chinese easy mode
`
``
288
`+
- VCR Chinese easy mode full test set (vcr_wiki_zh_easy)
`
``
289
`+
- VCR Chinese easy mode test 100 (vcr_wiki_zh_easy_100)
`
``
290
`+
- VCR Chinese easy mode test 500 (vcr_wiki_zh_easy_500)
`
``
291
`+
- VCR Chinese hard mode
`
``
292
`+
- VCR Chinese hard mode full test set (vcr_wiki_zh_hard)
`
``
293
`+
- VCR Chinese hard mode test 100 (vcr_wiki_zh_hard_100)
`
``
294
`+
- VCR Chinese hard mode test 500 (vcr_wiki_zh_hard_500)
`
283
295
`- VizWizVQA (vizwiz_vqa)
`
284
296
`- VizWizVQA Validation (vizwiz_vqa_val)
`
285
297
`- VizWizVQA Test (vizwiz_vqa_test)
`