ZacharyZhang-NY
77219c930b
Ground truth comes only from third-party annotations (MMLongBench-Doc
evidence_page_ids, VisRAG qrels, ScreenSpot-v2 bboxes, Video-MME QA,
LongMemEval answer_session_ids, CodeSearchNet func_path+func_name) and
from document structure; no model judgement is used anywhere.
- bench/corpus/manifest.jsonl: 28 sources with url, retrieved_at, sha256,
annotation_source, license, files[]; verified by bench.manifest_check
- bench/sets/{pdf,image,ui_screenshot,video,code,conversation}.{jsonl} plus
corpus indexes and a manifest that freezes every file's sha256
- 2,928 answerable + 2,380 unanswerable queries over 854 holders; every
query carries scope {holder, scenario, as_of} for transactive routing
- bench/validate_sets.py fails on missing gold, holder mismatch between
gold and query, gold observed after as_of, and manifest digest drift
431 lines
292 KiB
JSON
431 lines
292 KiB
JSON
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8np5YKYx3sU"}], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:181-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:181-1", "question": "How many men and women are presenting on the stage?\nA. Six men and three women.\nB. Five men and two women.\nC. Four men and three women.\nD. Four men and four women.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8np5YKYx3sU"}], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:181-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:181-2", "question": "What clothes is the singer wearing?\nA. A yellow shirt.\nB. A blue short-sleeve.\nC. A purple vest.\nD. A black skirt.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8np5YKYx3sU"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:181-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:181-3", "question": "What are the people on the stage doing in this video?\nA. They are reciting poetry.\nB. They are singing and dancing.\nC. They are performing acrobatics.\nD. They are performing a drama.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2QTiAmvygC4"}], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:182-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:182-1", "question": "Which color of pants is the person wearing while playing the piano in the video?\nA. Black.\nB. Purple.\nC. Brown.\nD. Blue.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2QTiAmvygC4"}], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:182-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:182-2", "question": "What is the exact number of performers in the video?\nA. 5.\nB. 4.\nC. 3.\nD. 2.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2QTiAmvygC4"}], "modality": "video", "origin": {"category": "Artistic Performance/Information Synopsis/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:182-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:182-3", "question": "What is happening in the video?\nA. They are performing a drama.\nB. They are reciting poetry.\nC. They are performing acrobatics.\nD. They are singing a song.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1q-5IIyZL20"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:197-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:197-1", "question": "According the video, what is the appearance of the clothes worn by the man holding a dog?\nA. A lovable magic dragon.\nB. A tree with lots of leaves.\nC. An elderly yellow cat.\nD. A sweet candy.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1q-5IIyZL20"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:197-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:197-2", "question": "What is the function of the black plastic bag shown in the video?\nA. To store the dog's treats for later.\nB. To carry the dog's toys during walks.\nC. To collect water for the dog to drink.\nD. To catch the dog's poo.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1q-5IIyZL20"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:197-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:197-3", "question": "Which of the following items is not placed on the judge's table who is speaking at the end of this video?\nA. A stuffed toy of a dragon.\nB. A photo of a white dog.\nC. Two mugs.\nD. A microphone.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4H8hcvNeWtg"}], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:206-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:206-1", "question": "What is the total number of people in the video?\nA. 7.\nB. 6.\nC. 5.\nD. 8.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4H8hcvNeWtg"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:206-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:206-2", "question": "Did they successfully play the game of telephone in the video?\nA. Yes..\nB. No.\nC. They did not play this game in the video.\nD. It is not possible to determine from the video if they successfully played the game of telephone.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4H8hcvNeWtg"}], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:206-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:206-3", "question": "How many people are wearing ties in the video?\nA. 4.\nB. 5.\nC. 3.\nD. 2.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:44ivpEIcBhE"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:208-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:208-1", "question": "Which instrument is the performer on the stage holding in the video?\nA. Trumpet.\nB. Saxophone.\nC. Violin.\nD. Guitar.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:44ivpEIcBhE"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:208-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:208-2", "question": "Who was the first person to press the button and turn the chair around in the video?\nA. The woman in gold clothes.\nB. Nobody.\nC. The person performing on stage.\nD. The man in a blue shirt.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:44ivpEIcBhE"}], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:208-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:208-3", "question": "Which option correctly indicates the number of microphones on the stage?\nA. 4.\nB. 3.\nC. 2.\nD. 1.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:026dzf-vc5g"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:212-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:212-1", "question": "Which skill is not included in the little girl's performance?\nA. Backflip.\nB. Cartweel.\nC. Handstand.\nD. Full split.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:026dzf-vc5g"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:212-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:212-2", "question": "According to the little girl's expression, how does she feel after finishing her performance?\nA. Depressed.\nB. Ashamed.\nC. Calm.\nD. Excited.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:026dzf-vc5g"}], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:212-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:212-3", "question": "What is the color of the little girl wearing shorts?\nA. Pink.\nB. Blue.\nC. White.\nD. Black.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5Knkqo-lYF0"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:216-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:216-1", "question": "What does the girl wear above the head during her performance?\nA. A red hat.\nB. A yellow headscarf.\nC. A red headscarf.\nD. A yellow hat.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5Knkqo-lYF0"}], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:216-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:216-2", "question": "Which sentence best describes the girl's dress?\nA. It is over-sized for her.\nB. It is colorful.\nC. It is very long.\nD. None of the above is correct.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5Knkqo-lYF0"}], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:216-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:216-3", "question": "How many rolls does the girl do in her performance?\nA. More than 5 but less than or equal to 10.\nB. Less than or equal to 5.\nC. More than 10 but less than or equal to 15.\nD. More than 15.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:-3t1rj8g6yg"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:482-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:482-1", "question": "What does this video document?\nA. What technology has been adopted for the National Theatre's live broadcast.\nB. Behind the scenes at the National Theatre.\nC. The popularity of the art of opera today.\nD. Can't extrapolate from the video.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:-3t1rj8g6yg"}], "modality": "video", "origin": {"category": "Artistic Performance/OCR Problems/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:482-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:482-2", "question": "Which play is featured at the end of the video?\nA. Macbeth.\nB. Hamlet.\nC. The Lehman Trilogy.\nD. War Horse.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:-3t1rj8g6yg"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:482-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:482-3", "question": "What can be inferred about broadcast quality from the video description?\nA. It utilizes state-of-the-art filming tailored to each play.\nB. It is broadcast in standard definition.\nC. The filming techniques are outdated.\nD. The plays are edited before being broadcast.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:323v_FtWqvo"}], "modality": "video", "origin": {"category": "Artistic Performance/Spatial Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:483-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:483-1", "question": "What is the primary theme of the high school theatre show featured in the video?\nA. Social justice issues.\nB. Classic literature adaptations.\nC. The celebration of school spirit.\nD. The exploration of modern art.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:323v_FtWqvo"}], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:483-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:483-2", "question": "How are the students dressed in the video?\nA. In period costumes.\nB. In formal attire.\nC. In casual streetwear.\nD. In matching thematic outfits.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:323v_FtWqvo"}], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:483-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:483-3", "question": "Based on the video, what setting is the high school theatre show trying to replicate?\nA. A professional Broadway stage.\nB. An experimental black box theatre.\nC. A historical setting.\nD. A classic Shakespearean stage.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1uqupftxFOM"}], "modality": "video", "origin": {"category": "Artistic Performance/Temporal Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:496-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:496-1", "question": "According to this video, in which order do the following events happen?\n(a) The magician took the white cloth away from the photo frame.\n(b) The magician led a self introduction.\n(c) The magician produced a feather.\nA. (a)(b)(c).\nB. (b)(c)(a).\nC. (c)(b)(a).\nD. (b)(a)(c).", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1uqupftxFOM"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:496-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:496-2", "question": "What is the last magic the magician played?\nA. He produced a small leather.\nB. He produced a large leather from a levitating small leather.\nC. His hands waved in the air.\nD. None of the above.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1uqupftxFOM"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:496-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:496-3", "question": "What sentence best describes the performance?\nA. The magic is not wonderful enough to make the audiences cheer up.\nB. One of the judges stops the performance.\nC. The magician does the magic with his eyes closed.\nD. The magician needs other tools besides leathers.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1sTNqJVrqx8"}], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:504-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:504-1", "question": "What other instrument is there on the stage besides the piano?\nA. Guitar.\nB. Trumpet.\nC. Saxophone.\nD. Violin.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1sTNqJVrqx8"}], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:504-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:504-2", "question": "Whose song did the performer sing in the video?\nA. Michael Jackson.\nB. Adele.\nC. Lady Gaga.\nD. Taylor Swift.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1sTNqJVrqx8"}], "modality": "video", "origin": {"category": "Artistic Performance/Spatial Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:504-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:504-3", "question": "From the perspective of the performer, is the judge wearing black clothes on her left or right side?\nA. Right.\nB. Middle.\nC. Left.\nD. There are no judges wearing black clothes.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6dmTmP4Dsw8"}], "modality": "video", "origin": {"category": "Artistic Performance/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:788-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:788-1", "question": "What overarching story is told in the video?\nA. The story of a princess who searches for her long-lost family and is finally reunited.\nB. The story of a knight who fights the evil witch to save the kingdom.\nC. The story of a princess who discovers her magical powers and their consequences.\nD. The story of a knight who saves and awakens a princess from a dragon.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6dmTmP4Dsw8"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:788-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:788-2", "question": "What motivates the main character to flee her hometown?\nA. she was banished from the country.\nB. she was greatly oppressed by life and wished to go for freedom.\nC. she exposed her superpowers, causing her to panic.\nD. she was pursuing a prophecy about her fate.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6dmTmP4Dsw8"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:788-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:788-3", "question": "What can be inferred about how the video's protagonist initially treated her powers and her kingdom?\nA. She sees her superpowers as a threat and isolates herself, unintentionally causing harm to her kingdom.\nB. She sees her superpowers as an asset and wishes to convince the past to use them to create value for her kingdom and benefit her people.\nC. Her superpowers inspire ambition; she desires to use her superpowers to earn a place for herself in her kingdom and begins to formulate meticulous plans.\nD. She is indifferent to her kingdom and abandons it without a second thought.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0bwyCF0HteE"}], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:792-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:792-1", "question": "How many magic shows are included in this video?\nA. 10.\nB. 9.\nC. 8.\nD. 7.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0bwyCF0HteE"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:792-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:792-2", "question": "What is special about the second magic?\nA. It incorporates fire manipulation and pyrotechnics.\nB. It includes a disappearing act with a grand illusion.\nC. It features mind-reading and psychic abilities.\nD. It is about dogs' quick change, while others are about humans' quick change.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0bwyCF0HteE"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:792-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:792-3", "question": "What are the magic tricks about?\nA. Cards trick magics.\nB. Quick change magics.\nC. Street magics.\nD. Coins trick magics.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5y5_VyEwZhc"}], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:813-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:813-1", "question": "Which acrobatic skill is absent from this video?\nA. Trampoline.\nB. Hula hoops.\nC. Ropes.\nD. Stilts.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3rTsETO3s9U"}], "modality": "video", "origin": {"category": "Film & Television/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:092-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:092-1", "question": "What does the girl want to do in the video?\nA. Running.\nB. Writing.\nC. Painting.\nD. Playing.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3rTsETO3s9U"}], "modality": "video", "origin": {"category": "Film & Television/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:092-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:092-2", "question": "What does the girl's mom want her to do in this video?\nA. Seeing a movie.\nB. Exercising.\nC. Playing with friends.\nD. Studying math.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3rTsETO3s9U"}], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:092-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:092-3", "question": "How does the girl perceive her future with regard to decision-making and control?\nA. She doesn't care about her future.\nB. She wishes to make decision by herself.\nC. She feels she will be controlled by her mom.\nD. She has no hope for the future.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:56yT3H_DjVE"}], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:100-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:100-1", "question": "Which animal appears in this video?\nA. Kangaroo.\nB. Bird.\nC. Deer.\nD. Panda.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:56yT3H_DjVE"}], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:100-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:100-2", "question": "What does the panda use to fight with enemies in the video?\nA. A bamboo.\nB. A stick.\nC. An axe.\nD. A spear.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:56yT3H_DjVE"}], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:100-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:100-3", "question": "Which type of tree is depicted behind the meditating panda?\nA. A peach tree.\nB. A pear tree.\nC. An apple tree.\nD. A pomegranate tree.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0IdYJGBmguM"}], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:102-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:102-1", "question": "According to the video, who is about to get married?\nA. The man in short sleeves.\nB. The man in the dark suit.\nC. The man in the blue shirt.\nD. It is unclear.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0IdYJGBmguM"}], "modality": "video", "origin": {"category": "Film & Television/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:102-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:102-2", "question": "What are the people in the video arguing about?\nA. Whether the person in the blue shirt will ever get married.\nB. Which person the man in the suit should choose as his best man.\nC. Whether the man in the suit should get married.\nD. How many times the man in the suit is getting married.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0IdYJGBmguM"}], "modality": "video", "origin": {"category": "Film & Television/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:102-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:102-3", "question": "How many people are wearing ties in the video?\nA. 2.\nB. 3.\nC. 0.\nD. 1.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2Qno7H4BwAU"}], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:107-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:107-1", "question": "What object is the man in the gray T-shirt pulling?\nA. A kite.\nB. A balloon.\nC. A ladder.\nD. A helicopter.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2Qno7H4BwAU"}], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:107-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:107-2", "question": "Whar color is the helicopter in the video?\nA. Orange.\nB. Pink.\nC. Blue.\nD. Black.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2Qno7H4BwAU"}], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:107-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:107-3", "question": "What happens after the helicopter takes off in this video?\nA. It is pulled to ground and crash.\nB. It flies to sky.\nC. It falls into water.\nD. It is hit by a missile.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:43wqf_KhiUo"}], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:121-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:121-1", "question": "Who was sentenced to have guilt in this video?\nA. The actor who triggered the gun.\nB. The prop master who was in charge of this gun.\nC. The film director.\nD. The deceased himself.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:43wqf_KhiUo"}], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:121-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:121-2", "question": "Which color is the coat worn by the news anchor at the beginning of the video?\nA. Blue.\nB. Green.\nC. Yellow.\nD. Pink.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:43wqf_KhiUo"}], "modality": "video", "origin": {"category": "Film & Television/Spatial Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:121-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:121-3", "question": "Based on the information provided in the video, which of the following locations is where the shooting occurred?\nA. The court.\nB. The actor's house.\nC. The TV station.\nD. A ranch in New Mexico.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2za5RwplXdI"}], "modality": "video", "origin": {"category": "Film & Television/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:397-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:397-1", "question": "What happens when a star falls on the earth?\nA. It smashes a big hole in the ground.\nB. It brings elements that never shows on earth.\nC. It makes a beautiful star sky.\nD. It causes a disaster and destroys dinosaurs.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2za5RwplXdI"}], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:397-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:397-2", "question": "According to the video, what do the dead dinosaurs transform into?\nA. Star and sun.\nB. Birds.\nC. Human.\nD. Stone.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2za5RwplXdI"}], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:397-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:397-3", "question": "What story does the video tell?\nA. Who is the ancestor of birds.\nB. How fossil comes about.\nC. We should visit the dinosaur museum.\nD. Dinosaurs went where.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:44G3dPME330"}], "modality": "video", "origin": {"category": "Film & Television/Counting Problem/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:402-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:402-1", "question": "If a cue appears in the bottom left corner when a splice occurs, then how many video clips were used to compose this video?\nA. 7.\nB. 10.\nC. 3.\nD. 1.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:44G3dPME330"}], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:402-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:402-2", "question": "What common element do these clips in the video share?\nA. There are four people in the room.\nB. Everyone is eating something.\nC. Everyone is sitting on the couch.\nD. Sheldon changed the Wi-Fi password.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:44G3dPME330"}], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:402-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:402-3", "question": "What color is the laptop the woman is holding at the beginning of the video?\nA. Black.\nB. Pink.\nC. Silver.\nD. Green.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4aPxxE345OM"}], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:404-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:404-1", "question": "Based on the video, who is Griffin more interested in?\nA. Manny's mom.\nB. Manny.\nC. Manny's dad.\nD. Cannot determine.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4aPxxE345OM"}], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:404-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:404-2", "question": "Based on the video, what is Manny's family's pet?\nA. Griffin.\nB. A dog.\nC. A rabbit.\nD. A cat.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4aPxxE345OM"}], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:404-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:404-3", "question": "Based on the video, why does Manny want to be friends with Griffin?\nA. Because he has a crush on Griffin's sister.\nB. Because Griffin is good at basketball.\nC. Because Griffin admires Manny's dad.\nD. Because he thinks Griffin is cool.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3EQLFHRHpag"}], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:419-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:419-1", "question": "The problems people encounter in the video are caused by what?\nA. Catastrophic weather.\nB. Global warming.\nC. Financial crisis.\nD. Oil crisis.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3EQLFHRHpag"}], "modality": "video", "origin": {"category": "Film & Television/Temporal Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:419-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:419-2", "question": "In which part of the video is a man wearing a red jersey interviewed?\nA. There is no interview with a man in red clothing.\nB. End of the video.\nC. Beginning of the video.\nD. Middle of the video.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3EQLFHRHpag"}], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:419-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:419-3", "question": "What emotion is the song sung by the woman at the end of the video expressing?\nA. Respect for leaders.\nB. Concern about climate change.\nC. Yearning for a beautiful love.\nD. Longing for the outside world.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:20gUIdXGuAs"}], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:428-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:428-1", "question": "Based on the video, why was Google sued?\nA. Google was sued for unlawfully using copyrighted content to train AI models.\nB. Google was not the subject of a lawsuit.\nC. Google was sued for violating antitrust laws.\nD. Google was sued due to the negative societal effects caused by its AI robots.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:20gUIdXGuAs"}], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:428-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:428-2", "question": "What is the likely liquid contained in the cup on the desk of the news studio?\nA. Juice.\nB. Water.\nC. Red wine.\nD. Cola.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:20gUIdXGuAs"}], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:428-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:428-3", "question": "How is the game content that appears in the video produced?\nA. Pre-set by the game company.\nB. Performed by real people.\nC. Generated by AI.\nD. Undeterminable.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1NYQf_OXDqI"}], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:700-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:700-1", "question": "Based on the video, what is the relationship of Tom and Jerry when they meet the witch?\nA. Competition.\nB. Cooperation.\nC. Hostile.\nD. No one is correct above.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1NYQf_OXDqI"}], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:700-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:700-2", "question": "How do Tom and Jerry share a similarity as depicted in the video?\nA. Sleeping.\nB. Liking eating cheese.\nC. Protecting Dorothy.\nD. Liking eating chicken.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1NYQf_OXDqI"}], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:700-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:700-3", "question": "In line with the video evidence, what is the weakness of the villain?\nA. Water.\nB. Dark.\nC. Overconfidence.\nD. Attachment.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:068rdc75mHM"}], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:717-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:717-1", "question": "According to the video, what inconsistency in quantum mechanics was discovered by Einstein and published in a paper?\nA. The trajectory of an object will be described as a probability wave and is no longer certain.\nB. There are problems with its mathematical equations.\nC. Two particles at a great distance can instantly influence each other, i.e., quantum entanglement.\nD. It's not mentioned in the video.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:068rdc75mHM"}], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:717-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:717-2", "question": "The video repeatedly shows a person at a table, lifting a cup and another cup also floating up, with two light balls under each cup. What is this segment trying to show?\nA. Quantum entanglement effect.\nB. This is a magic trick.\nC. Objects propagate in the form of probability waves.\nD. Einstein's photoelectric effect.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:068rdc75mHM"}], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:717-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:717-3", "question": "According to the video, how did the debate between Einstein and Bohr about quantum mechanics turn out?\nA. The experiment by the team at the high-altitude observatory further confirmed that Bohr was right.\nB. Bell's experiment completely confirmed that Bohr was correct.\nC. Bell's experiment completely confirmed that Einstein was correct.\nD. Pan Jianwei's team confirmed that Bohr was correct.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:54H8ppxnp8I"}], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:722-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:722-1", "question": "According to the video, does the male interviewee wearing a black suit have a stance that is more in favor of men or women?\nA. Neutral.\nB. In favor of men.\nC. In favor of women.\nD. Cannot be determined.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:54H8ppxnp8I"}], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:722-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:722-2", "question": "According to the video, the male interviewee wearing a tight black shirt told a joke about his experience in a popular culture class. He said if there's a movie that more than half of the class has seen, he would buy everyone pizza. Many years have passed, and he hasn't found such a movie yet. What does he imply with this joke?\nA. Consensus culture is becoming less common.\nB. People no longer like watching movies.\nC. The pizza from the place he orders is not good.\nD. There's less popular culture.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:54H8ppxnp8I"}], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:722-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:722-3", "question": "Based on the content of the video, whose viewpoint is relatively the most radical?\nA. The female interviewee.\nB. The male interviewee wearing a shirt.\nC. The show host.\nD. The male interviewee wearing a black suit.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:54k2g9ddy4M"}], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:724-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:724-1", "question": "According to the video, which of the following news items did NOT appear in this news segment?\nA. An earthquake occurred in the United States.\nB. Potential community spread of measles in Canada.\nC. Fire destroys First Nation's only school.\nD. Josh Liendo swims into the history books.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:24i4ncHuf6A"}], "modality": "video", "origin": {"category": "Knowledge/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:005-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:005-1", "question": "According to the video, how many individuals were in the car when Archduke Franz Ferdinand was assassinated?\nA. Three.\nB. Two.\nC. One.\nD. Four.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:24i4ncHuf6A"}], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:005-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:005-3", "question": "Which of the following options is incorrect regarding the events in Sarajevo depicted in the video?\nA. It was organized by the Black Hand in Serbia.\nB. Ferdinand was sitting on the left side of the car.\nC. Ferdinand was wearing a white hat.\nD. The killer was wearing black suit.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:40BlVzjxu-I"}], "modality": "video", "origin": {"category": "Knowledge/Temporal Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:006-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:006-2", "question": "What happened when Irish imiggrants brought the tradition of St. Patrick's Day to America?\nA. They began to center around drinking and celebrating the festival.\nB. St. Patrick moved to America.\nC. They celebrated St. Patrick's birth instead.\nD. They attended the church and gather for feasts.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0ay2Qy3wBe8"}], "modality": "video", "origin": {"category": "Knowledge/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:007-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:007-1", "question": "How is the smoke generated by the man depicted in the video?\nA. By burning a piece of cloth.\nB. By lighting a torch.\nC. By smoking.\nD. By lighting a bonefire.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0ay2Qy3wBe8"}], "modality": "video", "origin": {"category": "Knowledge/OCR Problems/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:007-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:007-3", "question": "What is the specific sentence in the smart phone that makes the man embarrassed?\nA. BTW...you got something in your teeth!\nB. Dude! You gotta come toBigStuf Camps!\nC. Smoke Sig 2.0.\nD. Last but not least.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5wLv3pCqZ9o"}], "modality": "video", "origin": {"category": "Knowledge/Action Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:013-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:013-2", "question": "According to the video, which of the following ingredients is not used in the artwork?\nA. Shell.\nB. Glue.\nC. Blue Food Dye.\nD. Oil.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5_fXicEnKKk"}], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:016-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:016-1", "question": "When was the painting mentioned in the video painted?\nA. 1998.\nB. 1889.\nC. 1899.\nD. 1988.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5_fXicEnKKk"}], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:016-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:016-3", "question": "Which of the following elements is not present in the \"Starry Sky\"?\nA. Houses.\nB. Stars.\nC. Castle.\nD. Moon.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:39HTpUG1MwQ"}], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:030-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:030-2", "question": "What color is the ATP in the video?\nA. Black.\nB. Green.\nC. Blue.\nD. Red.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5ksVshqVuiM"}], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:040-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:040-1", "question": "When did the events described in the video take place?\nA. Between 2014 and 2016.\nB. Between 2020 and 2023.\nC. Between 1997 and 2002.\nD. Between 2006 and 2008.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5ksVshqVuiM"}], "modality": "video", "origin": {"category": "Knowledge/Information Synopsis/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:040-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:040-3", "question": "What is the main content of this video?\nA. Amazon's development.\nB. The dot-com Bubble.\nC. Company competition.\nD. Stock market.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:08km9Yqbt-A"}], "modality": "video", "origin": {"category": "Knowledge/Temporal Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:050-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:050-2", "question": "On what date is the total eclipse supposed to occur in the video?\nA. August 1, 2008.\nB. July 22, 2009.\nC. June 29, 2024.\nD. April 8, 2024.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8TNPeimqOO0"}], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:060-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:060-1", "question": "Which element doesn't show up in the video?\nA. Iceberg.\nB. Orcas.\nC. Sea bird.\nD. Polar bear.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8TNPeimqOO0"}], "modality": "video", "origin": {"category": "Knowledge/Spatial Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:060-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:060-3", "question": "Which of the following facts is not caused by the iceberg mentioned in the video?\nA. Orcas and sea birds around the iceberg become more active.\nB. South Georgia Islands is affected.\nC. The thick mist at sea near the melting iceberg.\nD. Sea level may rises a little bit.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7iXM5aq53Ts"}], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:073-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:073-2", "question": "What is the icon of Keyborad Cleaner app shown in the video?\nA. The icon features a colorful image of a keyboard with sparkling keys.\nB. The icon depicts two black letters of K and C.\nC. The icon displays a cartoon character holding a broom and cleaning a keyboard.\nD. The icon shows a magnifying glass zooming in on a dirty keyboard.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:540LkURTR7g"}], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:077-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:077-1", "question": "What is the color of the tall drinking glass initially held by the woman?\nA. Blue.\nB. Red.\nC. Green.\nD. Yellow.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:540LkURTR7g"}], "modality": "video", "origin": {"category": "Knowledge/Action Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:077-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:077-3", "question": "According to this video, what is the purpose of adding fresh produce to the water?\nA. To enhance the water's purification and cleansing properties.\nB. To infuse the water with a refreshing and subtle flavor.\nC. To visually enhance the appearance of the water.\nD. To turn the water into a thick smoothie.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:21q-lDikdBg"}], "modality": "video", "origin": {"category": "Knowledge/Spatial Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:080-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:080-2", "question": "As depicted in the video, what are the resistance bands parallel to when the man is pulling apart?\nA. Neck.\nB. Chest.\nC. Chin.\nD. Nose.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8l1NyR6UvxU"}], "modality": "video", "origin": {"category": "Knowledge/Temporal Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:307-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:307-1", "question": "Which of the following events happened before 72 BCE?\nA. The Senate retaliated with the full force of two legion.\nB. Praetor Variniu was ambushed.\nC. Crixus died in a battle.\nD. Marcus Licinius Crassus had assumed control of the war.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8l1NyR6UvxU"}], "modality": "video", "origin": {"category": "Knowledge/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:307-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:307-3", "question": "What happened when the main character owned an army of about 120,000 soldiers?\nA. The army captured Rome.\nB. The army marched beyond Rome's border.\nC. The army climbed the Alp.\nD. The army turned south.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4jmMWohs1XM"}], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:311-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:311-2", "question": "Which of the following statements is not true?\nA. The colors on the Roman scultures faded in Renaissance.\nB. \"Laocoön and His Sons\" is originally full of color.\nC. Artists in the Renaissance liked white marble because they wanted to imitated the Roman sculptures.\nD. \"David\" is originally full of color.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1pHkv4KUiFY"}], "modality": "video", "origin": {"category": "Knowledge/Counting Problem/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:314-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:314-1", "question": "How many listeners gave busking donations to the girl before she started playing?\nA. One.\nB. Two.\nC. None.\nD. Three.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1pHkv4KUiFY"}], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:314-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:314-3", "question": "What color shoes does the little girl wear?\nA. Yellow.\nB. Orange.\nC. Pink.\nD. Black.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7Hk9jct2ozY"}], "modality": "video", "origin": {"category": "Knowledge/Temporal Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:321-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:321-2", "question": "What is the correct order in which the following events are presented in the video?\n(a) The nucleus is introduced.\n(b) Base pairing.\n(c) Cell division.\nA. (a)(c)(b).\nB. (c)(a)(b).\nC. (c)(b)(a).\nD. (a)(c)(b).", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3uV8XZcIBbk"}], "modality": "video", "origin": {"category": "Knowledge/Information Synopsis/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:329-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:329-1", "question": "What is the main topic of the video?\nA. The history of heart transplantation.\nB. The manufacture of durable artificial hearts.\nC. Developments in the treatment of cardiac arrhythmias.\nD. The development and production of new drugs for cardiovascular disease.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3uV8XZcIBbk"}], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:329-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:329-3", "question": "What is the role of the company BiVACOR in the field of medical devices?\nA. BiVACOR is engineering a long-term device intended to completely replace the function of a patient's native heart.\nB. BiVACOR is developing a temporary device for heart assistance during surgery.\nC. BiVACOR is focused on creating diagnostic tools for heart disease.\nD. BiVACOR designs pacemakers for regulating heart rhythm disorders.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:257wV-AbKaE"}], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:334-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:334-2", "question": "As shown in the video, if a money launderer is rigging a bet, what stage of money laundering might it be at?\nA. Phase one.\nB. Phase two.\nC. Phase three.\nD. Cannot be inferred.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7Ni4gcl4tpE"}], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:360-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:360-1", "question": "What is the background color of the sign that marks the highest point of Kiribati?\nA. White.\nB. Blue.\nC. Red.\nD. Black.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7Ni4gcl4tpE"}], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:360-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:360-3", "question": "What did the youtuber advise in order to save Kiribati?\nA. Bring tourists there and make them aware of the danger of climate change.\nB. Build up the sea wall.\nC. Bring tourists there and attract more money.\nD. Buy other islands and ask local people to move to these higher islands.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3fQxvz4ENDg"}], "modality": "video", "origin": {"category": "Knowledge/OCR Problems/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:364-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:364-2", "question": "Which AI technology is not featured in the video?\nA. Chatbot.\nB. Automatic driving.\nC. Generative AI.\nD. Deepfake.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7fnVcXfPe5c"}], "modality": "video", "origin": {"category": "Knowledge/Spatial Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:371-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:371-1", "question": "Which option correctly indicates the location of the \"psychological tip\" written in white on the board when illustrating the third suggestion in the video?\nA. Between \"REMOVE THE FILTER\" and \"THREAD THE CONVERSATION\".\nB. Below \"THE PRATFALL EFFECT\".\nC. Between \"THREAD THE CONVERSATION\" and \"THE PRATFALL EFFECT\".\nD. It can't be recognized in the video.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7fnVcXfPe5c"}], "modality": "video", "origin": {"category": "Knowledge/Action Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:371-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:371-3", "question": "What is the purpose of drawing a bifurcated tree when introducing the threading?\nA. To illustrate multiple possible topics to continue the conversation.\nB. To show various approaches to get yourself understood.\nC. To demonstrate the consequences of removing the filter.\nD. To clarify the importance of expressing yourself.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2Bns2m5Bg4M"}], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:380-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:380-2", "question": "As depicted in the video, which finger touches the chopsticks?\nA. Little finger on the right hand.\nB. Little finger on the left hand.\nC. Index finger on the right hand.\nD. Index finger on the left hand.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6DAFkaGUiT4"}], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:382-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:382-1", "question": "According to the video, why is IMAX not suitable for filming movies?\nA. The motors make too much noise and distracte the actors.\nB. The cameras are so heavy, and require specific training to operate them.\nC. IMAX movies are expensive to produce.\nD. All of the above.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6DAFkaGUiT4"}], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:382-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:382-3", "question": "Which IMAX movie isn't in the video?\nA. The Hunger Games: Catching Fire.\nB. The Dark Knight.\nC. Oppenheimer.\nD. Dune.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0rCbfsuKdYw"}], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:389-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:389-2", "question": "Which game is played on each generation of Play Stations in the video?\nA. Gran Turismo.\nB. The Last of Us.\nC. God of War.\nD. Grand Theft Auto V.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7D-gxaie6UI"}], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:603-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:603-1", "question": "In accordance with the video footage, which of the following diseases causes the most deaths?\nA. Tuberculosis.\nB. Malaria.\nC. Cholera.\nD. Typhoid.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7D-gxaie6UI"}], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:603-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:603-3", "question": "Based on the video, which of the following statements is correct?\nA. Roughly 30% of all northern Europeans were dying of TB, most of them were artists and writers.\nB. The consumption was thought to be only prevelant in white people.\nC. TB was incurable.\nD. Southern California came to be known as \"the land of new lungs\" for the reason that the air there can heal TB diseases.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0RxMZBLeqRI"}], "modality": "video", "origin": {"category": "Knowledge/Temporal Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:604-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:604-2", "question": "As depicted in the video, what happened when the Gypsies migrated to Europe?\nA. Slavery was abolished.\nB. They became increasingly enslaved in the Balkans as the Ottomans expanded their territory.\nC. They fought with Selic.\nD. They separated from the Turks.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5LU_XY0z2ZY"}], "modality": "video", "origin": {"category": "Knowledge/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:621-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:621-1", "question": "What is the theme of the video?\nA. Enhancing metabolic health as a strategy to combat Alzheimer's disease.\nB. Research progress and application prospects of beta-amyloid as a therapeutic target for Alzheimer's disease.\nC. Failed attempts to eradicate Alzheimer's disease through current medical treatments.\nD. Research on how human behavioural science can be used to improve cognitive performance and its potential as a strategy to combat Alzheimer's disease.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4twBzf6ngSc"}], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:240-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:240-1", "question": "Which of the following best describes the topic of the video?\nA. Destruction of illegal food at port.\nB. How is the juice sold at the port made.\nC. What kind of food do people bring into the port.\nD. What do people eat in the harbor.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4twBzf6ngSc"}], "modality": "video", "origin": {"category": "Life Record/OCR Problems/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:240-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:240-3", "question": "What are the potential risks associated with exotic animal diseases according to the bulletin board in the video?\nA. Animal.\nB. Agriculture.\nC. Airport.\nD. Human.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6NVr0cNiHPM"}], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:248-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:248-2", "question": "What is the order of skincare products used before makeup in the video?\nA. Face serum, toner, eye cream, face cream.\nB. Toner, face serum, eye cream, face cream.\nC. Face serum, toner, face cream, eye cream.\nD. Toner, face serum, face cream, eye cream.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2iHmlBmLKUE"}], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:250-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:250-1", "question": "Which topic does the video cover?\nA. How to apply perfume.\nB. How the perfume smells.\nC. How to refill perfume.\nD. How to choose a right perfume.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2iHmlBmLKUE"}], "modality": "video", "origin": {"category": "Life Record/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:250-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:250-3", "question": "Which of the following best describes the shape of the perfume bottle?\nA. Rounded.\nB. Triangular.\nC. Asymmetrical.\nD. Rectangular.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1sTQOxXFO44"}], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:251-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:251-2", "question": "What is the woman sitting on the floor ready to do at the end of the video?\nA. To play cell phone.\nB. To play games.\nC. To watch TV.\nD. To read a book.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3E4Zca1p64s"}], "modality": "video", "origin": {"category": "Life Record/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:260-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:260-1", "question": "What kind of cell phone is the person in the video using?\nA. iPhone 13.\nB. Google Pixel 8.\nC. Google Pixel 2.\nD. Google Pixel 3.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3E4Zca1p64s"}], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:260-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:260-3", "question": "What feature of the cell phone did the person in the video use?\nA. Phone call.\nB. Video editing.\nC. Photo shooting.\nD. Online games.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8e05W-wi38g"}], "modality": "video", "origin": {"category": "Life Record/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:264-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:264-2", "question": "Which animal is shown in the video?\nA. Kangaroo.\nB. Giraffe.\nC. Donkey.\nD. Horse.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5-4Od1qn53s"}], "modality": "video", "origin": {"category": "Life Record/OCR Problems/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:265-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:265-1", "question": "What is the lateral distance of the Buddha in the video?\nA. 48m.\nB. 46m.\nC. 45m.\nD. 47m.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5-4Od1qn53s"}], "modality": "video", "origin": {"category": "Life Record/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:265-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:265-3", "question": "In the video, what does the man's facial expression look like when he sees the scorpion skewer?\nA. Disgust.\nB. Joy.\nC. Sadness.\nD. Calmness.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2gFxZmb0dMo"}], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:266-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:266-2", "question": "What are the people in the video doing in the lake?\nA. Fishing.\nB. Swimming.\nC. Boating.\nD. Diving.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:27YZLpw0M98"}], "modality": "video", "origin": {"category": "Life Record/OCR Problems/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:268-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:268-1", "question": "What camera does the protagonist in the video use to shoot?\nA. Canon.\nB. Leica.\nC. Nikon.\nD. SONY.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:27YZLpw0M98"}], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:268-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:268-3", "question": "Which of the following topics is the most likely focus of this video?\nA. Camera advertising.\nB. Photography course.\nC. Promotional film.\nD. Publicity of tourist attractions.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6Cr_8tvvQ0k"}], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:276-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:276-2", "question": "What does the animal do in the video?\nA. It is pulled in circles by a person.\nB. It jumps on a person.\nC. It pulls a tree.\nD. It flies to the sky.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6EIrArTyLVU"}], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:284-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:284-1", "question": "What is the person in the background, wearing a white top and black shorts, doing while the person in pink is speaking at the beginning of the video?\nA. Sit-ups.\nB. Lying triceps extension.\nC. Using the bar for pull-ups.\nD. Push-up.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6EIrArTyLVU"}], "modality": "video", "origin": {"category": "Life Record/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:284-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:284-3", "question": "How many sit-ups did the man in the video, wearing a pink top and black pants, perform?\nA. 0.\nB. 1.\nC. 2.\nD. 3.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5kmnEgBSCfg"}], "modality": "video", "origin": {"category": "Life Record/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:286-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:286-2", "question": "What is the primary item that the two men in the video utilize for their workout?\nA. Dumbbel.\nB. Black bench.\nC. Black sofa.\nD. Black iron plate.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0ag_Qi5OEd0"}], "modality": "video", "origin": {"category": "Life Record/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:522-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:522-1", "question": "Which ingredient is not used in the video?\nA. Flower sticker.\nB. Can lids.\nC. Wool thread.\nD. Glue gun.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0ag_Qi5OEd0"}], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:522-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:522-3", "question": "According to the video, what is the sequential order in which the following tools are used?\n(a) Glue gun.\n(b) Needle.\n(c) Scissors.\nA. (a)(b)(c).\nB. (b)(c)(a).\nC. (b)(a)(c).\nD. (c)(a)(b).", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3EQzRz-V7uE"}], "modality": "video", "origin": {"category": "Life Record/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:526-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:526-2", "question": "Which of the following options is NOT one of the purposes of red threads?\nA. To make the left foot.\nB. To make the tail.\nC. To make the right foot.\nD. To make the nose.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5xi1iD4fkhc"}], "modality": "video", "origin": {"category": "Life Record/Counting Problem/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:533-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:533-1", "question": "How many cats in the video like mackerel the best?\nA. 3.\nB. 1.\nC. 2.\nD. 4.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5xi1iD4fkhc"}], "modality": "video", "origin": {"category": "Life Record/Action Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:533-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:533-3", "question": "What would most likely cause Mimi to eat on the floor?\nA. It can't climb the table.\nB. It's very timid.\nC. It fell off the table.\nD. It likes to eat on the floor.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6DbsOZU8mBM"}], "modality": "video", "origin": {"category": "Life Record/Temporal Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:540-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:540-2", "question": "What is the third baked food in the video?\nA. Scallop.\nB. Kobe beef.\nC. Bacon.\nD. Salmon.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3x8pvm0g5AU"}], "modality": "video", "origin": {"category": "Life Record/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:542-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:542-1", "question": "In which city did the video take place?\nA. Paris.\nB. London.\nC. New York.\nD. Hong Kong.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3x8pvm0g5AU"}], "modality": "video", "origin": {"category": "Life Record/Action Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:542-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:542-3", "question": "What is the model walking behind the one in a casual suit characterized by a rich print in vibrant shades of pink and white wearing?\nA. An oversized, short-sleeved shirt in a glossy, brown hue that suggests a leather-like material.\nB. A black wetsuit with a blue surfboard fin, reinforcing the aquatic theme of the outfit.\nC. A striking ensemble with a floral theme against a dark background, which gives a nocturnal, tropical vibe.\nD. An oversized, striped shirt jacket featuring a mix of blue tones and a pattern of classic denim patchwork.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3m29MQ-qPfg"}], "modality": "video", "origin": {"category": "Life Record/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:552-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:552-2", "question": "What is the student doing while the athlete is competing in the indoor stadium in the video?\nA. Shopping.\nB. Bathing.\nC. Studying.\nD. Preparing a meal.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4ME5ZfDg2aw"}], "modality": "video", "origin": {"category": "Life Record/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:566-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:566-1", "question": "Why does the author feel betrayed at the beginning of the video?\nA. Greenland is deserted.\nB. Greenland is not green.\nC. Greenland is very cold.\nD. Greenland is very expensive.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4ME5ZfDg2aw"}], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:566-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:566-3", "question": "What activities are recorded sequentially in the video?\nA. Explore ice sheet, take sled dog rides, visit residents.\nB. Explore ice sheet, visit residents, take sled dog rides.\nC. Take sled dog rides, visit residents, explore ice sheet.\nD. Visit residents, explore ice sheet, take sled dog rides.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1NcGHbFWBFA"}], "modality": "video", "origin": {"category": "Life Record/Counting Problem/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:573-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:573-2", "question": "How many hats does the hamster change in this video?\nA. 4.\nB. 6.\nC. 5.\nD. 7.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8-aI8Fp2bPU"}], "modality": "video", "origin": {"category": "Life Record/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:582-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:582-1", "question": "What is the next exercise after the burpee training in the video?\nA. Matrix pushups.\nB. Jump suqats.\nC. Shadowboxing.\nD. Sit-ups.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:8-aI8Fp2bPU"}], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:582-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:582-3", "question": "In what order do burpees, jump squats and push-ups appear in the video?\nA. First jump squats, then push-ups, then burpees.\nB. First jump squats, then burpees, then push-ups, then jump squats again.\nC. First burpees, then push-ups, then jump squats.\nD. First burpees, then jump squats, then push-ups.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2ka5AleJ48I"}], "modality": "video", "origin": {"category": "Life Record/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:586-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:586-2", "question": "What is the main product introduced by the male protagonist in the video?\nA. An open run headphones.\nB. A turban with built-in speakers.\nC. A sweatshirt with noise-canceling capabilities.\nD. A hearing aid with wireless charging.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3MJNKd10kxM"}], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:822-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:822-1", "question": "In which order do the following topics are introduced in this video ?\n(a) Spring pocket DIY.\n(b) Easter bucket floral DIY.\n(c) Farmhouse bunny in a bucket DIY.\n(d) Spring tin bucket floral DIY.\n(e) Bunny hop decor.\nA. (a)(b)(c)(d)(e).\nB. (a)(c)(b)(e)(d).\nC. (b)(e)(a)(d)(c).\nD. (b)(a)(d)(c)(e).", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:3MJNKd10kxM"}], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:822-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:822-3", "question": "What is the best caption for this video?\nA. Winter Holiday Decorations: Festive DIY Crafts for Christmas and New Year.\nB. Spring Easter Collection #4 DIY Crafts Farmhouse Whimsical Rustic Crafts using Florals and More.\nC. Gardening Tips and Tricks: Growing Your Own Organic Vegetables.\nD. A Travel Vlog: Exploring Exotic Destinations Around the World.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6Pt3-NDxzRk"}], "modality": "video", "origin": {"category": "Life Record/Temporal Perception/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:831-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:831-2", "question": "Could you please indicate the specific time in the video when the minor kitchen mishap occurs while cooking?\nA. Wednesday breakfast.\nB. Tuesday lunch.\nC. Friday dinner.\nD. Tuesday dinner.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4VniCsSusJs"}], "modality": "video", "origin": {"category": "Life Record/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:837-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:837-1", "question": "Which of the following food combinations is the favorite of the two people in the video?\nA. Hot sauce and bananas.\nB. Spaghetti with tacos.\nC. Crazy Sandwich.\nD. Cookies and Cheese.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4VniCsSusJs"}], "modality": "video", "origin": {"category": "Life Record/Object Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:837-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:837-3", "question": "What is the most significant difference between the first clip in the video and the other two?\nA. The food combinations in the first clip were all recommended by friends online.\nB. The first clip is all about weird food combinations.\nC. The food in the first clip is not additionally processed.\nD. The food in the first clip is not mixed together.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1evyOuQz-jM"}], "modality": "video", "origin": {"category": "Life Record/Object Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:845-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:845-2", "question": "What makes the dual diamond ring from Leon Diamond unique or special?\nA. It is worn on two fingers.\nB. It is made from rare and expensive materials.\nC. It can change colors based on the wearer's mood..\nD. It has a hidden compartment for storing small items..", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0eJvnKwGThw"}], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:847-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:847-1", "question": "What is this video documenting?\nA. A concert.\nB. Clothing ads.\nC. A clothing fashion walk.\nD. Designer Workshop.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4ZK-m01XSQ8"}], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:298-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:298-1", "question": "Which track athlete knocked down the railing first in the video?\nA. Track No. 2.\nB. Track No. 8.\nC. Track No. 3.\nD. Track No. 7.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4ZK-m01XSQ8"}], "modality": "video", "origin": {"category": "Multilingual/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:298-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:298-2", "question": "What was the total number of athletes who participated in the game in the video?\nA. 8.\nB. 7.\nC. 6.\nD. 9.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4ZK-m01XSQ8"}], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:298-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:298-3", "question": "Which of the following track athletes did not cause any disruption by knocking down railings during the competition?\nA. Track No. 4.\nB. Track No. 8.\nC. Track No. 1.\nD. Track No. 3.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5R64pAPUZmk"}], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:597-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:597-1", "question": "What does the girl take out from the envelop?\nA. A mirror.\nB. A book.\nC. A paper.\nD. A card.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5R64pAPUZmk"}], "modality": "video", "origin": {"category": "Multilingual/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:597-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:597-2", "question": "What is the usage of the thing that the girl take out from envelop?\nA. Identify herself.\nB. Buy food.\nC. Start elevator.\nD. Take money from bank.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5R64pAPUZmk"}], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:597-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:597-3", "question": "What is the animal flying in sky?\nA. Seagull.\nB. Whale.\nC. Turtle.\nD. Horse.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0JjgoicpYkU"}], "modality": "video", "origin": {"category": "Multilingual/OCR Problems/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:599-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:599-1", "question": "What time did the heroine in the video turn off her alarm clock?\nA. 8:24.\nB. 9:24.\nC. 6:24.\nD. Not mentioned in the video.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0JjgoicpYkU"}], "modality": "video", "origin": {"category": "Multilingual/Temporal Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:599-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:599-2", "question": "Which of the following options correctly sorts the events of the following heroines in chronological order?\n① Study\n② Make the bed\n③ Eat breakfast\n④ Exercise at home\nA. ②①③④.\nB. ②④③①.\nC. ②③①④.\nD. ③②①④.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0JjgoicpYkU"}], "modality": "video", "origin": {"category": "Multilingual/OCR Problems/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:599-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:599-3", "question": "How much money can you save by purchasing the course through the link and promo code shared by the heroine in the video?\nA. 11550 rubles.\nB. 16500 rubles.\nC. 4950 rubles.\nD. 21,450 rubles.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1O1TfTrEnss"}], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:895-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:895-1", "question": "As can be seen in the video, which of the following is excluded from the power value on the red or blue small card?\nA. Value 3.\nB. Value 4.\nC. Value 5.\nD. Value 1.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1O1TfTrEnss"}], "modality": "video", "origin": {"category": "Multilingual/Object Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:895-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:895-2", "question": "What is special about the board on the lower right corner of the video that keeps track of the locations controlled by each of the two sides?\nA. The quantities of locations on both sides always stay identical.\nB. The number of locations on each side must be greater than 6.\nC. The sum of locations of each side is 12.\nD. None of the above.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1O1TfTrEnss"}], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:895-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:895-3", "question": "As can be seen in the video, which of the items is not placed on the table?\nA. A red card marked with 1937 and 1938.\nB. Several blue dice.\nC. A game map.\nD. A green square card.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5KlS-p5eYH8"}], "modality": "video", "origin": {"category": "Multilingual/Action Reasoning/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:900-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:900-1", "question": "In line with the video evidence, why does the heroine in the video only do butt training once a week?\nA. Because the heroine's buttocks are already strong enough.\nB. Because the heroine thinks it takes time for the buttock muscles to recover.\nC. Because the heroine doesn't have time to do butt training.\nD. Because the heroine wants to achieve the best result in the marathon.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5KlS-p5eYH8"}], "modality": "video", "origin": {"category": "Multilingual/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:900-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:900-2", "question": "Which of the following is not discussed in the video when the heroine holds a cell phone in one hand and faces the mirror to record herself?\nA. Her motivation to exercise.\nB. Changes in physical condition after exercise.\nC. How she feels about today's workout.\nD. Her exercise goals.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5KlS-p5eYH8"}], "modality": "video", "origin": {"category": "Multilingual/Information Synopsis/long", "dataset": "lmms-eval/Video-MME", "item": "question_id:900-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:900-3", "question": "What is the primary focus of the video?\nA. How does the heroine do fitness exercises and gain muscle every day.\nB. The heroine's daily eating and shopping routine.\nC. The home life of the heroine and her boyfriend.\nD. None of the above.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4V6G0qYVoBg"}], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:132-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:132-1", "question": "What is on the legend when he is hit by the turret?\nA. Sand.\nB. Ice.\nC. Thunder.\nD. Fire.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4V6G0qYVoBg"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:132-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:132-2", "question": "Which of the following events occur when the player presses R?\nA. Nothing happens.\nB. The legend is flying.\nC. The legend runs away.\nD. The enemy is knocked up.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:4V6G0qYVoBg"}], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:132-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:132-3", "question": "What is thrown out when pressing Q on the keyboard?\nA. A brick.\nB. A spear.\nC. An axe.\nD. A wheel.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6Z_XNM_iT4g"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:134-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:134-1", "question": "In the legend, when the character with a fox tail goes left, what is her intention or goal?\nA. She wants to pick up gold.\nB. She wants to ward grass.\nC. She wants to slay an enemy.\nD. She wants to meet her ally.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6Z_XNM_iT4g"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:134-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:134-2", "question": "Which skill is used by the legend who slays the enemy?\nA. Haste.\nB. Flash.\nC. Exhaust.\nD. Teleport.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6Z_XNM_iT4g"}], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:134-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:134-3", "question": "What type of weapon does the slain legend retrieve?\nA. Sword.\nB. Axe.\nC. Gun.\nD. Spear.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:80p80ynsZ78"}], "modality": "video", "origin": {"category": "Sports Competition/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:139-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:139-1", "question": "Which of the following is the main color of the racetrack?\nA. Purple.\nB. White.\nC. Pink.\nD. Blue.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:80p80ynsZ78"}], "modality": "video", "origin": {"category": "Sports Competition/Spatial Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:139-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:139-2", "question": "What the weather is like when the race begins?\nA. It is foggy.\nB. It is rainy.\nC. It is snowing.\nD. It is cloudy.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:80p80ynsZ78"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:139-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:139-3", "question": "According to the video, what happens to the car when it is running?\nA. It soars into the sky.\nB. It drills into the ground.\nC. It floats on the water.\nD. It hits a tree.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7R1eNHvfspk"}], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:147-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:147-1", "question": "How many challengers does the protagonist in the video take on?\nA. 7.\nB. 6.\nC. 8.\nD. 5.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7R1eNHvfspk"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:147-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:147-2", "question": "What is the game in the video?\nA. Basketball three-point contest.\nB. Basketball one-on-one.\nC. Shooting Game Boy challenge.\nD. Basketball dunk challenge.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7R1eNHvfspk"}], "modality": "video", "origin": {"category": "Sports Competition/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:147-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:147-3", "question": "Which person in the video is shown to shoot the ball the highest?\nA. The first challenger.\nB. The Challenge initiator.\nC. The second challenger.\nD. The last challenger.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5fPtlxR3s3c"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:149-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:149-1", "question": "What technical moves do the players perform in the third clip in the video?\nA. Dunk.\nB. Pass.\nC. Hit 3-pointers.\nD. Hit the game-winning shot.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5fPtlxR3s3c"}], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:149-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:149-2", "question": "From which country does the player who takes the last shot in the video hail?\nA. Canada.\nB. America.\nC. Spain.\nD. Germany.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:5fPtlxR3s3c"}], "modality": "video", "origin": {"category": "Sports Competition/Information Synopsis/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:149-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:149-3", "question": "What is the main theme of this video?\nA. Highlights from Team USA during the FIBA Women's Basketball World Cup.\nB. A compilation of the top five plays from the Men's Basketball World Cup.\nC. A countdown of the top 10 moments from the Men's Basketball World Cup.\nD. A countdown of the top 5 moments from the Women's Basketball World Cup.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1tidNDIpKSY"}], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:154-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:154-1", "question": "At the beginning of the video, what is the man standing next to?\nA. The UEFA Champions League Trophy.\nB. The Olympic Torch.\nC. The FIFA World Cup Trophy.\nD. The Super Bowl Trophy.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1tidNDIpKSY"}], "modality": "video", "origin": {"category": "Sports Competition/Spatial Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:154-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:154-2", "question": "Which of the following options best describes the scene in the background behind the man?\nA. A soccer field.\nB. A basketball court.\nC. An athletic track.\nD. A baseball diamond.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:1tidNDIpKSY"}], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:154-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:154-3", "question": "What can be inferred from the video about the location of the FIFA World Cup 2026 Final?\nA. It will be held in Manchester.\nB. It will be held in New York/New Jersey.\nC. It will be held in Houston.\nD. It will be held in Golden State.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2yGaTOzaGIA"}], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:165-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:165-1", "question": "Who was the first athlete to reach the finish line in the video?\nA. The athlete wearing a blue top and blue shorts.\nB. The athlete wearing a white top and black shorts.\nC. The athlete wearing a yellow top and green shorts.\nD. The athlete wearing a white top and red shorts.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2yGaTOzaGIA"}], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:165-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:165-2", "question": "How many athletes are competing in the video?\nA. 7.\nB. 5.\nC. 6.\nD. 8.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2yGaTOzaGIA"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:165-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:165-3", "question": "What is the competition event taking place in the video?\nA. Men's 400 meters.\nB. Men's 200 meters.\nC. Women's 400 meters.\nD. Women's 200 meters.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:84EpEwIVFdU"}], "modality": "video", "origin": {"category": "Sports Competition/Attribute Perception/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:174-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:174-1", "question": "Which color of balls is absent from the table?\nA. Green.\nB. Red.\nC. Blue.\nD. Black.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:84EpEwIVFdU"}], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:174-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:174-2", "question": "What Latin texts are inscribed on the man's chest?\nA. Liber Win and MrQ.\nB. Only Liber Win.\nC. Only MrQ.\nD. None of the above.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:84EpEwIVFdU"}], "modality": "video", "origin": {"category": "Sports Competition/Information Synopsis/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:174-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:174-3", "question": "What is the main focus of this video?\nA. An actor is being interviewed for winning a prize.\nB. A snooker player is being interviewed for entering the final competition.\nC. A father is being interviewed for talking about his slow brain.\nD. None of the above.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6DO8yOVYXr0"}], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:177-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:177-1", "question": "What is the current score of the ongoing game?\nA. 3-2.\nB. 2-3.\nC. 2-2.\nD. 3-3.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6DO8yOVYXr0"}], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:177-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:177-2", "question": "How many players are wearing black shirts in this video?\nA. 1.\nB. 3.\nC. 4.\nD. 2.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:6DO8yOVYXr0"}], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:177-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:177-3", "question": "Who smashed the decisive ball?\nA. The woman in red with a number of 6 on her back.\nB. The woman in red with a number of 2 on her back.\nC. The woman in red with a number of 5 on her back.\nD. The woman in black.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:54YD3Gv-3MI"}], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:180-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:180-1", "question": "How many players are participating in the game?\nA. 6.\nB. 4.\nC. 3.\nD. 5.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:54YD3Gv-3MI"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:180-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:180-2", "question": "What happened to the blue player during the game?\nA. He won the first place.\nB. He slided out of the slope.\nC. He got injured during the game.\nD. He asked the umpire to stop the game.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:54YD3Gv-3MI"}], "modality": "video", "origin": {"category": "Sports Competition/Object Reasoning/short", "dataset": "lmms-eval/Video-MME", "item": "question_id:180-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:180-3", "question": "What country won first place?\nA. KOR.\nB. LAT.\nC. CHN.\nD. None of the above.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0FM64MrRuZE"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:434-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:434-1", "question": "What does Vayne do at the beginning of the game?\nA. Helping teammate jungle.\nB. Attacking the top of the enemy.\nC. Attacking the jungle of the enemy.\nD. Staying at the fountain.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0FM64MrRuZE"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:434-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:434-2", "question": "Which skill is used first by Vayne?\nA. Haste.\nB. Flash.\nC. Exhaust.\nD. Teleport.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0FM64MrRuZE"}], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:434-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:434-3", "question": "Which position is Vayne in this video?\nA. Jungle.\nB. Support.\nC. Mid.\nD. Top.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": "B", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0Y9-MQ44MdU"}], "modality": "video", "origin": {"category": "Sports Competition/Object Reasoning/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:445-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:445-1", "question": "Extrapolating from the video, what team is the commentator on?\nA. Team 1.\nB. Team 2.\nC. He's not on either team.\nD. Cannot be inferred from the video.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0Y9-MQ44MdU"}], "modality": "video", "origin": {"category": "Sports Competition/Attribute Perception/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:445-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:445-2", "question": "What is the largest run differential in the first inning of the game in the video?\nA. 4.\nB. 3.\nC. 2.\nD. 1.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:0Y9-MQ44MdU"}], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:445-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:445-3", "question": "How many points does a three-pointer count in the video?\nA. 4.\nB. 3.\nC. 1.\nD. 2.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2NOcM1HoRRg"}], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:447-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:447-1", "question": "What are the two doing in the video?\nA. Commentating on a basketball game.\nB. Shooting basketball commercials.\nC. Watch a basketball game.\nD. Have a basketball video game.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "C", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2NOcM1HoRRg"}], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:447-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:447-2", "question": "What is the team's LAC hitting percentage when the score is 38-29?\nA. 48%.\nB. 41%.\nC. 56%.\nD. 54%.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "D", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:2NOcM1HoRRg"}], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:447-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:447-3", "question": "LAL completed the comeback with how much time left in the third quarter?\nA. 9.8s.\nB. 5min32s.\nC. 4min44s.\nD. 6.3s.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": false}
|
|
{"answer": "A", "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [{"region": {}, "source_id": "videomme:7E6i3E-fsj4"}], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/medium", "dataset": "lmms-eval/Video-MME", "item": "question_id:450-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:450-1", "question": "How many fouls are blown on players in black jerseys in the first game?\nA. 3.\nB. 2.\nC. 4.\nD. 1.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": false}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:181-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:181-1@Film-Television", "question": "How many men and women are presenting on the stage?\nA. Six men and three women.\nB. Five men and two women.\nC. Four men and three women.\nD. Four men and four women.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:181-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:181-2@Film-Television", "question": "What clothes is the singer wearing?\nA. A yellow shirt.\nB. A blue short-sleeve.\nC. A purple vest.\nD. A black skirt.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:181-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:181-3@Film-Television", "question": "What are the people on the stage doing in this video?\nA. They are reciting poetry.\nB. They are singing and dancing.\nC. They are performing acrobatics.\nD. They are performing a drama.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:182-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:182-1@Film-Television", "question": "Which color of pants is the person wearing while playing the piano in the video?\nA. Black.\nB. Purple.\nC. Brown.\nD. Blue.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:182-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:182-2@Film-Television", "question": "What is the exact number of performers in the video?\nA. 5.\nB. 4.\nC. 3.\nD. 2.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Information Synopsis/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:182-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:182-3@Film-Television", "question": "What is happening in the video?\nA. They are performing a drama.\nB. They are reciting poetry.\nC. They are performing acrobatics.\nD. They are singing a song.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:197-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:197-1@Film-Television", "question": "According the video, what is the appearance of the clothes worn by the man holding a dog?\nA. A lovable magic dragon.\nB. A tree with lots of leaves.\nC. An elderly yellow cat.\nD. A sweet candy.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:197-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:197-2@Film-Television", "question": "What is the function of the black plastic bag shown in the video?\nA. To store the dog's treats for later.\nB. To carry the dog's toys during walks.\nC. To collect water for the dog to drink.\nD. To catch the dog's poo.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:197-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:197-3@Film-Television", "question": "Which of the following items is not placed on the judge's table who is speaking at the end of this video?\nA. A stuffed toy of a dragon.\nB. A photo of a white dog.\nC. Two mugs.\nD. A microphone.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:206-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:206-1@Film-Television", "question": "What is the total number of people in the video?\nA. 7.\nB. 6.\nC. 5.\nD. 8.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:206-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:206-2@Film-Television", "question": "Did they successfully play the game of telephone in the video?\nA. Yes..\nB. No.\nC. They did not play this game in the video.\nD. It is not possible to determine from the video if they successfully played the game of telephone.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:206-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:206-3@Film-Television", "question": "How many people are wearing ties in the video?\nA. 4.\nB. 5.\nC. 3.\nD. 2.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:208-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:208-1@Film-Television", "question": "Which instrument is the performer on the stage holding in the video?\nA. Trumpet.\nB. Saxophone.\nC. Violin.\nD. Guitar.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:208-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:208-2@Film-Television", "question": "Who was the first person to press the button and turn the chair around in the video?\nA. The woman in gold clothes.\nB. Nobody.\nC. The person performing on stage.\nD. The man in a blue shirt.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:208-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:208-3@Film-Television", "question": "Which option correctly indicates the number of microphones on the stage?\nA. 4.\nB. 3.\nC. 2.\nD. 1.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:212-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:212-1@Film-Television", "question": "Which skill is not included in the little girl's performance?\nA. Backflip.\nB. Cartweel.\nC. Handstand.\nD. Full split.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:212-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:212-2@Film-Television", "question": "According to the little girl's expression, how does she feel after finishing her performance?\nA. Depressed.\nB. Ashamed.\nC. Calm.\nD. Excited.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:212-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:212-3@Film-Television", "question": "What is the color of the little girl wearing shorts?\nA. Pink.\nB. Blue.\nC. White.\nD. Black.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:216-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:216-1@Film-Television", "question": "What does the girl wear above the head during her performance?\nA. A red hat.\nB. A yellow headscarf.\nC. A red headscarf.\nD. A yellow hat.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:216-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:216-2@Film-Television", "question": "Which sentence best describes the girl's dress?\nA. It is over-sized for her.\nB. It is colorful.\nC. It is very long.\nD. None of the above is correct.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:216-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:216-3@Film-Television", "question": "How many rolls does the girl do in her performance?\nA. More than 5 but less than or equal to 10.\nB. Less than or equal to 5.\nC. More than 10 but less than or equal to 15.\nD. More than 15.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:482-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:482-1@Film-Television", "question": "What does this video document?\nA. What technology has been adopted for the National Theatre's live broadcast.\nB. Behind the scenes at the National Theatre.\nC. The popularity of the art of opera today.\nD. Can't extrapolate from the video.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/OCR Problems/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:482-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:482-2@Film-Television", "question": "Which play is featured at the end of the video?\nA. Macbeth.\nB. Hamlet.\nC. The Lehman Trilogy.\nD. War Horse.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:482-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:482-3@Film-Television", "question": "What can be inferred about broadcast quality from the video description?\nA. It utilizes state-of-the-art filming tailored to each play.\nB. It is broadcast in standard definition.\nC. The filming techniques are outdated.\nD. The plays are edited before being broadcast.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Spatial Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:483-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:483-1@Film-Television", "question": "What is the primary theme of the high school theatre show featured in the video?\nA. Social justice issues.\nB. Classic literature adaptations.\nC. The celebration of school spirit.\nD. The exploration of modern art.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:483-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:483-2@Film-Television", "question": "How are the students dressed in the video?\nA. In period costumes.\nB. In formal attire.\nC. In casual streetwear.\nD. In matching thematic outfits.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:483-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:483-3@Film-Television", "question": "Based on the video, what setting is the high school theatre show trying to replicate?\nA. A professional Broadway stage.\nB. An experimental black box theatre.\nC. A historical setting.\nD. A classic Shakespearean stage.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Temporal Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:496-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:496-1@Film-Television", "question": "According to this video, in which order do the following events happen?\n(a) The magician took the white cloth away from the photo frame.\n(b) The magician led a self introduction.\n(c) The magician produced a feather.\nA. (a)(b)(c).\nB. (b)(c)(a).\nC. (c)(b)(a).\nD. (b)(a)(c).", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:496-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:496-2@Film-Television", "question": "What is the last magic the magician played?\nA. He produced a small leather.\nB. He produced a large leather from a levitating small leather.\nC. His hands waved in the air.\nD. None of the above.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:496-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:496-3@Film-Television", "question": "What sentence best describes the performance?\nA. The magic is not wonderful enough to make the audiences cheer up.\nB. One of the judges stops the performance.\nC. The magician does the magic with his eyes closed.\nD. The magician needs other tools besides leathers.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:504-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:504-1@Film-Television", "question": "What other instrument is there on the stage besides the piano?\nA. Guitar.\nB. Trumpet.\nC. Saxophone.\nD. Violin.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:504-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:504-2@Film-Television", "question": "Whose song did the performer sing in the video?\nA. Michael Jackson.\nB. Adele.\nC. Lady Gaga.\nD. Taylor Swift.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Spatial Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:504-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:504-3@Film-Television", "question": "From the perspective of the performer, is the judge wearing black clothes on her left or right side?\nA. Right.\nB. Middle.\nC. Left.\nD. There are no judges wearing black clothes.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:788-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:788-1@Film-Television", "question": "What overarching story is told in the video?\nA. The story of a princess who searches for her long-lost family and is finally reunited.\nB. The story of a knight who fights the evil witch to save the kingdom.\nC. The story of a princess who discovers her magical powers and their consequences.\nD. The story of a knight who saves and awakens a princess from a dragon.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:788-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:788-2@Film-Television", "question": "What motivates the main character to flee her hometown?\nA. she was banished from the country.\nB. she was greatly oppressed by life and wished to go for freedom.\nC. she exposed her superpowers, causing her to panic.\nD. she was pursuing a prophecy about her fate.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:788-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:788-3@Film-Television", "question": "What can be inferred about how the video's protagonist initially treated her powers and her kingdom?\nA. She sees her superpowers as a threat and isolates herself, unintentionally causing harm to her kingdom.\nB. She sees her superpowers as an asset and wishes to convince the past to use them to create value for her kingdom and benefit her people.\nC. Her superpowers inspire ambition; she desires to use her superpowers to earn a place for herself in her kingdom and begins to formulate meticulous plans.\nD. She is indifferent to her kingdom and abandons it without a second thought.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Counting Problem/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:792-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:792-1@Film-Television", "question": "How many magic shows are included in this video?\nA. 10.\nB. 9.\nC. 8.\nD. 7.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:792-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:792-2@Film-Television", "question": "What is special about the second magic?\nA. It incorporates fire manipulation and pyrotechnics.\nB. It includes a disappearing act with a grand illusion.\nC. It features mind-reading and psychic abilities.\nD. It is about dogs' quick change, while others are about humans' quick change.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:792-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:792-3@Film-Television", "question": "What are the magic tricks about?\nA. Cards trick magics.\nB. Quick change magics.\nC. Street magics.\nD. Coins trick magics.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Artistic Performance/Action Recognition/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:813-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:813-1@Film-Television", "question": "Which acrobatic skill is absent from this video?\nA. Trampoline.\nB. Hula hoops.\nC. Ropes.\nD. Stilts.", "scope": {"holder": "Film-Television", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:092-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:092-1@Knowledge", "question": "What does the girl want to do in the video?\nA. Running.\nB. Writing.\nC. Painting.\nD. Playing.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:092-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:092-2@Knowledge", "question": "What does the girl's mom want her to do in this video?\nA. Seeing a movie.\nB. Exercising.\nC. Playing with friends.\nD. Studying math.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:092-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:092-3@Knowledge", "question": "How does the girl perceive her future with regard to decision-making and control?\nA. She doesn't care about her future.\nB. She wishes to make decision by herself.\nC. She feels she will be controlled by her mom.\nD. She has no hope for the future.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:100-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:100-1@Knowledge", "question": "Which animal appears in this video?\nA. Kangaroo.\nB. Bird.\nC. Deer.\nD. Panda.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:100-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:100-2@Knowledge", "question": "What does the panda use to fight with enemies in the video?\nA. A bamboo.\nB. A stick.\nC. An axe.\nD. A spear.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:100-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:100-3@Knowledge", "question": "Which type of tree is depicted behind the meditating panda?\nA. A peach tree.\nB. A pear tree.\nC. An apple tree.\nD. A pomegranate tree.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:102-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:102-1@Knowledge", "question": "According to the video, who is about to get married?\nA. The man in short sleeves.\nB. The man in the dark suit.\nC. The man in the blue shirt.\nD. It is unclear.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:102-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:102-2@Knowledge", "question": "What are the people in the video arguing about?\nA. Whether the person in the blue shirt will ever get married.\nB. Which person the man in the suit should choose as his best man.\nC. Whether the man in the suit should get married.\nD. How many times the man in the suit is getting married.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:102-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:102-3@Knowledge", "question": "How many people are wearing ties in the video?\nA. 2.\nB. 3.\nC. 0.\nD. 1.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:107-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:107-1@Knowledge", "question": "What object is the man in the gray T-shirt pulling?\nA. A kite.\nB. A balloon.\nC. A ladder.\nD. A helicopter.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:107-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:107-2@Knowledge", "question": "Whar color is the helicopter in the video?\nA. Orange.\nB. Pink.\nC. Blue.\nD. Black.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:107-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:107-3@Knowledge", "question": "What happens after the helicopter takes off in this video?\nA. It is pulled to ground and crash.\nB. It flies to sky.\nC. It falls into water.\nD. It is hit by a missile.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:121-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:121-1@Knowledge", "question": "Who was sentenced to have guilt in this video?\nA. The actor who triggered the gun.\nB. The prop master who was in charge of this gun.\nC. The film director.\nD. The deceased himself.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:121-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:121-2@Knowledge", "question": "Which color is the coat worn by the news anchor at the beginning of the video?\nA. Blue.\nB. Green.\nC. Yellow.\nD. Pink.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Spatial Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:121-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:121-3@Knowledge", "question": "Based on the information provided in the video, which of the following locations is where the shooting occurred?\nA. The court.\nB. The actor's house.\nC. The TV station.\nD. A ranch in New Mexico.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:397-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:397-1@Knowledge", "question": "What happens when a star falls on the earth?\nA. It smashes a big hole in the ground.\nB. It brings elements that never shows on earth.\nC. It makes a beautiful star sky.\nD. It causes a disaster and destroys dinosaurs.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:397-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:397-2@Knowledge", "question": "According to the video, what do the dead dinosaurs transform into?\nA. Star and sun.\nB. Birds.\nC. Human.\nD. Stone.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:397-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:397-3@Knowledge", "question": "What story does the video tell?\nA. Who is the ancestor of birds.\nB. How fossil comes about.\nC. We should visit the dinosaur museum.\nD. Dinosaurs went where.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Counting Problem/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:402-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:402-1@Knowledge", "question": "If a cue appears in the bottom left corner when a splice occurs, then how many video clips were used to compose this video?\nA. 7.\nB. 10.\nC. 3.\nD. 1.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:402-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:402-2@Knowledge", "question": "What common element do these clips in the video share?\nA. There are four people in the room.\nB. Everyone is eating something.\nC. Everyone is sitting on the couch.\nD. Sheldon changed the Wi-Fi password.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:402-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:402-3@Knowledge", "question": "What color is the laptop the woman is holding at the beginning of the video?\nA. Black.\nB. Pink.\nC. Silver.\nD. Green.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:404-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:404-1@Knowledge", "question": "Based on the video, who is Griffin more interested in?\nA. Manny's mom.\nB. Manny.\nC. Manny's dad.\nD. Cannot determine.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:404-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:404-2@Knowledge", "question": "Based on the video, what is Manny's family's pet?\nA. Griffin.\nB. A dog.\nC. A rabbit.\nD. A cat.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:404-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:404-3@Knowledge", "question": "Based on the video, why does Manny want to be friends with Griffin?\nA. Because he has a crush on Griffin's sister.\nB. Because Griffin is good at basketball.\nC. Because Griffin admires Manny's dad.\nD. Because he thinks Griffin is cool.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:419-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:419-1@Knowledge", "question": "The problems people encounter in the video are caused by what?\nA. Catastrophic weather.\nB. Global warming.\nC. Financial crisis.\nD. Oil crisis.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Temporal Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:419-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:419-2@Knowledge", "question": "In which part of the video is a man wearing a red jersey interviewed?\nA. There is no interview with a man in red clothing.\nB. End of the video.\nC. Beginning of the video.\nD. Middle of the video.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:419-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:419-3@Knowledge", "question": "What emotion is the song sung by the woman at the end of the video expressing?\nA. Respect for leaders.\nB. Concern about climate change.\nC. Yearning for a beautiful love.\nD. Longing for the outside world.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:428-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:428-1@Knowledge", "question": "Based on the video, why was Google sued?\nA. Google was sued for unlawfully using copyrighted content to train AI models.\nB. Google was not the subject of a lawsuit.\nC. Google was sued for violating antitrust laws.\nD. Google was sued due to the negative societal effects caused by its AI robots.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:428-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:428-2@Knowledge", "question": "What is the likely liquid contained in the cup on the desk of the news studio?\nA. Juice.\nB. Water.\nC. Red wine.\nD. Cola.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:428-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:428-3@Knowledge", "question": "How is the game content that appears in the video produced?\nA. Pre-set by the game company.\nB. Performed by real people.\nC. Generated by AI.\nD. Undeterminable.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:700-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:700-1@Knowledge", "question": "Based on the video, what is the relationship of Tom and Jerry when they meet the witch?\nA. Competition.\nB. Cooperation.\nC. Hostile.\nD. No one is correct above.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:700-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:700-2@Knowledge", "question": "How do Tom and Jerry share a similarity as depicted in the video?\nA. Sleeping.\nB. Liking eating cheese.\nC. Protecting Dorothy.\nD. Liking eating chicken.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:700-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:700-3@Knowledge", "question": "In line with the video evidence, what is the weakness of the villain?\nA. Water.\nB. Dark.\nC. Overconfidence.\nD. Attachment.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:717-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:717-1@Knowledge", "question": "According to the video, what inconsistency in quantum mechanics was discovered by Einstein and published in a paper?\nA. The trajectory of an object will be described as a probability wave and is no longer certain.\nB. There are problems with its mathematical equations.\nC. Two particles at a great distance can instantly influence each other, i.e., quantum entanglement.\nD. It's not mentioned in the video.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:717-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:717-2@Knowledge", "question": "The video repeatedly shows a person at a table, lifting a cup and another cup also floating up, with two light balls under each cup. What is this segment trying to show?\nA. Quantum entanglement effect.\nB. This is a magic trick.\nC. Objects propagate in the form of probability waves.\nD. Einstein's photoelectric effect.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:717-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:717-3@Knowledge", "question": "According to the video, how did the debate between Einstein and Bohr about quantum mechanics turn out?\nA. The experiment by the team at the high-altitude observatory further confirmed that Bohr was right.\nB. Bell's experiment completely confirmed that Bohr was correct.\nC. Bell's experiment completely confirmed that Einstein was correct.\nD. Pan Jianwei's team confirmed that Bohr was correct.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:722-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:722-1@Knowledge", "question": "According to the video, does the male interviewee wearing a black suit have a stance that is more in favor of men or women?\nA. Neutral.\nB. In favor of men.\nC. In favor of women.\nD. Cannot be determined.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:722-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:722-2@Knowledge", "question": "According to the video, the male interviewee wearing a tight black shirt told a joke about his experience in a popular culture class. He said if there's a movie that more than half of the class has seen, he would buy everyone pizza. Many years have passed, and he hasn't found such a movie yet. What does he imply with this joke?\nA. Consensus culture is becoming less common.\nB. People no longer like watching movies.\nC. The pizza from the place he orders is not good.\nD. There's less popular culture.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Object Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:722-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:722-3@Knowledge", "question": "Based on the content of the video, whose viewpoint is relatively the most radical?\nA. The female interviewee.\nB. The male interviewee wearing a shirt.\nC. The show host.\nD. The male interviewee wearing a black suit.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Film & Television/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:724-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:724-1@Knowledge", "question": "According to the video, which of the following news items did NOT appear in this news segment?\nA. An earthquake occurred in the United States.\nB. Potential community spread of measles in Canada.\nC. Fire destroys First Nation's only school.\nD. Josh Liendo swims into the history books.", "scope": {"holder": "Knowledge", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:005-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:005-1@Life-Record", "question": "According to the video, how many individuals were in the car when Archduke Franz Ferdinand was assassinated?\nA. Three.\nB. Two.\nC. One.\nD. Four.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:005-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:005-3@Life-Record", "question": "Which of the following options is incorrect regarding the events in Sarajevo depicted in the video?\nA. It was organized by the Black Hand in Serbia.\nB. Ferdinand was sitting on the left side of the car.\nC. Ferdinand was wearing a white hat.\nD. The killer was wearing black suit.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Temporal Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:006-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:006-2@Life-Record", "question": "What happened when Irish imiggrants brought the tradition of St. Patrick's Day to America?\nA. They began to center around drinking and celebrating the festival.\nB. St. Patrick moved to America.\nC. They celebrated St. Patrick's birth instead.\nD. They attended the church and gather for feasts.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:007-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:007-1@Life-Record", "question": "How is the smoke generated by the man depicted in the video?\nA. By burning a piece of cloth.\nB. By lighting a torch.\nC. By smoking.\nD. By lighting a bonefire.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/OCR Problems/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:007-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:007-3@Life-Record", "question": "What is the specific sentence in the smart phone that makes the man embarrassed?\nA. BTW...you got something in your teeth!\nB. Dude! You gotta come toBigStuf Camps!\nC. Smoke Sig 2.0.\nD. Last but not least.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Action Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:013-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:013-2@Life-Record", "question": "According to the video, which of the following ingredients is not used in the artwork?\nA. Shell.\nB. Glue.\nC. Blue Food Dye.\nD. Oil.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:016-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:016-1@Life-Record", "question": "When was the painting mentioned in the video painted?\nA. 1998.\nB. 1889.\nC. 1899.\nD. 1988.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:016-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:016-3@Life-Record", "question": "Which of the following elements is not present in the \"Starry Sky\"?\nA. Houses.\nB. Stars.\nC. Castle.\nD. Moon.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:030-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:030-2@Life-Record", "question": "What color is the ATP in the video?\nA. Black.\nB. Green.\nC. Blue.\nD. Red.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:040-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:040-1@Life-Record", "question": "When did the events described in the video take place?\nA. Between 2014 and 2016.\nB. Between 2020 and 2023.\nC. Between 1997 and 2002.\nD. Between 2006 and 2008.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Information Synopsis/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:040-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:040-3@Life-Record", "question": "What is the main content of this video?\nA. Amazon's development.\nB. The dot-com Bubble.\nC. Company competition.\nD. Stock market.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Temporal Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:050-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:050-2@Life-Record", "question": "On what date is the total eclipse supposed to occur in the video?\nA. August 1, 2008.\nB. July 22, 2009.\nC. June 29, 2024.\nD. April 8, 2024.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:060-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:060-1@Life-Record", "question": "Which element doesn't show up in the video?\nA. Iceberg.\nB. Orcas.\nC. Sea bird.\nD. Polar bear.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Spatial Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:060-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:060-3@Life-Record", "question": "Which of the following facts is not caused by the iceberg mentioned in the video?\nA. Orcas and sea birds around the iceberg become more active.\nB. South Georgia Islands is affected.\nC. The thick mist at sea near the melting iceberg.\nD. Sea level may rises a little bit.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:073-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:073-2@Life-Record", "question": "What is the icon of Keyborad Cleaner app shown in the video?\nA. The icon features a colorful image of a keyboard with sparkling keys.\nB. The icon depicts two black letters of K and C.\nC. The icon displays a cartoon character holding a broom and cleaning a keyboard.\nD. The icon shows a magnifying glass zooming in on a dirty keyboard.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:077-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:077-1@Life-Record", "question": "What is the color of the tall drinking glass initially held by the woman?\nA. Blue.\nB. Red.\nC. Green.\nD. Yellow.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Action Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:077-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:077-3@Life-Record", "question": "According to this video, what is the purpose of adding fresh produce to the water?\nA. To enhance the water's purification and cleansing properties.\nB. To infuse the water with a refreshing and subtle flavor.\nC. To visually enhance the appearance of the water.\nD. To turn the water into a thick smoothie.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Spatial Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:080-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:080-2@Life-Record", "question": "As depicted in the video, what are the resistance bands parallel to when the man is pulling apart?\nA. Neck.\nB. Chest.\nC. Chin.\nD. Nose.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Temporal Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:307-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:307-1@Life-Record", "question": "Which of the following events happened before 72 BCE?\nA. The Senate retaliated with the full force of two legion.\nB. Praetor Variniu was ambushed.\nC. Crixus died in a battle.\nD. Marcus Licinius Crassus had assumed control of the war.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:307-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:307-3@Life-Record", "question": "What happened when the main character owned an army of about 120,000 soldiers?\nA. The army captured Rome.\nB. The army marched beyond Rome's border.\nC. The army climbed the Alp.\nD. The army turned south.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:311-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:311-2@Life-Record", "question": "Which of the following statements is not true?\nA. The colors on the Roman scultures faded in Renaissance.\nB. \"Laocoön and His Sons\" is originally full of color.\nC. Artists in the Renaissance liked white marble because they wanted to imitated the Roman sculptures.\nD. \"David\" is originally full of color.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Counting Problem/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:314-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:314-1@Life-Record", "question": "How many listeners gave busking donations to the girl before she started playing?\nA. One.\nB. Two.\nC. None.\nD. Three.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:314-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:314-3@Life-Record", "question": "What color shoes does the little girl wear?\nA. Yellow.\nB. Orange.\nC. Pink.\nD. Black.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Temporal Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:321-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:321-2@Life-Record", "question": "What is the correct order in which the following events are presented in the video?\n(a) The nucleus is introduced.\n(b) Base pairing.\n(c) Cell division.\nA. (a)(c)(b).\nB. (c)(a)(b).\nC. (c)(b)(a).\nD. (a)(c)(b).", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Information Synopsis/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:329-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:329-1@Life-Record", "question": "What is the main topic of the video?\nA. The history of heart transplantation.\nB. The manufacture of durable artificial hearts.\nC. Developments in the treatment of cardiac arrhythmias.\nD. The development and production of new drugs for cardiovascular disease.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:329-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:329-3@Life-Record", "question": "What is the role of the company BiVACOR in the field of medical devices?\nA. BiVACOR is engineering a long-term device intended to completely replace the function of a patient's native heart.\nB. BiVACOR is developing a temporary device for heart assistance during surgery.\nC. BiVACOR is focused on creating diagnostic tools for heart disease.\nD. BiVACOR designs pacemakers for regulating heart rhythm disorders.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:334-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:334-2@Life-Record", "question": "As shown in the video, if a money launderer is rigging a bet, what stage of money laundering might it be at?\nA. Phase one.\nB. Phase two.\nC. Phase three.\nD. Cannot be inferred.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:360-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:360-1@Life-Record", "question": "What is the background color of the sign that marks the highest point of Kiribati?\nA. White.\nB. Blue.\nC. Red.\nD. Black.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:360-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:360-3@Life-Record", "question": "What did the youtuber advise in order to save Kiribati?\nA. Bring tourists there and make them aware of the danger of climate change.\nB. Build up the sea wall.\nC. Bring tourists there and attract more money.\nD. Buy other islands and ask local people to move to these higher islands.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/OCR Problems/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:364-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:364-2@Life-Record", "question": "Which AI technology is not featured in the video?\nA. Chatbot.\nB. Automatic driving.\nC. Generative AI.\nD. Deepfake.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Spatial Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:371-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:371-1@Life-Record", "question": "Which option correctly indicates the location of the \"psychological tip\" written in white on the board when illustrating the third suggestion in the video?\nA. Between \"REMOVE THE FILTER\" and \"THREAD THE CONVERSATION\".\nB. Below \"THE PRATFALL EFFECT\".\nC. Between \"THREAD THE CONVERSATION\" and \"THE PRATFALL EFFECT\".\nD. It can't be recognized in the video.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Action Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:371-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:371-3@Life-Record", "question": "What is the purpose of drawing a bifurcated tree when introducing the threading?\nA. To illustrate multiple possible topics to continue the conversation.\nB. To show various approaches to get yourself understood.\nC. To demonstrate the consequences of removing the filter.\nD. To clarify the importance of expressing yourself.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:380-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:380-2@Life-Record", "question": "As depicted in the video, which finger touches the chopsticks?\nA. Little finger on the right hand.\nB. Little finger on the left hand.\nC. Index finger on the right hand.\nD. Index finger on the left hand.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:382-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:382-1@Life-Record", "question": "According to the video, why is IMAX not suitable for filming movies?\nA. The motors make too much noise and distracte the actors.\nB. The cameras are so heavy, and require specific training to operate them.\nC. IMAX movies are expensive to produce.\nD. All of the above.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:382-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:382-3@Life-Record", "question": "Which IMAX movie isn't in the video?\nA. The Hunger Games: Catching Fire.\nB. The Dark Knight.\nC. Oppenheimer.\nD. Dune.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:389-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:389-2@Life-Record", "question": "Which game is played on each generation of Play Stations in the video?\nA. Gran Turismo.\nB. The Last of Us.\nC. God of War.\nD. Grand Theft Auto V.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:603-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:603-1@Life-Record", "question": "In accordance with the video footage, which of the following diseases causes the most deaths?\nA. Tuberculosis.\nB. Malaria.\nC. Cholera.\nD. Typhoid.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Object Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:603-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:603-3@Life-Record", "question": "Based on the video, which of the following statements is correct?\nA. Roughly 30% of all northern Europeans were dying of TB, most of them were artists and writers.\nB. The consumption was thought to be only prevelant in white people.\nC. TB was incurable.\nD. Southern California came to be known as \"the land of new lungs\" for the reason that the air there can heal TB diseases.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Temporal Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:604-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:604-2@Life-Record", "question": "As depicted in the video, what happened when the Gypsies migrated to Europe?\nA. Slavery was abolished.\nB. They became increasingly enslaved in the Balkans as the Ottomans expanded their territory.\nC. They fought with Selic.\nD. They separated from the Turks.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Knowledge/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:621-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:621-1@Life-Record", "question": "What is the theme of the video?\nA. Enhancing metabolic health as a strategy to combat Alzheimer's disease.\nB. Research progress and application prospects of beta-amyloid as a therapeutic target for Alzheimer's disease.\nC. Failed attempts to eradicate Alzheimer's disease through current medical treatments.\nD. Research on how human behavioural science can be used to improve cognitive performance and its potential as a strategy to combat Alzheimer's disease.", "scope": {"holder": "Life-Record", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:240-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:240-1@Multilingual", "question": "Which of the following best describes the topic of the video?\nA. Destruction of illegal food at port.\nB. How is the juice sold at the port made.\nC. What kind of food do people bring into the port.\nD. What do people eat in the harbor.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/OCR Problems/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:240-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:240-3@Multilingual", "question": "What are the potential risks associated with exotic animal diseases according to the bulletin board in the video?\nA. Animal.\nB. Agriculture.\nC. Airport.\nD. Human.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:248-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:248-2@Multilingual", "question": "What is the order of skincare products used before makeup in the video?\nA. Face serum, toner, eye cream, face cream.\nB. Toner, face serum, eye cream, face cream.\nC. Face serum, toner, face cream, eye cream.\nD. Toner, face serum, face cream, eye cream.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:250-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:250-1@Multilingual", "question": "Which topic does the video cover?\nA. How to apply perfume.\nB. How the perfume smells.\nC. How to refill perfume.\nD. How to choose a right perfume.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:250-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:250-3@Multilingual", "question": "Which of the following best describes the shape of the perfume bottle?\nA. Rounded.\nB. Triangular.\nC. Asymmetrical.\nD. Rectangular.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:251-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:251-2@Multilingual", "question": "What is the woman sitting on the floor ready to do at the end of the video?\nA. To play cell phone.\nB. To play games.\nC. To watch TV.\nD. To read a book.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:260-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:260-1@Multilingual", "question": "What kind of cell phone is the person in the video using?\nA. iPhone 13.\nB. Google Pixel 8.\nC. Google Pixel 2.\nD. Google Pixel 3.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:260-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:260-3@Multilingual", "question": "What feature of the cell phone did the person in the video use?\nA. Phone call.\nB. Video editing.\nC. Photo shooting.\nD. Online games.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:264-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:264-2@Multilingual", "question": "Which animal is shown in the video?\nA. Kangaroo.\nB. Giraffe.\nC. Donkey.\nD. Horse.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/OCR Problems/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:265-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:265-1@Multilingual", "question": "What is the lateral distance of the Buddha in the video?\nA. 48m.\nB. 46m.\nC. 45m.\nD. 47m.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:265-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:265-3@Multilingual", "question": "In the video, what does the man's facial expression look like when he sees the scorpion skewer?\nA. Disgust.\nB. Joy.\nC. Sadness.\nD. Calmness.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:266-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:266-2@Multilingual", "question": "What are the people in the video doing in the lake?\nA. Fishing.\nB. Swimming.\nC. Boating.\nD. Diving.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/OCR Problems/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:268-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:268-1@Multilingual", "question": "What camera does the protagonist in the video use to shoot?\nA. Canon.\nB. Leica.\nC. Nikon.\nD. SONY.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:268-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:268-3@Multilingual", "question": "Which of the following topics is the most likely focus of this video?\nA. Camera advertising.\nB. Photography course.\nC. Promotional film.\nD. Publicity of tourist attractions.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:276-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:276-2@Multilingual", "question": "What does the animal do in the video?\nA. It is pulled in circles by a person.\nB. It jumps on a person.\nC. It pulls a tree.\nD. It flies to the sky.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:284-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:284-1@Multilingual", "question": "What is the person in the background, wearing a white top and black shorts, doing while the person in pink is speaking at the beginning of the video?\nA. Sit-ups.\nB. Lying triceps extension.\nC. Using the bar for pull-ups.\nD. Push-up.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:284-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:284-3@Multilingual", "question": "How many sit-ups did the man in the video, wearing a pink top and black pants, perform?\nA. 0.\nB. 1.\nC. 2.\nD. 3.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:286-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:286-2@Multilingual", "question": "What is the primary item that the two men in the video utilize for their workout?\nA. Dumbbel.\nB. Black bench.\nC. Black sofa.\nD. Black iron plate.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:522-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:522-1@Multilingual", "question": "Which ingredient is not used in the video?\nA. Flower sticker.\nB. Can lids.\nC. Wool thread.\nD. Glue gun.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:522-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:522-3@Multilingual", "question": "According to the video, what is the sequential order in which the following tools are used?\n(a) Glue gun.\n(b) Needle.\n(c) Scissors.\nA. (a)(b)(c).\nB. (b)(c)(a).\nC. (b)(a)(c).\nD. (c)(a)(b).", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:526-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:526-2@Multilingual", "question": "Which of the following options is NOT one of the purposes of red threads?\nA. To make the left foot.\nB. To make the tail.\nC. To make the right foot.\nD. To make the nose.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Counting Problem/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:533-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:533-1@Multilingual", "question": "How many cats in the video like mackerel the best?\nA. 3.\nB. 1.\nC. 2.\nD. 4.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:533-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:533-3@Multilingual", "question": "What would most likely cause Mimi to eat on the floor?\nA. It can't climb the table.\nB. It's very timid.\nC. It fell off the table.\nD. It likes to eat on the floor.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Temporal Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:540-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:540-2@Multilingual", "question": "What is the third baked food in the video?\nA. Scallop.\nB. Kobe beef.\nC. Bacon.\nD. Salmon.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:542-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:542-1@Multilingual", "question": "In which city did the video take place?\nA. Paris.\nB. London.\nC. New York.\nD. Hong Kong.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:542-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:542-3@Multilingual", "question": "What is the model walking behind the one in a casual suit characterized by a rich print in vibrant shades of pink and white wearing?\nA. An oversized, short-sleeved shirt in a glossy, brown hue that suggests a leather-like material.\nB. A black wetsuit with a blue surfboard fin, reinforcing the aquatic theme of the outfit.\nC. A striking ensemble with a floral theme against a dark background, which gives a nocturnal, tropical vibe.\nD. An oversized, striped shirt jacket featuring a mix of blue tones and a pattern of classic denim patchwork.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:552-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:552-2@Multilingual", "question": "What is the student doing while the athlete is competing in the indoor stadium in the video?\nA. Shopping.\nB. Bathing.\nC. Studying.\nD. Preparing a meal.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:566-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:566-1@Multilingual", "question": "Why does the author feel betrayed at the beginning of the video?\nA. Greenland is deserted.\nB. Greenland is not green.\nC. Greenland is very cold.\nD. Greenland is very expensive.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:566-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:566-3@Multilingual", "question": "What activities are recorded sequentially in the video?\nA. Explore ice sheet, take sled dog rides, visit residents.\nB. Explore ice sheet, visit residents, take sled dog rides.\nC. Take sled dog rides, visit residents, explore ice sheet.\nD. Visit residents, explore ice sheet, take sled dog rides.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Counting Problem/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:573-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:573-2@Multilingual", "question": "How many hats does the hamster change in this video?\nA. 4.\nB. 6.\nC. 5.\nD. 7.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:582-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:582-1@Multilingual", "question": "What is the next exercise after the burpee training in the video?\nA. Matrix pushups.\nB. Jump suqats.\nC. Shadowboxing.\nD. Sit-ups.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:582-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:582-3@Multilingual", "question": "In what order do burpees, jump squats and push-ups appear in the video?\nA. First jump squats, then push-ups, then burpees.\nB. First jump squats, then burpees, then push-ups, then jump squats again.\nC. First burpees, then push-ups, then jump squats.\nD. First burpees, then jump squats, then push-ups.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:586-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:586-2@Multilingual", "question": "What is the main product introduced by the male protagonist in the video?\nA. An open run headphones.\nB. A turban with built-in speakers.\nC. A sweatshirt with noise-canceling capabilities.\nD. A hearing aid with wireless charging.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Temporal Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:822-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:822-1@Multilingual", "question": "In which order do the following topics are introduced in this video ?\n(a) Spring pocket DIY.\n(b) Easter bucket floral DIY.\n(c) Farmhouse bunny in a bucket DIY.\n(d) Spring tin bucket floral DIY.\n(e) Bunny hop decor.\nA. (a)(b)(c)(d)(e).\nB. (a)(c)(b)(e)(d).\nC. (b)(e)(a)(d)(c).\nD. (b)(a)(d)(c)(e).", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:822-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:822-3@Multilingual", "question": "What is the best caption for this video?\nA. Winter Holiday Decorations: Festive DIY Crafts for Christmas and New Year.\nB. Spring Easter Collection #4 DIY Crafts Farmhouse Whimsical Rustic Crafts using Florals and More.\nC. Gardening Tips and Tricks: Growing Your Own Organic Vegetables.\nD. A Travel Vlog: Exploring Exotic Destinations Around the World.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Temporal Perception/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:831-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:831-2@Multilingual", "question": "Could you please indicate the specific time in the video when the minor kitchen mishap occurs while cooking?\nA. Wednesday breakfast.\nB. Tuesday lunch.\nC. Friday dinner.\nD. Tuesday dinner.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:837-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:837-1@Multilingual", "question": "Which of the following food combinations is the favorite of the two people in the video?\nA. Hot sauce and bananas.\nB. Spaghetti with tacos.\nC. Crazy Sandwich.\nD. Cookies and Cheese.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:837-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:837-3@Multilingual", "question": "What is the most significant difference between the first clip in the video and the other two?\nA. The food combinations in the first clip were all recommended by friends online.\nB. The first clip is all about weird food combinations.\nC. The food in the first clip is not additionally processed.\nD. The food in the first clip is not mixed together.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Object Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:845-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:845-2@Multilingual", "question": "What makes the dual diamond ring from Leon Diamond unique or special?\nA. It is worn on two fingers.\nB. It is made from rare and expensive materials.\nC. It can change colors based on the wearer's mood..\nD. It has a hidden compartment for storing small items..", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Life Record/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:847-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:847-1@Multilingual", "question": "What is this video documenting?\nA. A concert.\nB. Clothing ads.\nC. A clothing fashion walk.\nD. Designer Workshop.", "scope": {"holder": "Multilingual", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:298-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:298-1@Sports-Competition", "question": "Which track athlete knocked down the railing first in the video?\nA. Track No. 2.\nB. Track No. 8.\nC. Track No. 3.\nD. Track No. 7.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:298-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:298-2@Sports-Competition", "question": "What was the total number of athletes who participated in the game in the video?\nA. 8.\nB. 7.\nC. 6.\nD. 9.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:298-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:298-3@Sports-Competition", "question": "Which of the following track athletes did not cause any disruption by knocking down railings during the competition?\nA. Track No. 4.\nB. Track No. 8.\nC. Track No. 1.\nD. Track No. 3.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:597-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:597-1@Sports-Competition", "question": "What does the girl take out from the envelop?\nA. A mirror.\nB. A book.\nC. A paper.\nD. A card.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:597-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:597-2@Sports-Competition", "question": "What is the usage of the thing that the girl take out from envelop?\nA. Identify herself.\nB. Buy food.\nC. Start elevator.\nD. Take money from bank.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:597-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:597-3@Sports-Competition", "question": "What is the animal flying in sky?\nA. Seagull.\nB. Whale.\nC. Turtle.\nD. Horse.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/OCR Problems/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:599-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:599-1@Sports-Competition", "question": "What time did the heroine in the video turn off her alarm clock?\nA. 8:24.\nB. 9:24.\nC. 6:24.\nD. Not mentioned in the video.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Temporal Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:599-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:599-2@Sports-Competition", "question": "Which of the following options correctly sorts the events of the following heroines in chronological order?\n① Study\n② Make the bed\n③ Eat breakfast\n④ Exercise at home\nA. ②①③④.\nB. ②④③①.\nC. ②③①④.\nD. ③②①④.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/OCR Problems/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:599-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:599-3@Sports-Competition", "question": "How much money can you save by purchasing the course through the link and promo code shared by the heroine in the video?\nA. 11550 rubles.\nB. 16500 rubles.\nC. 4950 rubles.\nD. 21,450 rubles.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:895-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:895-1@Sports-Competition", "question": "As can be seen in the video, which of the following is excluded from the power value on the red or blue small card?\nA. Value 3.\nB. Value 4.\nC. Value 5.\nD. Value 1.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Object Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:895-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:895-2@Sports-Competition", "question": "What is special about the board on the lower right corner of the video that keeps track of the locations controlled by each of the two sides?\nA. The quantities of locations on both sides always stay identical.\nB. The number of locations on each side must be greater than 6.\nC. The sum of locations of each side is 12.\nD. None of the above.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Object Recognition/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:895-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:895-3@Sports-Competition", "question": "As can be seen in the video, which of the items is not placed on the table?\nA. A red card marked with 1937 and 1938.\nB. Several blue dice.\nC. A game map.\nD. A green square card.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Action Reasoning/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:900-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:900-1@Sports-Competition", "question": "In line with the video evidence, why does the heroine in the video only do butt training once a week?\nA. Because the heroine's buttocks are already strong enough.\nB. Because the heroine thinks it takes time for the buttock muscles to recover.\nC. Because the heroine doesn't have time to do butt training.\nD. Because the heroine wants to achieve the best result in the marathon.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:900-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:900-2@Sports-Competition", "question": "Which of the following is not discussed in the video when the heroine holds a cell phone in one hand and faces the mirror to record herself?\nA. Her motivation to exercise.\nB. Changes in physical condition after exercise.\nC. How she feels about today's workout.\nD. Her exercise goals.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Multilingual/Information Synopsis/long", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:900-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:900-3@Sports-Competition", "question": "What is the primary focus of the video?\nA. How does the heroine do fitness exercises and gain muscle every day.\nB. The heroine's daily eating and shopping routine.\nC. The home life of the heroine and her boyfriend.\nD. None of the above.", "scope": {"holder": "Sports-Competition", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:132-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:132-1@Artistic-Performance", "question": "What is on the legend when he is hit by the turret?\nA. Sand.\nB. Ice.\nC. Thunder.\nD. Fire.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:132-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:132-2@Artistic-Performance", "question": "Which of the following events occur when the player presses R?\nA. Nothing happens.\nB. The legend is flying.\nC. The legend runs away.\nD. The enemy is knocked up.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:132-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:132-3@Artistic-Performance", "question": "What is thrown out when pressing Q on the keyboard?\nA. A brick.\nB. A spear.\nC. An axe.\nD. A wheel.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:134-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:134-1@Artistic-Performance", "question": "In the legend, when the character with a fox tail goes left, what is her intention or goal?\nA. She wants to pick up gold.\nB. She wants to ward grass.\nC. She wants to slay an enemy.\nD. She wants to meet her ally.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:134-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:134-2@Artistic-Performance", "question": "Which skill is used by the legend who slays the enemy?\nA. Haste.\nB. Flash.\nC. Exhaust.\nD. Teleport.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:134-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:134-3@Artistic-Performance", "question": "What type of weapon does the slain legend retrieve?\nA. Sword.\nB. Axe.\nC. Gun.\nD. Spear.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:139-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:139-1@Artistic-Performance", "question": "Which of the following is the main color of the racetrack?\nA. Purple.\nB. White.\nC. Pink.\nD. Blue.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Spatial Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:139-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:139-2@Artistic-Performance", "question": "What the weather is like when the race begins?\nA. It is foggy.\nB. It is rainy.\nC. It is snowing.\nD. It is cloudy.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:139-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:139-3@Artistic-Performance", "question": "According to the video, what happens to the car when it is running?\nA. It soars into the sky.\nB. It drills into the ground.\nC. It floats on the water.\nD. It hits a tree.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:147-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:147-1@Artistic-Performance", "question": "How many challengers does the protagonist in the video take on?\nA. 7.\nB. 6.\nC. 8.\nD. 5.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:147-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:147-2@Artistic-Performance", "question": "What is the game in the video?\nA. Basketball three-point contest.\nB. Basketball one-on-one.\nC. Shooting Game Boy challenge.\nD. Basketball dunk challenge.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:147-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:147-3@Artistic-Performance", "question": "Which person in the video is shown to shoot the ball the highest?\nA. The first challenger.\nB. The Challenge initiator.\nC. The second challenger.\nD. The last challenger.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:149-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:149-1@Artistic-Performance", "question": "What technical moves do the players perform in the third clip in the video?\nA. Dunk.\nB. Pass.\nC. Hit 3-pointers.\nD. Hit the game-winning shot.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:149-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:149-2@Artistic-Performance", "question": "From which country does the player who takes the last shot in the video hail?\nA. Canada.\nB. America.\nC. Spain.\nD. Germany.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Information Synopsis/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:149-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:149-3@Artistic-Performance", "question": "What is the main theme of this video?\nA. Highlights from Team USA during the FIBA Women's Basketball World Cup.\nB. A compilation of the top five plays from the Men's Basketball World Cup.\nC. A countdown of the top 10 moments from the Men's Basketball World Cup.\nD. A countdown of the top 5 moments from the Women's Basketball World Cup.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:154-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:154-1@Artistic-Performance", "question": "At the beginning of the video, what is the man standing next to?\nA. The UEFA Champions League Trophy.\nB. The Olympic Torch.\nC. The FIFA World Cup Trophy.\nD. The Super Bowl Trophy.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Spatial Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:154-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:154-2@Artistic-Performance", "question": "Which of the following options best describes the scene in the background behind the man?\nA. A soccer field.\nB. A basketball court.\nC. An athletic track.\nD. A baseball diamond.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:154-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:154-3@Artistic-Performance", "question": "What can be inferred from the video about the location of the FIFA World Cup 2026 Final?\nA. It will be held in Manchester.\nB. It will be held in New York/New Jersey.\nC. It will be held in Houston.\nD. It will be held in Golden State.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:165-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:165-1@Artistic-Performance", "question": "Who was the first athlete to reach the finish line in the video?\nA. The athlete wearing a blue top and blue shorts.\nB. The athlete wearing a white top and black shorts.\nC. The athlete wearing a yellow top and green shorts.\nD. The athlete wearing a white top and red shorts.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:165-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:165-2@Artistic-Performance", "question": "How many athletes are competing in the video?\nA. 7.\nB. 5.\nC. 6.\nD. 8.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:165-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:165-3@Artistic-Performance", "question": "What is the competition event taking place in the video?\nA. Men's 400 meters.\nB. Men's 200 meters.\nC. Women's 400 meters.\nD. Women's 200 meters.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Attribute Perception/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:174-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:174-1@Artistic-Performance", "question": "Which color of balls is absent from the table?\nA. Green.\nB. Red.\nC. Blue.\nD. Black.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:174-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:174-2@Artistic-Performance", "question": "What Latin texts are inscribed on the man's chest?\nA. Liber Win and MrQ.\nB. Only Liber Win.\nC. Only MrQ.\nD. None of the above.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Information Synopsis/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:174-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:174-3@Artistic-Performance", "question": "What is the main focus of this video?\nA. An actor is being interviewed for winning a prize.\nB. A snooker player is being interviewed for entering the final competition.\nC. A father is being interviewed for talking about his slow brain.\nD. None of the above.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:177-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:177-1@Artistic-Performance", "question": "What is the current score of the ongoing game?\nA. 3-2.\nB. 2-3.\nC. 2-2.\nD. 3-3.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:177-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:177-2@Artistic-Performance", "question": "How many players are wearing black shirts in this video?\nA. 1.\nB. 3.\nC. 4.\nD. 2.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:177-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:177-3@Artistic-Performance", "question": "Who smashed the decisive ball?\nA. The woman in red with a number of 6 on her back.\nB. The woman in red with a number of 2 on her back.\nC. The woman in red with a number of 5 on her back.\nD. The woman in black.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:180-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:180-1@Artistic-Performance", "question": "How many players are participating in the game?\nA. 6.\nB. 4.\nC. 3.\nD. 5.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:180-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:180-2@Artistic-Performance", "question": "What happened to the blue player during the game?\nA. He won the first place.\nB. He slided out of the slope.\nC. He got injured during the game.\nD. He asked the umpire to stop the game.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Reasoning/short", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:180-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:180-3@Artistic-Performance", "question": "What country won first place?\nA. KOR.\nB. LAT.\nC. CHN.\nD. None of the above.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:434-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:434-1@Artistic-Performance", "question": "What does Vayne do at the beginning of the game?\nA. Helping teammate jungle.\nB. Attacking the top of the enemy.\nC. Attacking the jungle of the enemy.\nD. Staying at the fountain.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:434-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:434-2@Artistic-Performance", "question": "Which skill is used first by Vayne?\nA. Haste.\nB. Flash.\nC. Exhaust.\nD. Teleport.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:434-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:434-3@Artistic-Performance", "question": "Which position is Vayne in this video?\nA. Jungle.\nB. Support.\nC. Mid.\nD. Top.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Object Reasoning/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:445-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:445-1@Artistic-Performance", "question": "Extrapolating from the video, what team is the commentator on?\nA. Team 1.\nB. Team 2.\nC. He's not on either team.\nD. Cannot be inferred from the video.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Attribute Perception/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:445-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:445-2@Artistic-Performance", "question": "What is the largest run differential in the first inning of the game in the video?\nA. 4.\nB. 3.\nC. 2.\nD. 1.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:445-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:445-3@Artistic-Performance", "question": "How many points does a three-pointer count in the video?\nA. 4.\nB. 3.\nC. 1.\nD. 2.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Action Recognition/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:447-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:447-1@Artistic-Performance", "question": "What are the two doing in the video?\nA. Commentating on a basketball game.\nB. Shooting basketball commercials.\nC. Watch a basketball game.\nD. Have a basketball video game.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "dev", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:447-2", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:447-2@Artistic-Performance", "question": "What is the team's LAC hitting percentage when the score is 38-29?\nA. 48%.\nB. 41%.\nC. 56%.\nD. 54%.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/OCR Problems/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:447-3", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:447-3@Artistic-Performance", "question": "LAL completed the comeback with how much time left in the third quarter?\nA. 9.8s.\nB. 5min32s.\nC. 4min44s.\nD. 6.3s.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|
|
{"answer": null, "answer_format": "mcq", "as_of": "2024-07-04T08:14:20+00:00", "gold": [], "modality": "video", "origin": {"category": "Sports Competition/Counting Problem/medium", "construction": "cross-holder", "dataset": "lmms-eval/Video-MME", "item": "question_id:450-1", "revision": "ead1408f75b618502df9a1d8e0950166bf0a2a0b"}, "query_id": "videomme:450-1@Artistic-Performance", "question": "How many fouls are blown on players in black jerseys in the first game?\nA. 3.\nB. 2.\nC. 4.\nD. 1.", "scope": {"holder": "Artistic-Performance", "scenario": "video-qa", "session": null}, "split": "test", "unanswerable": true}
|