Movie Facts and Fibs (MF²): A Benchmark for Long Movie Understanding

⚠️ This repository is outdated. The current code and instructions are in deep-spin/MF2-bench-how-well-vlms-understand-movies.

Name		Name	Last commit message	Last commit date
data		data
model_serving		model_serving
models		models
src_cropped_movies		src_cropped_movies
templates		templates
README.md		README.md
get_model_results_on_granularities_categories.ipynb		get_model_results_on_granularities_categories.ipynb
parse_model_outputs.py		parse_model_outputs.py
requirements.txt		requirements.txt
run_closed_inference.sh		run_closed_inference.sh
run_gemini_2.5.py		run_gemini_2.5.py
run_gpt4o.py		run_gpt4o.py
run_open_inference.sh		run_open_inference.sh
run_open_vlm.py		run_open_vlm.py
utils.py		utils.py

Navigation Menu