FSMBench

university

AI & ML interests

Evaluating and Benchmarking Large Multimodal Models

Recent Activity

taesiri submitted a paper about 11 hours ago

Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable

taesiri submitted a paper about 11 hours ago

OvisOCR2 Technical Report

taesiri submitted a paper about 24 hours ago

Let RGB Be the Language of Vision

View all activity

spaces 3

FSMBenchLeaderboard

Heatmaps

Display heatmaps for model performance comparisons

Something

models 0

None public yet

datasets 13

FSMBench/fsmbench_reborn_subset_864

Viewer • Updated May 13, 2024 • 864 • 29

FSMBench/fsmbench_reborn_12k

Viewer • Updated May 13, 2024 • 12.8k • 28

FSMBench/simple_fsm_vision_qa

Viewer • Updated May 6, 2024 • 1.92k • 18

FSMBench/fsmbench_what_will_be_the_state_12K_with_output_instruction

Viewer • Updated May 5, 2024 • 12.8k • 13

FSMBench/fsmbench_intersection_set_2

Viewer • Updated Apr 21, 2024 • 1.58k • 31

FSMBench/fsmbench_what_will_be_the_state_12K_oneshot

Viewer • Updated Apr 16, 2024 • 12.8k • 13

FSMBench/fsmbench_intersection_set_1

Viewer • Updated Apr 16, 2024 • 500 • 19

FSMBench/fsmbench_what_will_be_the_state_12K_think_step_by_step_image

Viewer • Updated Apr 13, 2024 • 12.8k • 46

FSMBench/fsmbench_what_will_be_the_state_12K_image

Viewer • Updated Mar 23, 2024 • 12.8k • 96

FSMBench/fsmbench_what_will_be_the_state_12K_think_step_by_step

Viewer • Updated Mar 18, 2024 • 12.8k • 12

View 13 datasets