Resources for Measure what Matters: Psychometric Evaluation of AI with Situational Judgment Tests)(https://arxiv.org/abs/2510.22170)
AI & ML interests
We work with you to develop a high impact AI strategy for your industry, refine your data foundations and design meaningful human-AI interactions. We also empower you to develop, integrate and test the latest AI technologies responsibly.
Recent Activity
View all activity
models 13
thoughtworks/arithmetic-sorl
Updated
thoughtworks/Gemma-4-31B-Eagle3
Text Generation • 0.6B • Updated • 25
thoughtworks/arithmetic-sorl-saes
Updated
thoughtworks/DeepSeek-R1-Distill-Qwen-14B-Eagle3
Text Generation • Updated • 294
thoughtworks/DeepSeek-R1-Distill-Qwen-7B-Eagle3
Text Generation • Updated • 286
thoughtworks/Qwen2.5-7B-Instruct-Eagle3
Text Generation • Updated • 289
thoughtworks/Llama-3.2-3B-Instruct-Eagle3
Text Generation • Updated • 279
thoughtworks/Qwen3-32B-Eagle3
Text Generation • Updated • 269
thoughtworks/Qwen3-14B-Eagle3
Text Generation • Updated • 257
thoughtworks/Qwen3-8B-Eagle3
Text Generation • Updated • 260
datasets 13
thoughtworks/arithmetic-sorl-data
Viewer • Updated • 1.02M • 29
thoughtworks/ablation_psychometrics_personas
Viewer • Updated • 500 • 20
thoughtworks/gemma_psychometrics_personas_responses
Viewer • Updated • 3.98M • 185 • 1
thoughtworks/psychometric_personas
Viewer • Updated • 23.6k • 98
thoughtworks/psychometric_sjts_analysis
Viewer • Updated • 1.85k • 51
thoughtworks/psychometric_personas_responses
Viewer • Updated • 4.57M • 124 • 1
thoughtworks/CulturalCounterfactuals
Updated • 6
thoughtworks/psychometric_human_annotations
Viewer • Updated • 55 • 7
thoughtworks/parliamentary_personas
Viewer • Updated • 2.2k • 9
thoughtworks/psychometric_personas_temp
Viewer • Updated • 50 • 10