We introduce GAPA (Gender Associations of Physical Attributes), a dataset of 316 physical attributes paired with 14,706 human gender-association ratings, and show that seemingly “objective” physical descriptions still carry systematic gender associations that 16 evaluated LLMs only partially and unevenly recover.

FormalRx is a diagnostic evaluation framework for autoformalization built on the SCI Error Taxonomy (28 error categories). It supports alignment verdicts, error categorization, localization, and correction, and introduces FormalRx-8B and the FormalRx-Test benchmark.

FaStfact is a multi-agent pipeline for evaluating long-form generation factuality that achieves the highest alignment with human evaluation and time/token efficiency among existing baselines. An annotated FaStfact-bench is also open-sourced.

FormalAlign aims to address a long-lasting challenge in autoformalization - the absence of an effective alignment evaluation metric. It accurately assesses the semantic and logical alignment between the natural language and formal theorems.

MR-BEN is a comprehensive process-based benchmark to evaluate advanced `meta-reasoning’ skills, where models are asked to locate and analyse errors in the provided CoT solutions. It comprises 5,975 multi-domain samples with annotated groundtruths.