HarmBench audit finds one refusal score hides several patterns of model behavior
A psychometric study separates response patterns behind HELM Safety scores and tests the limits of aggregate comparisons.
Explore Franklin AI
Understand new AI research with readable explanations and links to the original papers.
A psychometric study separates response patterns behind HELM Safety scores and tests the limits of aggregate comparisons.
Nguyen and Fithian refit METR's software-task data and propose diagnostics for interpreting AI capability in human minutes.
Token counts differ between instructed response policies at group level, but the study does not establish an individual-answer lie detector.
Water-quality valuation prompts expose different failures in price sensitivity, scope and agreement across elicitation formats.
An environment-maintained record reduces omissions in multi-file deliverables, while its completion checks still depend on requirements and cited content.
The study scales action-conditioned world models to 8B parameters while holding the visual encoder fixed, then tests planning toward image goals.
Hypothesis-guided trials improve simulated manipulation and transfer to a real arm, with the transfer claim applying to the harness rather than an untrained robot policy.
Verifier-certified action probes track post-trained performance across ten model pairs without asking untuned checkpoints to run an agent from scratch.
A six-month historical evaluation favors the post-trained strategy selector, but its strongest variant excludes news during reinforcement learning.
Six of twelve systems exceed a published reference on a composite evaluation, while the reference remains strongest on observed statistics.
Start with the overview to understand the paper’s main idea, then follow its original paper link for the methods, results and limitations.
Use Submit Research to send the original paper URL and explain why it is useful. An editor reviews the suggestion before publication.