Evaluation cues change model refusals across English and five Indic languages
A study finds that telling models they are under safety evaluation increases harmful-request refusals, while also increasing some benign refusals.
Explore Franklin AI
Understand new AI research with readable explanations and links to the original papers.
A study finds that telling models they are under safety evaluation increases harmful-request refusals, while also increasing some benign refusals.
MLExpert combines supervised training and window-based reinforcement learning, reporting a higher medal rate on MLE-Bench Lite and tests of transfer to other tasks.
A research team reports a four-agent Minecraft completion after more than 27 hours, offering a case study in long-running coordination and recovery.
Researchers apply a shared projection to query and datastore embeddings, reporting useful retrieval performance and empirical resistance to extraction attacks.
LangDiT changes the Transformer backbone while preserving the underlying diffusion setup, reporting lower generation perplexity in matched experiments.
LEASH combines initial routing, step-level escalation and continued oversight, reporting OSWorld improvements while reducing cost in one compared configuration.
An environment-agnostic agent improves on some benchmarks after prompt and controller changes, but the study reports mixed transfer and higher token costs.
FDE-Gym evaluates 95 simulated delivery tasks using customer outcomes and interaction costs, finding gaps in both discovering constraints and executing solutions.
EliteReplay combines reinforcement learning with an archive of diverse solutions, reporting gains in text-to-SQL strategy coverage and ambiguous-question handling.
KnowGPO groups search trajectories by acquired knowledge and reports gains over outcome-only and process-supervision baselines on three benchmarks.
Start with the overview to understand the paper’s main idea, then follow its original paper link for the methods, results and limitations.
Use Submit Research to send the original paper URL and explain why it is useful. An editor reviews the suggestion before publication.