Firehose

Filtered to Papers, tagged “benchmarks” · clear filters

All PeopleCompaniesPapersPodcastsHacker News

Browse by tag

29 OCT 2026 · Paper

This paper creates a system that turns users' histories into labels to help improve AI agents' memory systems, making them more adaptable to different tasks and users. Practitioners might care about this because it can help improve the performance of AI agents in real-world applications.

29 OCT 2026 · Paper

This paper develops a framework called CodeSpecWeave to help coding agents create more realistic and comprehensive task specifications for long-horizon software development. Practitioners may care about this because it could improve the performance and reliability of coding agents in real-world development scenarios.

29 OCT 2026 · Paper

This paper proposes a method to improve text-to-image generation models by matching the generated distribution with a reference distribution, allowing for more accurate rendering of details specified in the prompt. Practitioners may care about this approach as it can lead to better performance on image generation tasks.

29 OCT 2026 · Paper

This paper introduces Youtu-Parsing-Omni, a system that can parse documents, images, audio, and video into structured records, allowing agents to access and cite evidence across multiple modalities. Practitioners might care about this research because it provides a new approach to multimodal parsing that can improve the performance of agents in various applications.

29 OCT 2026 · Paper

This paper proves the Platonic Representation Hypothesis by showing that models trained on different modalities (e.g. vision and language) converge to the same representation of the world as they scale, but with a specific condition (good views). Practitioners might care because this has implications for building more efficient and accurate multimodal AI models.

27 OCT 2026 · Paper

This paper introduces SciGame, a controlled benchmark for evaluating language model agents in scientific discovery, and finds that familiar priors can hinder performance, adaptive experimentation can be beneficial but also unfair, and that agents struggle to induce exact symbolic laws in unfamiliar settings.

27 OCT 2026 · Paper

This paper introduces WebAnything, a framework that automatically generates reusable website environments from real URLs, allowing for reproducible training and evaluation of web agents. Practitioners might care about this because it simplifies the creation of diverse and realistic environments for training AI models.