Results for “benchmarking”

A Systematic Survey of Deep Research

[ICML2025 Oral] LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

Awesome papers involving LLMs in Social Science.

非线智能 NoneLinear - ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE

Awesome LLM Papers and repos on very comprehensive topics.

xLAM: A Family of Large Action Models to Empower AI Agent Systems

[ICLR 2025 Oral] This is the official repo for the paper "LLM-SR" on Scientific Equation Discovery and Symbolic Regressi

Yunjue Agent: A Fully Reproducible, Zero-Start In-Situ Self-Evolving Agent System for Open-Ended Tasks

The benchmark tasks and evaluation harness for "PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments".

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolution

Odyssey: Empowering Minecraft Agents with Open-World Skills

"DeepCode: Open Agentic Coding (Paper2Code & Text2Web & Text2Backend)"

ML-Dev-Bench is a benchmark for evaluating AI agents against various ML development tasks.

LLM Agent that leverages cheminformatics tools to provide informed responses.

YantrikDB memory provider for NousResearch/hermes-agent — self-maintaining memory with canonicalization, contradiction t

Official Implementation of UA^{2}-Agent and other baseline algorithms of "Towards Unified Alignment Between Agents, Huma

🧙🏻 Code and benchmark for our Findings of ACL 2024 paper - "TimeChara: Evaluating Point-in-Time Character Hallucinatio

Agentic Theorem Prover for Rocq for Program Verification

Code and Data for "MIRAI: Evaluating LLM Agents for Event Forecasting"

[CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

A general purpose scientific writer

ICML 2026 · Plug-and-play long-term memory for LLM agents

🔴 VERY LARGE AI TOOL LIST! 🔴 Curated list of AI Tools - Updated 2026

A curated list of awesome things related to Anthropic Claude

@microsoft✓ Official

[ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures?

[ACL 2024 Findings] MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning https://arxiv.org/

The pretty much "official" DSPy framework for Typescript

🤖 Awesome list of AGI Agents. Agents 精选资源合集.

The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.

The official repository of "SmartAgent: Chain-of-User-Thought for Embodied Personalized Agent in Cyber World".

Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan

Structured deep research skill for Claude Code/Open Code/Codex with human-in-the-loop control

Towards Large Multimodal Models as Visual Foundation Agents

RepairAgent is an autonomous LLM-based agent for software repair.

[ICLR2026] The official repository for the CodeGym project: "Generalizable End-to-End Tool-Use RL with Synthetic CodeGym

Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups

MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)

AI Observability & Evaluation

Agent Interface Discovery

Declarative agent config for Claude Code, Codex, and Cursor: an agent.json manifest for skills, MCP servers, and stack p

@microsoft✓ Official

A programming framework for agentic AI