Results for “vllm”

Official Implementation for the Paper [AgentArk: Distilling Multi-Agent Intelligence into a Single LLM Agent](https://ar

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

MCP server for troubleshooting vLLM inference workloads on Red Hat OpenShift AI — queries Prometheus, Alertmanager, Loki

ContextLattice is the local-first control plane for long-horizon agent memory and coordination.

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

AI gateway written in Go. Lightweight unified OpenAI-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama. L

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your cl

Persistent memory for any AI — MCP server, HTTP API, CLI. Works with Claude, ChatGPT, Grok, Gemini, Codex, Cursor, OpenC

🚀 MassGen is an open-source multi-agent scaling system that runs in your terminal, autonomously orchestrating frontier

[ICML2025 Oral] LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models

Governed observability + governance for on-endpoint local LLMs (Ollama): model policy, deterministic prompt scanner, rou

MCP server that saves Claude Code tokens by delegating bounded tasks to local or cloud LLMs. Works with LM Studio, Ollam

🎭 AI Avatar / digital human platform — upload a photo, clone a voice, talk to any face in real time with lip-sync video

The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.

Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan

MCP server for OpenAI's Deep Research APIs, Gemini Deep Research Agent, Allen AI's DR-Tulu, and Hugging Face's Open Deep

Synthetic monitoring and CI smoke tests for LLM inference endpoints.

Industrial-grade speech recognition toolkit: 170x realtime, 50+ languages, speaker diarization, emotion detection, strea

A Python library powered by Language Models (LLMs) for conversational data discovery and analysis.

This repo covers LLM, Agents, MCP Tools, Skills concepts with sample codes: LangChain & LangGraph, AWS Strands Agents, G

Open-source deep research MCP. Qwen3-30B-A3B-Thinking via OpenRouter, cited web synthesis for Claude Code, Codex, Cursor

Open-source AI agent orchestration platform — self-hosted mission control for autonomous multi-agent systems. Visual DAG

本项目为xiaozhi-esp32提供后端服务，帮助您快速搭建ESP32设备控制服务器。Backend service for xiaozhi-esp32, helps you quickly build an ESP32 device c

Python, LlamaIndex, LangChain, Docker Compose: 15 Property Graph, 4 RDF , 10 Vector, OpenSearch, Elasticsearch, Alfresco

Fully autonomous AI Agents system capable of performing complex penetration testing tasks

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails

A map of what AI tokens actually cost, and where they're wasted vs. well spent. Tools, research, practices, and copy-pas

A powerful AI assistant integrated into KOReader.

Custom AWS Transform agent that migrates PyTorch/Triton kernels to AWS Trainium NKI (@nki.jit) and compiles, numerically

Opinionated agentic RAG powered by LanceDB, Pydantic AI, and Docling

Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features

AI-powered IDE for bioinformatics — built by biologists, for biologists

Source code for our paper: "ARIA: Training Language Agents with Intention-Driven Reward Aggregation".

Open-source MCP server giving AI assistants live, natural-language control of real quantum hardware across IBM Quantum,

Automation frameworks shouldn't fight you. Marktoflow is CLI-native automation with the power of AI agents. Write workfl

Lightweight, open-source AI agent for your tools, chats, and workflows.

A list of open-source AI projects you can use to generate income easily.

AI-powered OSINT agent with interactive REPL, MCP server, and CLI. 16 tools. Works with Claude, GPT-4, or local models.

acrawl — LLM-powered web crawler. Describe what you want in plain English, get structured data back. Single Rust binary,

🔴 VERY LARGE AI TOOL LIST! 🔴 Curated list of AI Tools - Updated 2026

一个生产级的深度研究 Agent 系统，从零构建多智能体编排、Red-Blue 对抗降噪、 语义级上下文压缩、跨 Agent 共享记忆四大核心能力，配套 165 次独立实验 + Bootstrap 统计显著性检验的完整评测体系。

LLM Agent that leverages cheminformatics tools to provide informed responses.

From a goal to a task DAG, automatically. TypeScript-native multi-agent orchestration.

Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CP

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained acce