Tracked Repositories
2035
Cognaptus DataHub Monitor
A monitored reference page for GitHub repositories surfaced from arXiv-paper digests, rendered from a machine-generated local data file.
Tracked Repositories
2035
Unique Papers
1557
Core Fields
paper title, ref_id, GitHub URL
Refresh Mode
local data file written by backend tasks
Use it as a lightweight index of implementation assets surfaced from research digests. The page stays defensive: required fields remain visible even when optional metadata is missing.
This page is designed as a refreshable reference surface rather than a hand-maintained article.
The goal is simple: when paper-digest workflows identify linked GitHub repositories, keep them visible in one place with enough context to scan quickly and revisit later.
Search by paper title, arXiv reference, GitHub repository, author, or tags when those fields are available.
Repository containing code, configurations, prompts, and data-processing utilities for according-to prompting and QUIP-Score experiments.
Official repository for the paper containing the in-the-wild prompt corpus, forbidden-question set, ChatGLM evaluator, and semantic-visualization code.
Repository containing code and results for the LLM-based zero-shot tree induction and embedding experiments, with feature-description files referenced for private-dataset feature names.
Repository containing code and data for replicating the paper's LIME and SP-LIME experiments.
Repository linked by the paper as the code for PriorDynaFlow, the proposed a priori dynamic multi-agent workflow construction framework.
Repository for the KindsOfReasoning collection and raw outputs/evaluation results for OpenAI instruction-tuned models.
Repository identified by the paper as containing code for the empirical experiments.
Repository containing the experimental software associated with the proposed causal evaluation framework for deferring systems.
Python, notebook, and spreadsheet materials for driver ranking, forced ARMA changes, and related paper experiments.
EvolveGCN repository data folder referenced as the source for the SBM dynamic graph benchmark.
Repository containing datasets and code files supporting the paper's DeepSeek-versus-other-LLMs benchmark.
Repository containing accompanying code and resources for the book, including chapter folders and Python-oriented examples for XAI techniques.
Aegis is an open-source defense system directly evaluated as one of the paper's jailbreak defenses.
The paper's LLM Jailbreak Attack-Defense Arena implementation, containing attack and defense modules, benchmark data, evaluation utilities, and support for the three tested models.
LLM Guard is an open-source LLM security toolkit directly evaluated in the paper's defense benchmark.
An implementation referenced for reducing GPU all-to-all communication bottlenecks in large-scale MoE execution.
A GitHub repository associated with the survey that organises resources and representative work on self-evolving AI agents.
Repository implementing the LED baselines, evidence-selection scaffold, shorter-context experiments, heuristic evidence baselines, and evaluation workflow reported for QASPER.
Repository containing the EIIE portfolio-management code, configurations, figures, tables, and data used for the cryptocurrency replication and stock-market extension.
PGPortfolio (Policy Gradient Portfolio), the authors' source-code repository implementing the paper's deep reinforcement-learning portfolio framework.
AIDE-ML: AI-Driven Exploration in the Space of Code, used as the agentic AutoML baseline/interface for observing decisions and artifacts.
Git repository providing open access to the research datasets supporting the study's findings and replication.
Source code for a minimal MedLog prototype using an OpenAPI-described HTTP REST interface.
Repository for the financial news dataset used with permission as part of the paper's Bloomberg dataset experiments.
Open implementation code for the TGN-SEAL framework introduced and evaluated in the paper.
Public codebase containing the Agent-Driver pipeline, tool library, cognitive memory, reasoning engine, scripts for fine-tuning and inference, prepared data layout, and nuScenes evaluation workflow.
The public Lean 4/Mathlib library containing the formalized QAOA and Ising-ring components, the lower-bound and attainability theorems, and the machine-checked proof of residualEnergy_isLeast.
Repository released by the authors for the minimal agentic theorem prover and experiment reproduction.
Official code repository for interaction-aware retargeting, retargeted trajectories, Isaac Lab task environments, PPO training, and evaluation scripts for the paper.
Repository for the CLINC150 intent-classification and out-of-scope evaluation data used in the experiments.
Repository for the StackOverflow short-text intent dataset evaluated by the paper.
Repository containing the Banking77 fine-grained banking-intent dataset evaluated by the paper.
Repository for a hybrid LSTM, multi-head attention, Gaussian fuzzy-rule, and ARIX local-model forecasting system, including folders for LSTM, Transformer, Neuro-fuzzy, data utilities, model code, and an experiment notebook.
R-based analysis and reporting pipeline orchestrated with DVC, with scripts, parameters, environment configuration, intermediate outputs, and instructions for reproducing the reported results.
Repository containing code used for the paper, including notebooks and utilities for the daily trading strategy, the CNN model with the new loss, data downloading/processing, baselines, and analysis.
Repository containing Python, R, and notebook implementations, data files, portfolio outputs, and figures associated with the dynamic stock-recommendation study.
Repository for Dedupe, the SVM-distance and hierarchical-clustering baseline evaluated against PDDM-AL.
Repository associated with the proposed red-teaming framework, containing generated faithfulness/completeness datasets and prompt materials; the paper states that model configurations, evaluation scripts, standardized judge instructions, attacker prompts, and consensus aggregation code are made available there.
A repository created to keep pace with the fast-moving literature on LLMs and LLM-based agents in science.
Repository released by the author for resources associated with the LLM-agent survey.
TensorTrade is cited as an open-source package/platform relevant to implementing and adapting RL methods to finance.
Official code repository for the paper's Agora implementation and heterogeneous 100-agent demonstration.
The GitHub repository contains the self-improving coding-agent implementation introduced by the paper.
FakeNewsNet repository containing fake-news research data resources and crawler tooling for collecting news and related social-media data.
Repository containing the resulting mind map, collected notes for each reviewed grey resource, and an online repository of references for further exploration.
The Google Agent2Agent protocol repository, reviewed as a general-purpose inter-agent protocol and used in the paper's comparative use-case analysis.
Repository for the Web-Agent Protocol, reviewed as a domain-specific inter-agent or human-computer interaction protocol.
Repository for the agents.json specification, reviewed as a domain-specific context-oriented protocol for exposing website capabilities to agents.
Companion repository maintained by the authors to track ongoing developments in AI agent protocols.
Author-maintained companion repository containing the survey's framework materials and a curated, stage-organized list of AI Scientist papers, systems, benchmarks, and applications.
An Awesome Data Agents repository linked directly in the paper header, likely used to collect or organize data-agent resources associated with the survey.
JoyAgent is discussed as a proto-L3 system that begins to address predefined-toolset limitations through tool evolution and multi-level thinking.
GitHub repository established by the authors as the project page associated with the survey on embodied learning for object-centric robotic manipulation.
Repository linked by the paper as the full list of surveyed papers and summary slides.
Repository for AlphaFin, a benchmark/resource associated with financial question answering and stock prediction.
Repository for R-Judge, a benchmark for safety judgment and risk identification.
Repository for FinanceBench, a financial question-answering benchmark.
Repository for a Japanese financial language-model benchmark.
Repository for BBT-Fin/CUGE-related Chinese financial language benchmark resources.
Repository for FinEval, a Chinese benchmark for financial domain knowledge.
Repository for PIXIU/FinMA-related financial LLM resources, instruction data, and evaluation benchmarks.
Repository for CFBenchmark, a Chinese financial benchmark covering multiple financial NLP tasks.
Repository for DocMath-Eval, used for evaluating numerical reasoning over text and tables.
Official repository for the survey, maintaining a categorized collection of papers, projects, datasets, tools, and related public materials.
A curated repository of papers and benchmarks associated with the survey on reasoning with foundation models.
Maintained repository containing the survey's paper list, figures, taxonomy-oriented table of contents, and contribution channel for adding omitted work.
The authors' repository organizes VLM papers, models, datasets, evaluation resources, alignment methods, applications, and challenge areas beyond the static paper.
Official repository for the survey, containing the README, poster, and datasets.csv catalog used to share the dataset analysis.
agentUniverse, a multi-agent ecosystem for autonomous agents.
Agno, described as an agentic workflow framework for LLM applications.
Phidata, described as a framework for building multi-modal agents with memory, knowledge, tools, and reasoning.
Coze, described as an open framework for building agentic applications.
Flowise, described as a drag-and-drop UI to build LLM apps with LangChain.
LangGraph, described as a stateful multi-actor workflow library for LLM applications.
Dify, described as an open-source LLM application development platform.
Microsoft Semantic Kernel, compared as an agent workflow system.
n8n, described as a fair-code workflow automation platform with UI and integrations.
OpenAI Swarm, described as a multi-agent framework by OpenAI.
Qwen-Agent, a QwenLM agent framework/repository compared in the survey.
Official companion repository that organizes papers relevant to language-model data selection across the training stages and method categories used by the survey.
Transformer model library used as an inference baseline in the framework comparison.
Inference and deployment framework used in the paper's W4A16 quantization benchmark.
LLM serving framework compared for inference and serving throughput, memory management, batching, and scheduling.
NVIDIA inference and serving framework used in the paper's W4A16 quantization benchmark and framework comparison.
An author-linked repository organizing papers on retrieval-augmented generation.
GPT Engineer, a software-development agent implementation cited in the engineering application survey and open-source project discussion.
GPT Researcher, an experimental application that uses LLMs for research-question development, web crawling, source summarization, and aggregation.
AI Legion, an LLM-agent implementation cited in the survey's open-source library and reference set.
LoopGPT, an LLM-agent implementation cited in the survey's open-source library and reference set.
AGiXT, an agent framework implementation cited in the survey as a dynamic AI automation platform.
DemoGPT, a software-development agent repository cited in the engineering application survey and open-source project discussion.
MiniAGI, an LLM-agent implementation cited in the survey's open-source library and reference set.
AgentVerse, a multi-agent collaboration framework referenced among surveyed agent systems and open-source libraries.
AgentGPT, an LLM-based autonomous-agent system cited in the survey's open-source library and reference set.
Auto-GPT, an autonomous LLM-agent implementation included in the construction taxonomy and open-source library discussion.
SmolModels/developer-style agent repository cited as a software engineering application artifact.
WorkGPT, a workflow-oriented LLM-agent framework cited as similar to AutoGPT and LangChain.
SuperAGI, an autonomous-agent framework cited in the survey's open-source library and reference set.
XLang, an LLM-agent/tool-use framework cited as supporting executable language grounding and interaction with databases, web applications, and physical robots.
Curated repository for tracking LoRA-related research updates and supporting discussion around the survey taxonomy.
Author-maintained repository established to facilitate ongoing updates and sharing of advances related to the survey's MoE literature coverage.
Repository for the survey on memory mechanisms of LLM-based agents, including the paper link and visual summaries of the survey sections.
A curated reading list accompanying the survey, organized around LLM-agent optimization methods, datasets, benchmarks, and applications.
Repository for the paper's code and experimental workflow comparing LLM self-explanations, human rationales, and post-hoc attribution explanations.
Repository path listed as the source for the gas station revenue dataset.
Repository listed as the source for daily COVID-19 confirmed and recovered case data.
Repository listed as the source for SPMD and VED driving and vehicle energy datasets.
Repository listed as the source for the exchange-rate dataset used in LTSF studies.
Repository listed as the source for daily stock opening price data.
Repository listed as the source for the ETT transformer temperature/load dataset.
Public repository containing the medical RAG application, evaluation framework, text rechunking pipeline, experimental configurations, and generated evaluation outputs associated with the study.
OpenAI HumanEval benchmark for evaluating code generation with pass@k metrics.
Self-rewarding reasoning LLM implementation referenced as an example of using model-generated judgments to reduce annotation cost.
AlpacaEval benchmark for automatic evaluation of instruction-following model outputs.
Repository containing the Phase 1 SSL and contrastive encoder code, Phase 2 MoE PPO curriculum, inference and backtest scripts, routing diagnostics, and deployment-related components; the repository states that Phase 3 personalization is proprietary and not released.
Repository containing code for training and evaluating the Transformer electricity price forecasting model and comparing it against EPF toolbox benchmarks.
Repository linked from the paper that mirrors the paper title, abstract, framework figure, table of contents, and compiled relevant works for agent categories and attack types.
Author-provided production-oriented implementation of the A-Mem agentic memory system.
Author-provided repository for evaluating the A-Mem method and reproducing benchmark experiments.
Open-source MVP and implementation repository for the AAGATE governance platform introduced by the paper.
Repository for ABC-Bench, a benchmark for evaluating whether coding agents can explore repositories, edit code, configure environments, deploy containerized backend services, and pass external HTTP/API integration tests.
Optimized Faiss exact-search implementation for Intel CPUs.
Cycle-approximate IKS simulator parameterized with RTL and memory/interconnect timing.
Public repository containing the access-controlled website implementation, agent-side experiment scripts, modified SST/Auth component as a submodule, and experiment logs for delegated access workflows.
Public repository for MCTSr, including scripts for running the supported mathematics benchmarks with LLM inference servers.
Code and dataset repository for ActivationReasoning, including implementation and materials for replication or extension.
Official repository containing the FLARE code, task configurations, experimental data, retrieval setup, and run instructions.
Repository containing the ADAGE seven-stage construction pipeline, CAPR-ar/CAPR-am/CAPR-ja benchmark data, model-evaluation code, configurations, and reported evaluation results.
Repository linked by the paper for AutoCompressor code and released models.
Repository containing data loaders, preprocessing, regime models, custom environments, PPO training pipelines, ablations, evaluation outputs, figures, and notebooks associated with the regime-aware portfolio framework.
SentiFin is cited as a benchmark dataset for sentiment analysis of Indian financial news headlines and is used to fine-tune the LLaMA 3.2 model.
An installable Python repository implementing AGoT, AIoT, and GIoT and providing experimental setups, datasets, and result files used to reproduce or inspect the paper's evaluations.
Repository containing the code developed and used for the study, with a README to support replication and methodology exploration.
GitHub repository identified by the paper as containing implementation details for the Dueling DDQN liquidity-provision method and baseline methods.
Repository stated to include scripts for data preprocessing, model training, performance evaluation, and ablation studies for AMDTL.
Repository containing AMDM implementation code, simulation scripts, evaluation scripts, example data, results files, plots, and the paper materials.
Longformer repository for the long-document transformer model evaluated as an additional architecture in the paper.
A continuously updated collection of FFM-related publications, tools, datasets, and resources associated with the survey.
The paper identifies this repository as containing representative Python code generated under the tested prompt levels.
Author-owned repository for the ICME 2024 ATS paper and its proposed scene-text VQA architecture.
Repository implementing AFlow's nodes, operators, workflow representation, optimizer, evaluator, benchmark integrations, and scripts for reproducing the paper's workflow-search experiments.
Claude-Agent-SDK framework used as one of the scaffold alternatives in the agentic scaffold impact study.
Public repository for the AgencyBench benchmark and evaluation toolkit released by the authors.
OpenAI-Agents-SDK framework used as one of the scaffold alternatives in the agentic scaffold impact study.
Repository for the AGENT KB cross-framework agent memory system introduced and evaluated in the paper.
Official open-source implementation of Agent Laboratory, including the end-to-end research workflow and source modules for mle-solver and paper-solver.
Official Agent Lumos repository containing code for annotation generation, module training, and benchmark evaluation.
Official WebShop environment used as an unseen interactive task in the Lumos generalization evaluation.
Repository for the Agent Mentor / Agent Analytics open-source observability and analytics platform for agentic AI applications.
GitHub path identified by the paper as the code corresponding to the analytics pipeline used for semantic feature analysis.
Repository for building task/state knowledge, processing training data, constructing the state knowledge cache, LoRA training of agent and world knowledge models, and evaluating the paper's planning experiments.
Repository containing experiment code, response matrices, IRT models, task embeddings, LLM-as-a-judge features, adaptive testing code, and scripts for the new task, new response, new agent, and new benchmark experiments.
Repository for the paper's virtual trading arena, ArenaTrader implementation, prompts, code, and data.
Official code repository implementing AWM pipelines for WebArena and Mind2Web in offline and online settings.
Repository for the Agent-as-a-Judge project and DevAI-related evaluation artifacts.
GPT-Pilot is one of the three open-source code-generation agentic systems benchmarked in the paper.
A GitHub repository collecting papers and resources for the survey on Agent-as-a-Judge.
Repository associated with Agent-R, the paper's iterative self-training framework for training language-model agents to reflect and recover from errors.
Repository for AgentBench datasets, environments, and integrated evaluation package.
Official AgentBoard repository containing the benchmark/evaluation framework and associated data resources introduced by the paper.
Indeed Hiring Lab repository tracking the share of job postings mentioning artificial intelligence.
Google's Agent-to-Agent Protocol repository, referenced as the source for A2A, one of the modern agent communication protocols compared in the paper.
BlenderMCP repository cited as a GitHub integration for Blender Model Context Protocol.
PowerAgent PowerMCP repository cited as a GitHub implementation for power-system simulation software MCPs.
Repository hosting the draft proteomics_GROUNDING.md epistemic grounding specification and Appendix A preliminary testing materials.
LangGraph is used to illustrate graph traversal with persistent state, checkpoints, controlled cycles, guard nodes, approval steps, and typed state updates for production flow engineering.
Swarm is used to illustrate specialist-agent handoffs and routines as a controllable coordination pattern complementary to state-machine-style graph orchestration.
Open-source repository for the Agent4CT loop, all 26 solver implementations, compact recombination solvers, helical-to-fan rebinning pipeline, and evaluation scripts.
Agent-zero repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
ANUS repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Camel repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
CrewAI repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
MetaGPT repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Google ADK repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Source code repository released by the authors for reproducing the benchmark comparison.
LangChain repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
LangGraph repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Mastra repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
PraisonAI repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Autogen repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Semantic-kernel repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
TaskWeaver repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
OpenAI-Agents-Python repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Swarm repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Pydantic-AI repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Qwen-Agent repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
AutoGPT repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
SuperAGI repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Upsonic repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
Agency-swarm repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
BabyAGI repository evaluated as a selected agentic framework in the paper's 22-framework benchmark study.
A curated and continuously updated collection of papers and resources organized around the survey's foundational, self-evolving, collective, application, and benchmark taxonomy.
Code repository for the Agentic Reasoning framework introduced and evaluated in the paper.
Public repository for Agentic Reward Modeling, including the RewardAgent implementation and materials intended to facilitate further research.
A continuously updated collection of relevant studies for the Agentic Web.
Official code repository linked by the paper for Agentic-DPO; the current release includes the StableToolBench Qwen3.5-2B training pipeline, canonical step pairs, PPA rendering, hard-negative generation, and trainer code.
Repository for the AgenticPay benchmark and framework, including buyer and seller agents, negotiation environments, examples, metrics, and model backends for LLM-based commerce negotiation.
Repository containing the AgentLAB benchmark code, attack scripts, environments, prompts, data, and usage instructions for evaluating LLM agents against long-horizon attacks.
Official open-source repository for the Agentless approach introduced and evaluated in the paper.
Repository associated with AgentOrchestra; it contains the hierarchical agent runtime and evolving protocol/resource implementation used for general-purpose agent research.
Repository for the AgentRewardBench library, including tools for running agents, running judges, scoring judgments, loading trajectories, and submitting leaderboard results.
Repository associated with AgentRx, the paper's diagnostic framework and benchmark artifact for AI-agent failure attribution.
Official repository for PASB, including the benchmark data, baseline runners, judge code, audit scripts, and documentation.
Hermes-Agent is one of the two stateful personal-agent stacks evaluated by PASB.
OpenClaw is one of the two stateful personal-agent stacks evaluated by PASB.
A curated GitHub repository associated with the paper that lists and classifies related papers on LLM-based agents in software engineering.
The GitHub repository for AgentScope, the multi-agent platform described in the paper.
Public implementation of AgentStepper and relevant data for the paper's evaluation.
GitHub Gist containing the Claude Code implementation prompt for the case summarization by file name microservice.
GitHub Gist containing the Case Summarization by Given Case Name Workflow pitch generated by the Planning Agent.
Official repository for the AgentVerse framework introduced and evaluated in the paper.
AgentWard prototype repository implementing a lifecycle security architecture for autonomous AI agents with native adaptation to OpenClaw.
Agile V skills repository v1.3, described as the composable AI-agent skills library that operationalizes Agile V and includes context-engineering patterns.
Repository released by the authors for the robust-transformers implementation used with AGRO.
A GitHub CLI extension that exposes a compact interface for reading review threads and submitting inline pull request comments.
Agyn platform for configuring and orchestrating multi-agent systems with explicit communication, roles, and dedicated sandboxes.
Repository for the AI Act Evaluation Benchmark, including structured EU AI Act compliance scenarios, QA pairs, documentation, and scripts.
Official repository released by the authors with code to reproduce all experimental results, implementations of the proposed simple baselines, and the DSPy joint optimizer.
BabyAGI is used as a representative agentic framework showing how LLMs can be embedded in feedback loops to plan, act, adapt, and manage or prioritize subtasks.
Repository for the violent-python dataset of security-oriented Python code and natural-language descriptions.
Repository for CodeBERT, the pre-trained programming-language model used as the fine-tuned open-model baseline.
Repository containing an implementation related to reproducing 'Clustering by fast search and find of density peaks'.
User interface and implementation for customizing the visual framework to empirical studies using AI accuracy, human adherence, and final decision-making accuracy, and for computing reliance components and Q.
Official open-source repository for Denario, a modular multi-agent system for scientific research assistance that supports idea generation, literature checking, planning, code execution, analysis, paper drafting, and review.
A GitHub Action that reviews pull requests by sending changed file contents to ChatGPT/OpenAI and posting review comments back to the PR.
Repository containing the paper's algorithm code and a link to the associated QuantConnect backtest artifact.
Repository released by the authors for the Writing Quality benchmark, WQRM models, data, and associated evaluation or editing code.
GitHub repository linked by the paper for example Jupyter notebooks and materials related to AIDev and AI teammates in SE 3.0.
Repository for the AIRepr / LLM data-science reproducibility experiments and code released by the authors.
Repository stated by the paper as the public code and data release for AirQA.
Repository for the AISysRev web application, an LLM-based tool for title-abstract screening that imports CSV metadata, applies inclusion/exclusion criteria using multiple LLMs, supports manual screening with LLM guidance, and exports results to CSV.
Repository containing ALFRED dataset tooling, data-generation and replay code, Seq2Seq baseline training/evaluation code, documentation, and benchmark submission utilities.
Official ALFWorld repository containing the aligned environments, downloadable game/PDDL assets, pretrained components, agents, and training/evaluation code.
A curated repository accompanying the paper that organizes embodied-AI papers and resources covered by the survey.
Contains the source code, dataset-construction scripts, dependency documentation, and result-generation pipelines associated with the paper.
Repository containing code and configurations for training and evaluating AlphaDPO.
Official Alympics repository containing the framework code, Water Allocation Challenge experiment code, requirements, prompts/resources, and related implementation materials.
Repository containing the AMVICC prompt CSV, model-evaluation scripts, image-generation scripts, result examples, and utilities used to reproduce or extend the benchmark experiments.
Repository containing a practical implementation of the online AdaVol recursive volatility-prediction method.
Public repository containing experimental code supporting the TDQN trading results reported in the paper.
Official repository for the paper's uncertainty analysis, ConfiLM resources, and Olympic 2024 data release.
Semantic Kernel is described as a modular, plugin-based framework for integrating LLM and agent capabilities into enterprise and software systems.
Swarm is described as a lightweight multi-agent interface framework for experimenting with multi-agent coordination.
BabyAGI is described as an experimental framework for autonomous task planning and iterative execution through a self-improving task loop.
Author-provided Deformable DETR code repository used for the reconstruction-based SSL evaluation.
Author-provided DETR code repository used for the proposed SSL task experiments.
Official SWE-bench experiment repository used by the authors as the source of execution logs, generated patches, and pass/fail statuses for the studied tools.
Code repository for ACEFormer, the attention-based stock forecasting system introduced by the paper.
Repository for the Online-Mind2Web benchmark and associated evaluation artifacts introduced by the paper.
Google Research repository containing Vision Transformer code, fine-tuning support, and released pretrained models associated with the paper.
GPT Engineer is described as an AI coding agent that can generate an entire codebase from a prompt and ask clarifying questions.
MetaGPT is described as a multi-agent framework assigning different GPT roles to form a collaborative software entity for complex tasks.
AgentGPT is described as a framework for rapidly configuring and deploying autonomous AI agents.
Multi-GPT is described as an experimental multi-agent system in which expertGPTs collaborate, communicate, and use short- and long-term memory.
Auto-GPT is described as an early example of GPT-4 running fully autonomously by chaining LLM thoughts to achieve user-set goals.
SuperAGI is described as a developer-centric open-source framework for building, managing, and running autonomous AI agents.
BabyAGI is described as a task-driven autonomous AI agent that builds and prioritises tasks toward an overall goal.
A curated repository of reentrancy attacks from which the paper draws 13 sufficiently isolated real-world exploit contracts for evaluation.
Official implementation of the paper's lightweight contamination detector, including search scripts, contamination reports for six benchmarks, model predictions, clean-dirty comparison code, and visualizations.
Repository containing code to generate school-level mathematical question-answer pairs and access the released Mathematics Dataset used for the paper's benchmark experiments.
The report states that EnglandCovid is a PyTorch Geometric Temporal dataset and cites this GitHub repository as reference [9].
Repository referenced by the paper for more details on the EnglandCovid dataset conversion and temporal neural network analysis.
A repository of DAN-style jailbreak prompts represented in the paper's attack-source comparisons.
A system-prompt leak collection used to inform the paper's adversarial prompt pool.
A public collection of GPT super-prompts used as part of the paper's heterogeneous attack-source pool.
An implementation reference for the self-examination or self-defence mechanism evaluated by the paper.
A prompt-injection defence framework used as the reference point for vector-based detection and filtering.
A curated jailbreak-prompt repository used to broaden the study's community-sourced attack collection.
A defence repository referenced for the voting and structured validation approaches discussed and evaluated.
A prompt-hacking resource used as one of the repositories from which attack examples were collected.
A prompt-hacking collection used as an external source of attack patterns.
Repository released with the paper containing the additional human reference translations and related analysis resources.
The fairseq-py toolkit supplies the pretrained convolutional sequence-to-sequence models used as the main objects of analysis.
A curated repository for the paper's agentic-memory survey, organised around the taxonomy introduced in the manuscript and intended to be updated as the field evolves.
Official repository for the paper, containing a CLAIR preference-generation notebook, cached results, documentation, and links to associated data.
Repository for the AndroidWorld environment, task suite, evaluation logic, and associated experiments introduced by the paper.
Official API-Bank code and data directory containing implemented APIs, datasets, database initialization resources, evaluators, simulators, examples, and demo code.
GitHub repository for the DLS-DDPG implementation used or released with the paper.
Repository for AppWorld Engine and AppWorld Benchmark, including the simulated app environment, benchmark tasks, and evaluation infrastructure.
Repository for APTBench, the benchmark for evaluating agentic potential of base LLMs during pre-training.
Repository identified by the paper as the code for the Arabic tool-calling benchmark work.
AutoResearchClaw is cited as an example of the scenario-verticalized or research-oriented pattern and as the only pipeline/stage subagent case.
deer-flow is cited as an example of the scenario-verticalized or research-oriented pattern.
cline is included as a corpus project and cited as an example of tool-based delegation.
docker-agent is used as a representative orchestration-oriented project combining orchestrator-worker structure, hybrid context, MCP-first tooling, and advanced execution controls.
fast-agent is used as an illustrative project showing tool delegation, hybrid context handling, and MCP-first tool registration.
Gemini CLI is included as one of the official or first-party products from major AI companies in the corpus.
deepagents is cited as an example of the scenario-verticalized or research-oriented pattern.
Mistral Vibe is included as one of the official or first-party products from major AI companies in the corpus.
Kimi CLI is included as one of the official or first-party products from major AI companies in the corpus and is named as a balanced CLI representative.
nullclaw is cited as an example of the Enterprise Full-Featured pattern.
codex is included as an official product/public-evidence case in the corpus and appears in the complete project list.
OpenClaw is analyzed as a corpus project and cited as an example of multi-level recursive or balanced CLI-style infrastructure depending on context.
OpenHands is included in the 70-project corpus and used as an example of event-driven, hybrid-context, enterprise-tool, advanced-safety infrastructure.
agentpool is used to illustrate event-driven subagent architecture with hierarchical context, registry tooling, and enterprise safety classification.
Qwen Code is included as one of the official or first-party products from major AI companies in the corpus.
openfang is cited as an example of the Enterprise Full-Featured pattern.
Repository containing three customer-service chatbot variants generated from different single prompts, with methodology, prompts, and source code for the paper's vibe-architecting demonstration.
GitHub repository for the ARDNS-FN-Quantum code, including the core script and interactive analysis or visualization notebook described by the paper.
Repository containing NeuLR and the paper's appendix or supporting resources for benchmark construction and evaluation.
LongBench is used as the main benchmark source for most datasets and for baseline evaluation settings.
GitHub repository for the Cross-Attention-only Time Series transformer introduced in the paper.
Repository containing the code implementation for evaluating language models using the paper's framework and generating visualizations; described as configurable for other HuggingFace models, metrics, task types, domains, and reasoning types.
Official repository for MMStar containing the evaluation code and dataset associated with the paper.
Repository containing code for ArgEval, the paper's argumentation-based LLM decision-support framework.
The core open-source implementation repository for the Ark robotics framework introduced by the paper.
Salesforce repository containing the Art_or_Artifice project folder and associated creativity-evaluation resources.
Code repository linked by the paper for the ART framework and its language-program implementation.
Companion repository assembled by the authors to collect the papers surveyed in the review and link associated code when available.
Repository containing Python implementation files and supplementary materials for detecting hallucinations with specialized model divergence.
Repository reported by the authors as containing the code and data for Ask an Expert / BBMHReasoning experiments.
Repository containing code and scripts for the ASPIRE paper, including captioning, GPT-4 prompt use, spurious object detection, diffusion fine-tuning, image generation, and classifier training workflows.
Repository released to support reproduction and continued evaluation of prompt-injection attacks and defenses studied in the paper.
Repository implementing Wanda/SNIP-based pruning, safety-utility set difference, ActSVD low-rank removal, orthogonal-projection rank disentanglement, zero-shot utility evaluation, and attack evaluation for Llama2-chat models.
Repository containing the ARMT implementation and scripts for training and evaluating the architecture studied in the paper.
Official repository for ATACompressor, containing pretraining, finetuning, inference, preprocessing, configuration, and LoRA implementation code.
Tensor2Tensor repository containing the code used by the authors to train and evaluate the Transformer models.
Repository linked by the authors as the code for the attention-retention continual-learning framework.
Repository released by the authors containing system responses and their human and automatic attribution ratings for the Attributed QA study.
Official Audio-Omni repository containing the model implementation, inference code, API, prompts, interface, configuration, and setup instructions.
Repository linked from the arXiv v1 project page and identified in its README as the official repository for the AudioDER paper, with dataset access and construction resources.
Author-referenced sample dataset of synthetic identification-document images covering five document types.
Author-referenced repository for generating synthetic document images used in the document identification and information extraction experiment.
Repository containing the implementation of Document Augmentation for dense Retrieval (DAR).
Repository identified by the paper as the official source-code location for the Auto-ADMET method.
Repository containing the Auto-FP benchmark resources, including code, datasets, meta-features, and comprehensive experimental results associated with the paper.
Official AutoAct repository containing code and prompts for self-instruct data generation, automatic tool selection, trajectory synthesis and filtering, LoRA-based self-differentiation, and group-planning evaluation.
Source-code repository for the AutoFlow framework introduced by the paper.
Repository for the Autoformer model and experiments introduced in the paper.
The paper's AutoGen framework repository for building LLM applications via multi-agent conversations.
Repository for Bias Identification Test in Sentiments, including data files and templates for probing sentiment and toxicity models for bias; the paper specifically uses the disability facet.
Repository for the ADAS codebase introduced by the paper, including the Meta Agent Search implementation and experimental framework.
Repository for ECLAIR, described as enterprise-scale AI for workflows, including code and scripts for the paper experiments and hospital workflow demo materials.
Repository containing folders for datasets, models, plots, pretrained models, additional tests, requirements, and a README with benchmark results for AutoML-DC.
Open-source implementation of the paper's three-task validation case study, including Python orchestration, generated Prolog programs, Prolog templates, sample-data creation, and logic execution.
Official repository for the AG3D museum model, exploration data, and PointNav++ benchmark artifacts.
Official implementation and pretrained models for the impact-driven exploration method developed in Chapter 3.
Official LoCoNav implementation and models for deploying a Habitat-trained navigation system on a real LoCoBot.
Official artifact for the Spot the Difference task, manipulated-map dataset, training code, and pretrained models.
Supplementary repository containing datasets, generated manuscripts, run records, coding runs, and supplemental appendix materials used to support the paper's evaluation.
Code implementation of the data-to-paper framework for backward-traceable AI-driven scientific research.
Hosts the working paper, data.json, figures, tables, and an interactive visualization of Top-N portfolio performance and alpha concentration.
Idea2Paper repository for connecting research ideation to paper-oriented production.
Aider repository for agent-assisted code editing and executable software workflows.
OpenScholar repository for literature-grounded scientific question answering and knowledge synthesis.
Tongyi DeepResearch repository for agentic deep-research workflows.
OpenHands repository for general software-agent execution over files, tools, and runtimes.
GPT Researcher repository for automated deep-research report generation.
ScienceClaw repository for scientific-agent workflow orchestration.
DeerFlow repository for deep-research workflow orchestration.
PaperQA2 repository for paper-grounded question answering and scientific synthesis.
AI-Researcher repository for an integrated literature, experimentation, and reporting workflow.
autoresearch repository for a steerable software-native AI research loop.
Open Deep Research repository for recursive literature research and report construction.
Agent Laboratory repository for a human-piloted multi-agent computational research workflow.
STORM repository for retrieval-grounded, multi-perspective long-form synthesis.
SWE-agent repository for repository-level software-agent execution.
ARIS repository for long-running AI research orchestration and execution.
ResearchClaw repository for reusable research-agent workflow infrastructure.
Official repository for AvaTaR with implementation, configurations, data preparation, retrieval-task scripts, and baseline/evaluation code.
Official source repository for the AVISE framework and the Red Queen SET introduced and evaluated in the paper.
Repository for the summarize-from-feedback / TL;DR data used as one of the paper's two primary preference-learning evaluation settings.
Repository for the BacktestBench benchmark and AutoBacktest implementation, including project folders for AutoBacktest, datasets, figures, tables, environment setup, database setup, and reproduction scripts.
Repository for the BadAgent attack on LLM agents.
Repository for the BagStacking implementation provided by the authors within a Scikit-learn API framework.
AgentGPT is analysed as a general-purpose autonomous LLM-powered multi-agent system with user-guided alignment in selected aspects such as decomposition, agent generation, and resource utilization.
Auto-GPT is analysed as a general-purpose autonomous LLM-powered multi-agent system with autonomous goal decomposition, task action management, and resource utilization.
SuperAGI is analysed as a general-purpose autonomous LLM-powered multi-agent system with some user-guided alignment options for agent-related and resource-related aspects.
BabyAGI is analysed as a general-purpose autonomous LLM-powered multi-agent system with a profile similar to Auto-GPT across many assessed aspects.
The fairseq BART directory provides the implementation interface, released BART checkpoints, and task-specific usage and fine-tuning instructions associated with the paper.
Official repository for the BeaverTails dataset family, dataset cards, QA-moderation training/evaluation code, and links to released model/data artifacts.
Repository for General AgentBench, the unified benchmark and evaluation framework for general LLM agents.
Official repository for the WorfBench benchmark, WorfEval evaluation implementation, data, and experiment code.
Repository containing code for evaluating MT-BaxBench and MT-SECCODEPLT, the two splits of the MT-Sec evaluation kit.
OpenAI Codex CLI, cited as a lightweight coding agent running in a terminal and evaluated as one of the agent scaffolds.
Chapyter is one of the data science agent frameworks benchmarked by DSEval.
Jupyter-AI is one of the agent frameworks benchmarked by DSEval.
Official repository for DSEval, including the evaluation toolkit, benchmark data, results, and scripts.
Open-source Code Interpreter API implementation directly evaluated as a data science agent framework.
rllab, the framework released with the paper containing the continuous-control tasks and reference implementations of the evaluated reinforcement-learning algorithms.
Official repository for the paper's ECG foundation-model benchmark, including evaluation code, preprocessing/configuration assets, and the ECG-CPC framework with checkpoint links.
GitHub repository for the FaithJudge leaderboard and associated faithfulness evaluation resources.
Repository containing the modular benchmarking framework, configurations, scripts, results, and visualization code for comparing retrieval strategies in biomedical RAG.
Repository for MedRag, the toolkit implementing the corpora, retrievers, and LLM configurations used in the study.
Repository for Mirage, the medical RAG evaluation benchmark introduced in the study.
Repository containing corruption scripts, model-evaluation code, sample execution materials, and links to reduced, corrupted, and verified DUDE and MPDocVQA benchmark data.
Repository containing the agent scaffold, behaviour-analysis pipeline, SFT recipes, scripts, utilities, and evaluation suite associated with Behavior Priming for agentic search.
Repository containing the authors' BERT-of-Theseus implementation, GLUE scripts, compression examples, and links/instructions for the released MNLI-compressed model.
Repository released by the authors with TensorFlow code for BERT, pretrained BERT_BASE and BERT_LARGE checkpoints, and scripts for replicating major fine-tuning experiments.
Repository for reproducing and extending the paper's generator-versus-classifier experiments; it includes the main experiment script, a shell runner, and data files containing synthetic and human-labelled examples.
Official implementation and pretrained sample model for the paper's learned reference-free summary reward, including metric comparison and reward-training scripts.
Official LEAP implementation containing the Python package, prompts, configuration files, data-processing scripts, SFT and DPO training scripts, and evaluation workflows for ALFWorld and WebShop, with InterCode-related code also included in the repository structure.
Repository by genai-analytics containing a beyond-black-box-benchmarking folder with benchmark, core, examples, and sdk subfolders.
ParlAI crowdsourcing code associated with the paper's multi-session model-chat human evaluation.
ParlAI implementation for loading and evaluating the Multi-Session Chat and PersonaSummary tasks introduced by the paper.
Code repository identified by the paper for implementing the CRS reliability-evaluation framework.
Official ICML 2023 implementation of DAC, including feature extraction, KNN-score computation, calibration code, experiment scripts, checkpoints, and a CIFAR-10/ResNet18 reproduction workflow.
Official codebase containing 1dCA data generation, evaluated model implementations, ACT variants, training scripts, evaluation pipelines, and experiment configurations.
The LM Evaluation Harness supplies the raw, token-normalized, and character-normalized full-sequence scoring methods evaluated by the paper.
OpenCompass is one of the two evaluation frameworks whose multiple-choice scoring implementation is analyzed and empirically compared.
Code repository for Multi-Objective Direct Preference Optimization and its experimental workflow.
Repository backing the Agentic Factor Investing project homepage, containing a README, project-framework image, interactive site, and chart data; it is a showcase rather than a complete research-code release.
GoodAI baseline LTM system using a vector database and JSON scratchpad to augment an LLM controller.
Versioned branch of the GoodAI LTM Benchmark repository containing code, test definitions, experiments, result data, and reports corresponding to the paper.
Public repository containing RAG, GRAG, AGRAG, and HRAG prompts; text-to-Cypher and Cypher-to-QA prompts; few-shot query examples; guided-question generation material; the LLM-as-a-Judge rubric; the annual CTI report used for guided questions; and experiment logs.
Code for f-DPO with reverse KL, forward KL, Jensen-Shannon, and alpha-divergence regularization, including scripts for IMDB, Anthropic HH, MT-Bench, PPO comparisons, and calibration experiments.
Repository containing the code associated with the Strategic Tactical Agent Reasoning benchmark and its execution framework.
Repository containing the paper's experiments and results for the Agent Assessment Framework.
Repository containing BIG-bench task definitions, JSON and programmatic evaluation infrastructure, documentation, model score files, BIG-bench Lite resources, and contribution workflows.
Repository for the paper's supplemental materials, including the coding schema, all repository metadata, raw graph data, and the LLM coding prompt.
TokenScope is used to extract probabilities for the first decision token where the judge commits to A or B.
Repository for the semantic-uncertainty method used as a hallucination-detection baseline.
One of the two chest-X-ray datasets combined to construct the paper's four-class federated-learning evaluation corpus.
Official BookSum repository containing data-preparation, collection, cleaning, chapterization-support, and paragraph-alignment scripts associated with the paper.
Repository containing the MuseD evaluation code and associated research artifact.
PyTorch implementation of BoostMIS with active-learning components, configuration files, training code, and released MESCC ResNet-50 feature and label artifacts.
Official PyTorch implementation of BOSS for simulated ALFRED experiments associated with the paper.
Repository for the paper containing the agent and AI2THOR environment code, experiment entry points, generated production rules and weights, prompts, world-knowledge database, bootstrapping/test logs, experiment spreadsheet, and token-usage figure.
Project repository for the paper's automated peer-review vulnerability evaluation and adversarial robustness study.
Official repository providing BridgeData V2 data-processing utilities, JAX implementations for several paper methods, training scripts, evaluation scripts, and links to checkpoints and robot setup resources.
Repository containing preprocessing, KG demos, lab-informed pretraining, diagnosis and heart-failure training scripts, metrics, and notebooks for the DuaLK framework.
Implementation used to generate the saliency-map explanations that formed the H2 baseline condition.
The gym-sokoban implementation that the authors modified into Sokoban-switch and Sokoban-cells variants for precondition and cost-explanation experiments.
An aggregated dataset of chess opening names and move sequences used by the paper to create opening-position concept datasets.
Companion agent layer containing Brain Researcher skills, agent templates, MCP adapters, and AutoResearch evaluation rubrics.
Public Brain Researcher implementation including the Python package, CLI, agent runtime, MCP server with versioned tool contracts, orchestrator, web UI, and deployment recipes.
Analysis code, specification ledger, per-hypothesis outputs, run report, and figures for the NeuroMark schizophrenia collaborator case evaluated in the paper.
Source-code repository for the BCDA study and its algorithmic experiments.
Code for fitting and extrapolating BNSLs, reproducing the 4-digit-addition experiments and noiseless simulation in Figure 5, and decomposing BNSL into the power-law segments shown in Figure 1.
Repository for downloading/decrypting benchmark data, building or downloading indexes, running supported search agents, evaluating end-to-end and retrieval-only results, reproducing experiments, and integrating custom retrievers.
Source code for the CoELA framework and the paper's TDW-MAT and C-WAH experimental implementations, including LLM-agent code and experiment scripts.
OpenDev, the open-source command-line AI coding agent whose architecture, harness, context engineering, tool system, and lessons learned are described in the paper.
Open-source Python package calibrated-explanations, including code repository, examples, notebooks, and evaluation/regression scripts for reproducing experiments.
Repository containing CPR, reset-method baselines, continual-learning environments, experiment configurations, plotting scripts, dependency specifications, and reproduction instructions.
Repository containing experiment data, model configurations, prediction scripts, calibration implementations for agreement/entropy/FSD and baselines, evaluation scripts, scores, and visualization utilities.
Repository containing installation instructions, data preparation, experiment scripts, evaluation code, and analysis for the paper's calibration framework.
Source code accompanying the paper, with scripts for decoding, extracting internal-consistency information, and evaluating self-consistency variants.
The open-source CAMEL library introduced by the paper, including agent implementations, prompts, data-generation pipelines, analysis tools, examples, and links to generated datasets.
Repository designated by the paper for code, training conditions, and experimental run records.
JSON benchmark file for the paper's freelance-style task suite.
Repository for the Econometrics-Agent/MetricsAI system that automates econometric analysis through an AI-agent workflow and domain-specific econometric tools.
Official repository directory containing the paper's code, data, and experimental setup for writing alignment through edits.
Repository accompanying the paper, containing the ageval evaluator package, agent tools, baseline evaluators, datasets/labels, experiment configurations, notebooks, and a Gradio app for inspecting annotator outputs.
Official repository containing 50 author-specific writing prompts and anonymized JSON evaluation data organized by quality versus style, prompting versus fine-tuning, and expert versus lay judges.
Repository linked by the paper as the available code for evaluating GPT models on mock CFA exams.
Official implementation of TextGym, evaluated language-agent configurations, EXE, and the benchmark experiments.
Repository for the paper containing the agent_trust experiment code, game prompts, non-repeated and repeated experiment results, environment files, and runnable demos.
Repository containing resources and code for implementing and experimenting with LLMs for vehicle routing problems, including context materials, LLM framework code, oracle algorithms, and verifier code.
Repository for RWE-bench, the benchmark and evaluation environment introduced by the paper for testing LLM agents on real-world evidence generation from medical databases.
Repository containing the FINSABER framework, backtesting code, strategy interfaces, experiment scripts, documentation, and dataset links for reproducing or extending the paper's benchmark.
Official repository containing code, prompts, modules, tests, and post-processing pipeline for generating and evaluating self-generated counterfactual explanations across the paper's datasets and models.
Repository released by the authors for the confidence-elicitation framework and experiments introduced and evaluated in the paper.
Repository containing EnterpriseBench's application data, task-generation components, enterprise tools, evaluation code, and interactive demonstrations.
Public repository containing the code, method files, data directory, processing notebook, and framework assets used for the paper's MADR experiments.
Repository for IllusionReasoning, the paper's real-world visual-illusion benchmark for evaluating LVLM perceptual and reasoning capabilities.
The isbiased library implements the prediction-shortcut reliance diagnostics used to compute relative accuracy drops in the paper.
Repository released by the authors for the study's dataset, source code, and detailed evaluation results.
Repository released by the authors for the CAP construction pipeline and verifiable agent-as-a-judge evaluation framework.
LangChain repository audited for the default path from model-produced actions to tool execution.
LangGraph repository audited for mandatory value authorization before ToolNode invocation.
Reference implementation of the paper's deterministic fail-closed authorization gate, including framework integrations and proof scripts.
LlamaIndex repository audited for central dispatch, schema validation, and per-call authorization behavior.
Stripe Agent Toolkit repository audited for client-side authorization of model-supplied payment arguments.
Repository for CAR-bench, including benchmark implementation, tools, task and evaluation workflow, results analysis, and documentation for evaluating multi-turn tool-using LLM agents under uncertainty.
Official CARE-LoRA implementation built on a repository-local PEFT fork, with reproduction workflows for T5-Base and Mistral-7B-v0.3 experiments, gradient-similarity diagnostics, and comparison baselines.
Companion implementation for the SD3-Medium DreamBooth personalization experiments reported for CARE-LoRA.
Open-source LLM adversarial robustness toolkit used by the paper to generate adversarial suffixes for the generator-stage jailbreak experiment.
Repository for the paper's cascaded LLM experiments, including implementation details for the framework evaluated in the paper.
Repository accompanying the paper, containing the P-99 materials, CLAUDE.md instructions, generated problem directories, tests, proof files and the maintained lptp-reference.md.
BitTern is presented as an open toolkit for low-cost, high-accuracy post-training ternary quantization and 1.58-bit models.
Repository containing the implementation for causal inference via style transfer for OOD generalisation.
Official RSS 2023 implementation of Causal MoMa, including Minigrid and iGibson components, causal-inference and data-collection scripts, and policy-training and testing entry points.
Repository containing the open-source LLMCert-B implementation, model-query utilities, experiment code, and materials used for the BOLD bias-detector human evaluation.
Official repository for the ChAda-ViT architecture, training/evaluation code, and model artifacts.
Microsoft repository containing the Python implementation and supporting materials for the plug-and-play CoNLI hallucination detection and reduction framework.
Official code repository for Chain-of-Models Pre-Training introduced in the paper.
Repository for the SVAMP math word-problem benchmark.
Repository for the ASDiv diverse math word-problem dataset.
Repository for the AQuA algebraic word-problem dataset.
Repository for BIG-bench, including the Date Understanding and Sports Understanding tasks.
BIG-bench task repository for the StrategyQA question-only evaluation setting.
Repository associated with the CommonsenseQA benchmark.
Repository for the GSM8K grade-school math word-problem benchmark.
MIT-licensed Chameleon source repository containing the system implementation, optimization modules, models, benchmark artifacts, and deterministic tests.
Repository for the ChannelViT architecture, HCS training/evaluation code, configurations, and pretrained models used to reproduce the paper's experiments.
Repository for the Chat2Workflow benchmark and associated workflow-generation/evaluation resources.
Public GitHub location for ChatCollab code and data used or produced by the paper.
MetaGPT repository, representing a prior meta-programming multi-agent framework compared with ChatCollab.
ChatDev repository, representing a prior communicative-agent software-development system compared with ChatCollab.
Repository for the ChatDev framework and the code/data artifact associated with the paper.
Repository explicitly linked by the paper for ChatEDA-Bench, examples of EDA-tool instruction data, API documentation, and the corresponding OpenROAD implementation.
Official implementation and configuration repository for the ChatEval multi-agent referee framework and its evaluation experiments.
Repository containing general and targeted synthetic datasets, generation examples, BERT and GPT-2 adapter notebooks, and evaluators for StereoSet, CrowS-Pairs, and BiasTestGPT.
GitHub repository identified by the paper as the location where the dataset can be accessed.
The paper states that the MMF-Trans code has been open sourced at this GitHub URL, with data requiring authorized access. The repository page itself returned 404 during extraction, so its contents could not be inspected.
Repository released by the authors for Chronos code and model checkpoints.
ClawNet repository containing the governed multi-agent social network implementation, including core/gateway, server, desktop, macOS client, and setup components.
Repository for CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models, including code, configs, data, docs, and README material describing the framework and evaluation setup.
Official code repository for training and testing CMI-MTL on SLAKE, VQA-RAD, and OVQA, including preprocessing scripts and pretrained-model instructions.
Paper-linked repository for the introduced framework.
Official CochlScene repository containing baseline training/evaluation code, dataset metadata, a saved model, and data-preparation scripts.
A GitHub repository listed by the paper as an accompanying curated resource for papers on code as agent harness.
Official Code as Policies directory in the Google Research repository, containing notebooks for LMP examples, HumanEval, RoboCodeGen, code-versus-language reasoning, reactive controllers, and an interactive demo.
Repository containing released benchmark data derived from SWE-CARE, pipeline scripts for filtering, environment building, test generation, agent resolution, and tool evaluation, plus compressed raw experimental outputs.
Repository for the CodeAssistBench benchmark, datasets, prompts, scripts, and evaluation framework for AI coding assistants on real GitHub issues.
Open-source repository associated with the CodeScout model family and RL recipe for code localization agents.
GitHub repository for CodeTaste, including benchmark infrastructure, agent/evaluation scripts, documentation, and links to benchmark artifacts and precomputed outputs.
Repository for Codev-Bench, the developer-centric repository-level code-completion benchmark constructed with Codev-Agent.
Official implementation of CORY, including IMDB training scripts, GSM8K utilities, TRL-based trainers, environment code, and experiment support files.
The latest arXiv v3 links this dedicated repository for the newer CogAgent-9B-20241220 release; it is a direct successor artifact to the paper's CogAgent system.
The paper explicitly states that the CogAgent model and code are available in the CogVLM repository, which contains CogAgent-18B resources alongside CogVLM.
Official implementation of the CogVis framework, including inference, staged adapter training, prompt profiles, and benchmark configuration.
Repository titled KotiJaddu/Masters-Project, described on GitHub as code supporting the author's Master's thesis, with Python source and model folders.
Official implementation repository containing the ComfyBench benchmark resources, ComfyAgent code, workflow data, agent modules, inference scripts, and evaluation scripts.
Repository for the LLMWorkflowGenerator project, containing the Python Controller implementation, Android/Termux-oriented workflow automation code, sample files, experiment outputs, and setup instructions.
Repository for H2O, the Heavy-Hitter KV-cache eviction method selected as the representative static-sparsification approach.
Official artifact repository for InfiniGen, the recoverable hierarchical KV-cache selection framework evaluated in the paper.
Official repository for vLLM, the GPU-resident memory-management framework used as the full-cache baseline in the study.
Repository provided by the authors for reproducing the LLM, human-comparison, and algorithmic bandit experiments.
Official code repository implementing the CompeteAI simulation framework, restaurant environment, agent backends, prompt templates, scenes, database integration, and experiment runner.
Official code repository for the paper, including model runners, interaction-specific evaluation tasks, attention extraction, and attention manipulation scripts for the OmniReason dataset.
Repository for the Bitcoin Fee Rate Prediction Project, including data, model notebooks, scripts, result outputs, plots, and citation information for arXiv:2502.01029.
PyTorch implementation for Compressed Context Memory, including the compression-memory method introduced and evaluated in the paper.
Repository released by the authors for the compression datasets and the data-collection, processing, and evaluation pipeline used to study the relationship between LLM compression efficiency and downstream capability.
ScalePlan packages the operator-level analytical cost model, calibration data, memory/MFU prediction, and parallelism search used by MOSAIC.
Repository reported by the paper as the code for confidence estimation in LLM-based dialogue state tracking.
Official repository and Python package for CONFLARE, supporting document loading, cleaning, chunking, calibration-set creation or loading, and conformal retrieval-augmented generation.
Repository linked by the authors as the public code for experiments in Conformal Prediction as Bayesian Quadrature.
Repository linked by the paper for CCA/SWE-Bench-related materials.
Open-source PyTorch repository from which the authors selected reproducible GitHub issues requiring specialist debugging.
Repository explicitly provided by the authors to reproduce the experiments in the paper.
Companion repository for the paper containing evaluation materials, few-shot and constitutional prompts, and model samples used to document the Constitutional AI experiments.
Repository containing the CLL training implementation, weak-signal generation notebook, model utilities, and scripts for synthetic and real-data experiments.
Python repository for generating PortBench portfolio-theory tasks and evaluating LLM portfolio decisions.
Repository accompanying the paper with selected Python code for feature construction, metrics, and the model. The README states that the full proprietary backtesting and continuous-futures processing framework and licensed data are not included.
Repository released by the authors for constructing hierarchical NAS spaces based on CFGs and reproducing the BOHNAS experiments.
GitHub repository identified by the authors as containing the standard performance forecaster model for the Allora network.
Repository directory containing the implementation and resources for the CoT-MAE contextual masked auto-encoder introduced and evaluated in the paper.
Repository containing the paper's data and codebase, including data collection materials for the user feedback and annotation tasks.
Repository containing the automated AI research environments and idea execution trajectories introduced in Chapter 4.
Open-source code, model, and data for the s1 sample-efficient reasoning and budget-forcing work used in Chapters 3 and 4.
Code artifact for the Synthetic Continued Pretraining and EntiGraph experiments in Chapter 2.
Python repository containing slow-tail, V-shape, and combined max-cash modules, execution scripts, data-schema documentation, and reproducible output paths for the empirical cash-overlay study.
Repository containing code, data artifacts, and reproducible empirical materials for the continuous smooth-signal growth-versus-defensive allocation framework.
Official implementation of the paper's TinyBabyLM construction, model training, GOOD/BAD contrastive generation, mixed-corpus retraining, benchmark evaluation, bootstrap analysis, and figure/table reproduction.
Author-linked ConVIRT repository containing the CheXpert 8x200 image-image and text-image retrieval evaluation files; the paper identifies this repository as the public location for its model and collected retrieval datasets.
Repository identified by the paper as the posted model code for reproducing the ConFIRM workflow.
The open-source repository for the openCHA framework introduced and demonstrated in the paper.
Generation script used in constructing the synthetic natural-language-to-Cypher evaluation data for the NeDRex KG silver-standard benchmark.
Backend implementation of ChatDRex, including API services, documentation, local setup instructions, and tool-evaluation resources.
Frontend implementation for the ChatDRex conversational user interface and interactive biomedical workflow experience.
GitHub repository associated with the paper's cooperative knowledge distillation method.
Official CooperBench repository containing the benchmark package, dataset tooling, task-running CLI, evaluation logic, and cooperative/solo/team settings for coding-agent experiments.
Repository containing the implementation and configuration details for LSNPC experiments.
Repository containing datasets, inference-refining code, CoT-UQ uncertainty integration code, configuration, pipeline scripts, and result-analysis utilities.
Repository released by the authors for the COTCAgent system, including agent modules, temporal-analysis code, knowledge-base files, patient-data examples, tests, and interface components.
Repository containing the generated synthetic datasets, evaluation outputs, and additional t-SNE visualizations for the paper.
Repository for the paper containing CLP/CLSP implementation code, MGSM experiment data, request/merge utilities, and metric scripts.
Repository containing the implementation of CryptoMamba, baseline models, data preprocessing, model training, evaluation metrics, and trading simulation scripts.
Official CSKV repository with calibration, layer-wise fine-tuning, and inference code for compressed KV-cache models.
RAGQALeaderboard is used as a benchmark environment for evaluating RAG-QA performance across multi-hop, single-hop, and biomedical question-answering tasks.
Repository for the CXL-SpecKV memory manager, speculative prefetcher, FPGA cache engine, host library, driver, framework integration, documentation, and tests.
Source-code repository for DAG-MoE, including the learned structural aggregation module evaluated in the paper.
IBM Agentics is the agentic AI framework on which DAO-AI is built; the paper uses its ATypes, logical transduction, and scalable workflow concepts.
GitHub repository identified by the paper as containing DAO-GP source code and datasets.
Repository for ImageNet-Captions, the dataset introduced to pair ImageNet images with original Flickr text and enable controlled language-image versus classification experiments.
Repository implementing the Bloom-filter-based Data Portrait method described in the paper.
FastChat v0.2.5 question JSONL containing 80 diverse evaluation queries.
Repository implementing data-local, ensemble-based, LLM-guided NAS for multiclass multimodal time-series classification, including local executor scripts, remote LLM proposer scripts, schemas, and a Flask control interface.
Contains the code for coarse plan generation, fine-grained plan evolution, SFT-data construction, orchestrator and tool-model inference, distributed corpus curation, prompts, and links to released orchestrator and NP checkpoints.
Repository containing the official evaluator, baseline implementations, experimental configurations, and documentation for the DataSpace benchmark.
Repository cited by the paper for NVIDIA<ef><bf><bd>s Comprehensive Verilog Design Problems benchmark, which provides the selected code-generation and code-comprehension tasks used to evaluate SLMs and LLMs.
Repository for the DB2-TransF time-series forecasting model introduced and evaluated in the paper.
Official repository for the DCQA benchmark, dataset overview, and access instructions.
Microsoft's repository for the DeBERTa implementation, pretrained models, and fine-tuning resources associated with the paper.
Repository released by the authors for the experiments and data supporting the paper's analysis of probability, memorization, and noisy reasoning in CoT prompting.
Code repository for the limited teacher supervision decoding method introduced in the paper.
Repository containing implementations of the tested actor-critic agents and policy parameterizations, experiment configurations, the Backwashing-PID simulator, source plant data, KL utilities, and plotting/reproducibility support.
An Awesome-style repository organizing MMR papers, datasets, benchmarks, and related surveys around the paper's PerceptionAlignmentReasoning framework and AnswerProcessExecutable evaluation hierarchy.
AllenNLP contains the official PyTorch ELMo module and scalar-mix implementation for computing the paper's contextual representations.
Official TensorFlow implementation for training the pretrained bidirectional language model and computing ELMo representations introduced by the paper.
Repository containing the data-pipeline code, hedging simulator, actor-critic training workflow, saved configurations and models, notebooks, evaluation utilities, tests, figures, and paper materials for reinforcement-learning-based hedging of SPX and SPY exposures.
Public repository containing software code and datasets or scripts for reproducing the baseline algorithms and experiments.
Repository stated by the paper to contain the market simulation and experiment code.
Repository linked by the paper as containing the publicly available datasets and code used for the DRL-in-finance experiments.
Repository containing code associated with the paper's A2C, DDPG, PPO, ensemble-selection, and backtesting workflow.
Official DeepConf repository implementing offline and online confidence-aware reasoning, voting, trace filtering, warmup thresholding, and early stopping on top of LLM serving backends.
Repository containing source code, datasets, and supplementary materials associated with the multi-horizon NEM electricity price forecasting benchmark.
The repository contains DeepAries source code, market data folders, checkpoints, model components, experiment code, and instructions for training and inference.
Repository for the paper's VRGA method, including Qwen evaluation code, attention-intervention implementation, dataset interfaces, and a reproducible evaluation pipeline.
Repository path containing DeepPlanning benchmark code, travel and shopping domain runners, evaluation utilities, configuration files, and instructions for reproducing benchmark results.
Official repository for DeepSeekMath model checkpoints, evaluation materials, replication resources, and inference examples.
Official DeepSeek-MoE repository linked by the paper for the introduced architecture and released DeepSeekMoE 16B research artifact.
The paper's released DeepSpeed-Chat implementation, including end-to-end RLHF examples, training stages, APIs, inference support, tests, and documentation.
The DeepSpeed repository contains the framework, code, tutorials, and documentation for large-scale model training and inference, including DeepSpeed-MoE components.
Repository for DeepTraderX, a deep-learning trading agent running in Threaded-BSE.
Threaded Bristol Stock Exchange repository providing the asynchronous market simulator and working trading agents used for DTX training data and experiments.
Repository identified by the paper as containing code and data for the finance hallucination experiments.
Software suite described and used by the paper to calculate reward-representable policy orderings, non-trivial simplifications, and reward functions representing them for specified environments and policy sets.
Official DeFT research repository containing Triton implementations, tree templates, benchmark scripts, and reproduced performance results for the paper's attention methods.
Code, documentation, and demos for ToolUniverse, the ecosystem for building AI scientists from language models, reasoning models, and agents.
Official implementation repository released for the Demonstrate-Search-Predict framework.
Salesforce AI Research repository for FinDAP: Demystifying Domain-adaptive Post-training for Financial LLMs, including framework materials, training scripts, evaluation guidance, and links to model/data artifacts.
Repository associated with the AgentFail dataset and website for failure lifecycle data and analyses.
Repository containing DPR training, retrieval, evaluation, data-processing tools, configurations, and released model resources.
Code repository provided by the paper for DAAM implementations and the IEMOCAP, AG News, CIFAR-100, LoRA-comparison, and appendix experiments.
GitHub repository for the TSCC2019 competition data used as real Hangzhou traffic data in the paper's traffic-light-control benchmark.
Repository containing the released loss data and analysis scripts/notebooks for optimal hyperparameter estimation, learning-rate and batch-size scaling, Chinchilla/Skaling fitting, compute-optimal scaling, and uncertainty estimation.
Official code repository for the DEPS/MC-Planner implementation introduced and evaluated in the paper.
Repository containing the blank Design-OS template, design-case artifacts, prompt files, simulation code, plots, and verification report used to support reuse and replicability testing.
GitHub repository for the TalkTuner paper, including code and data for a dashboard that visualizes and controls a chatbot LLM's internal user model.
GitHub repository for the evolutionary multi-objective neural architecture search approach introduced in the paper.
Repository linked by the paper for reproducing or inspecting the OAS generation experiment.
Repository containing code, model files, feature data, and training scripts for the paper's physics-guided bearing prognostic and uncertainty-quantification experiments.
Repository describing DeXposure-FM as a time-series graph foundation model for forecasting inter-protocol credit exposure, with scripts for experiments, macroprudential tools, checkpoints, and dataset helpers.
The code URL reported in the paper's v2 HTML/PDF abstract for the DeXposure-FM project.
Official MuJoCo Allegro Hand environments used for the DIME simulation experiments.
Official scripts for collecting and processing demonstrations for the rotation, spinning, and flipping tasks.
Official package for inverse-kinematics-based teleoperation of an Allegro Hand attached to a Kinova Arm.
Official implementation repository containing the nearest-neighbor imitation component and links to the other DIME packages.
Official code repository for DiaLLM, including supervised fine-tuning, PPO, reward-modeling, evaluation scripts, data folders, and result folders.
Code repository for the DiffLOB regime-conditioned diffusion model.
Autonomous-driving decision-making simulator used for DiLu's closed-loop experiments and domain-shift evaluations.
Code repository for running and visualizing the DiLu closed-loop LLM driving framework.
Official CitySim vehicle-trajectory dataset repository used as the source of one transferred DiLu memory module.
Training code for supervised fine-tuning followed by DPO preference learning on causal Hugging Face language models, with dataset and trainer utilities.
Google Java Format repository; the paper uses Newlines.java from this repository for generated-vs-original unit-test comparison.
Junit5 Modular World sample module; the paper uses a Flavor.java code snippet from this repository for prompt-based test generation and comparison.
Contains code, data, configurations, and scripts for the FineLogic training and evaluation experiments.
Author repository for the GSM8K-AI-SubQ reasoning dataset and baselines for distilling LLM decomposition abilities into compact language models.
Official source code repository for the Distilling step-by-step method introduced in the paper.
Repository containing code for the supervised and unsupervised LLM uncertainty experiments reported in the paper.
GitHub repository released by the authors for Distributed Conformal Prediction via Message Passing.
Official code repository for the Division-of-Thoughts framework introduced and evaluated in the paper.
Official repository for DNABERT-2 code, model usage, pre-training/fine-tuning scripts, and GUE benchmark resources.
Official self-contained SayCan implementation in a simulated tabletop environment using a UR5 setup, ViLD affordances, GPT-3 planning, and a CLIPort pick-and-place policy.
Official SayCan dataset files mapping natural-language user instructions and initial conditions to possible solution plans.
Repository containing code and notebooks associated with the S&P 500 graph-neural-network forecasting project.
The paper-associated repository curates video-LLM systems, visual encoders, datasets, code links, figures, and citation information related to the review.
Repository linked by the paper for code and the SelfAware research artifact used to evaluate whether LLMs recognize unanswerable questions.
Repository containing code and data for evaluating uncertainty estimation in LLM instruction-following.
Repository for Stanford Alpaca, whose Alpaca-7B model is directly evaluated in the paper's altered task-definition experiments.
Public source-code repository for the multimodal repair-recognition system introduced and evaluated in the paper.
Contains VLN-HAMT and VLN-DUET integrations, training/inference scripts, requirements, and links to R2R-Imagine generations, metadata, extracted features, and trained HAMT-Imagine/DUET-Imagine checkpoints.
Repository reported by the paper as containing the prediction model implementation and experiment data.
Repository for the DocAgent multi-agent code documentation generation framework introduced by the paper.
Repository accompanying the paper, linking to hosted C4 data and providing a public discussion venue for documenting additional corpus issues.
Repository for the code, human-subject study materials, results, and supplementary materials associated with the Persona framework and AAAI 2025 paper.
Semantic routing package for routing inputs by embedding or intent similarity.
Framework using repeated generations, verification prompts, and confidence estimates to decide whether to escalate to larger models.
AWS multi-agent orchestration framework that includes prompt-based routing or agent selection patterns.
Implementation associated with routing prompts to pre-trained experts after fine-tuned meta-model categorisation.
Implementation associated with deciding whether a query requires a complex prompting strategy.
Iterative multi-agent code generation system using execution success as a routing signal.
LLM routing implementation associated with assessing model adequacy through multiple responses and ground-truth comparison.
Routing-agent implementation using synthetic data and small classifiers for classification-based routing.
Orchestrator implementation using decoder-only LLM representations for routing or model selection.
Framework for serving and evaluating routers that choose between LLMs using preference-oriented routing strategies.
Task-planning framework in which an LLM selects among models or tools based on descriptions and user tasks.
Implementation assessing consistency across reasoning representations for cascade-style routing.
OpenAI multi-agent orchestration framework discussed as an example of prompt-based routing practice.
Fine-tuned model framework for API call generation, discussed as treating routing as a code generation problem.
Framework for reducing LLM application cost using LLM cascades and related strategies.
Adaptive RAG framework that routes among no retrieval, single-step retrieval, and multi-step retrieval paths according to query complexity.
Code and data for a multi-LLM routing benchmark and evaluation framework.
GitHub repository containing the Indonesian financial-domain language-model code and post-trained IndoBERT models.
Implementations of original, sparse, continuous, and related statistical jump models.
Code and model artifacts for Reinforced Token Optimization, the paper's DPO-derived token-reward and PPO/RL alignment method.
Official RSS 2024 repository implementing DrEureka reward generation, reward-aware physics priors, domain-randomization generation, and the forward-locomotion and globe-walking environments.
Provides the Go1 soccer simulation environment, PPO training scripts, pretrained policy evaluation, configuration, and documentation accompanying the paper.
Official repository for the paper's LLM-based autonomous-driving demonstrations, including closed-loop HighwayEnv code, scenario assets, and common-sense reasoning materials.
Official repository containing the DS-1000 data, execution-based evaluators, environment files, inference scripts, and released baseline results.
Repository for evaluating LLMs on the DSBC dataset, including response generation, LLM-as-judge evaluation, command-line usage, and dataset evaluation utilities.
Repository for DSPy, the programming model and compiler introduced by the paper.
Code repository for the DSTCGCN traffic forecasting model introduced and evaluated in the paper.
Official D-DiT repository with environment setup, pretrained 512-base and supervised-fine-tuned checkpoints, inference examples, data formats, training configurations, and distributed training commands.
A scikit-learn-style implementation of a collection of statistical jump models, including the model family used to identify asset-specific market regimes.
Repository indicated by the paper as the code website for DVGNN.
Repository containing experimental analysis, tools, and code associated with dynamic design of machine-learning pipelines via metalearning.
The first author's repository providing implementations of statistical jump models, including methods relevant to the sparse jump-model analysis used in the paper.
Official GitHub repository containing code for the paper Dynamic Graph Convolutional Network with Attention Fusion for Traffic Flow Prediction.
Repository for the Dynamic Meta-Learning for Adaptive XGBoost-Neural Ensembles implementation, including source code and test datasets as described by the paper.
Repository containing data and code for the ICLR 2023 PromptPG paper, including the TabMWP dataset and implementations/evaluation scripts for GPT-3, UnifiedQA, TAPEX, and PromptPG experiments.
Python repository containing pseudo-answer generation, silver-label construction, input processing, multi-task training, inference, and evaluation scripts for the six reported datasets.
Repository containing the EasyRAG pipeline, ingestion code, retrievers, rerankers, prompt templates, challenge scripts, Docker deployment, FastAPI service, Streamlit WebUI, and processed challenge assets.
The EasyTool directory in Microsoft JARVIS contains implementation code, requirements, generated tool-instruction data for ToolBench and RestBench, FuncQA data, and commands for reproducing the reported evaluations.
Official Microsoft Research implementation of the Sui Generis scoring pipeline introduced in the paper.
Public GitHub repository for the study's replication materials, mirrored in Zenodo.
Official code repository for the EconAgent paper, including simulation scripts, configuration, data, and AI-Economist foundation components.
Repository containing the EDA augmentation implementation and code associated with the paper's experiments.
Code repository linked by the paper for the ChatSim system and its introduced simulation pipeline.
Code repository for CAID, including the multi-agent workflow where a central manager delegates tasks to engineer agents that run asynchronously in isolated git worktrees, plus scripts and task modules for Commit0 and PaperBench experiments.
NovGrid extends MiniGrid with a generalized novelty generator so environment properties and dynamics can change and agents can be evaluated on adaptation to those changes.
OWL is compared against Efficient Agents in the agent framework evaluation.
Smolagents is compared against Efficient Agents and OWL in the agent framework evaluation.
Repository linked by the paper as its code resource, associated with the OAgents/Efficient Agents work.
Public code repository for the DASH architecture-search algorithm introduced and evaluated in the paper.
Official repository for the NAACL 2021 paper, containing data and model resources needed to reproduce reported results.
fairseq example code and resources for training and evaluating the paper's MoE language models.
Source-code repository for Helium, the workflow-aware LLM serving system proposed and evaluated in the paper.
Public source repository for vLLM, the LLM serving system introduced and evaluated in the paper.
The paper's vLLM fork and branch containing its Activated LoRA serving and cross-model prefix-cache reuse implementation.
Maintained companion repository for the survey's literature organization and updates on efficient multimodal large language models.
Repository for the Temporal Neural Common Neighbor model introduced in the paper.
Repository containing SDPG agents, configurations, Genesis environments, models, training/evaluation scripts, baseline dependencies, and Go2 hardware-related files.
Official repository for ActPRM, containing the active-PRM package, training and ProcessBench evaluation scripts, examples, and links to released models and data.
Official experiment code for the paper's expert-wise mixed-precision MoE quantization method.
Repository associated with EfficientLLM for the benchmark codebase, metric API, evaluation workflows, and planned model artifacts.
Repository containing the code, experiment configurations, and model artifacts for the structured state-space work discussed in the paper.
Official code repository for generating embeddings and pseudo-labels, collecting training dynamics, computing importance scores, selecting ELFS coresets, and training CIFAR and ImageNet classifiers.
Official repository containing scripts and links to reconstruct the ELI5 dataset, build support documents and splits, format multi-task data, train and evaluate the reported models, and use the released pretrained checkpoint.
Repository implementing the paper's ELSAA hybrid attention mechanism, including sortLSH sparse attention, RACE low-rank attention, denominator-aware fusion, causal variants, and experiment scripts.
Repository for EmbedLLM materials, described by the paper as containing the dataset, code, and embedder for further research and application.
Official repository for EMMA, containing the LAVIS-based ALFWorld finetuning setup, links to released training artifacts, and trajectory/experiment logs for EMMA and the Reflexion LLM teacher.
Repository for the Embodied Web Agents project, including web environment hosting instructions and model-running folders for indoor, outdoor, and geolocation tasks.
Python SDK that lets users obtain drone observations and issue control actions through the Embodied City online API.
Repository containing simulator-related materials, datasets, task code, prompts, VLN code, and documentation for the EmbodiedCity benchmark.
Official code repository for the EMERGE framework, including data processing, retrieval, fusion, training, and evaluation components.
Code and experiment resources for measuring how context-characteristic sensitivity changes across instruction-fine-tuning stages.
Repository named Emoji-Embedding-For-Finance, cited throughout the paper as the source for model-vs-BERT comparisons, emoji frequencies, BTC/VCRIX figures, sentiment time series, and trading-strategy outputs.
Repository linked as 'Code' from the paper's official project page; its README states that it maintains an overview/implementation of the Habitat-MAS benchmark and EMOS multi-agent system and contains a habitat-mas component plus instructions for running the EMOS demo.
Official repository for the paper, containing code and data artifacts for generating analysis-report features and training the hybrid asset pricing model.
Core open-source Academy implementation for building and deploying stateful actors and autonomous agents across distributed and federated research infrastructure.
Code for generating and scoring multiple-choice questions from scientific papers, used as the implementation basis for the paper's information-extraction case study.
Repository released by the authors for ILM code, data, trained models, and human-evaluation outputs/responses.
Official code and data repository for the ALCE benchmark and evaluation framework introduced in the paper.
Pre-release Python/PyTorch code for building chart-image datasets, splitting data, training the ResNet trader, and inferring triple-I weights.
Repository for implementing Iter-CoT, the paper's iterative bootstrapping method for chain-of-thought prompting.
Preferred Multi-turn Benchmark for Finance in Japanese, used by the paper to evaluate generation quality across financial dialogue tasks.
Pathway is used as the vector store implementation in the paper's retrieval system.
Stated repository for the modular Python prototype implementing the neuro-symbolic ontology-based LLM validation pipeline.
Repository containing implementation for the PSX interpretability algorithms and models discussed in the paper.
Repository indicated by the paper as containing code for AdvDistill; the URL returned 404 when fetched during extraction.
Official CASE inference-code repository linked directly by the paper. The repository implements the context-aware semantic embedding pipeline with a scikit-learn-style transformer interface.
Public implementation of the structured-matrix Transformer enhancement framework introduced in the paper.
Code repository for the Focus reference-free uncertainty-based hallucination detector.
Official PyTorch implementation of JADE and distribution point for the text portion of the CC3M-QA-DC dataset.
Official repository for the paper containing scripts for question-driven caption generation, GPT-3.5 answer generation, preprocessing and evaluation, plus released captions and prediction files.
Repository containing the LoT prompting implementation, scripts for CoT and LoT experiments, requirements, and quick-run instructions.
Gym-PushT is the simulation environment used for ENPIRE's heuristic-learning autoresearch comparison and is explicitly cloned for the Push-T setup.
GitHub repository cited by the paper as the source of the second obesity classification dataset.
Repository reported by the paper as containing code, curated data pointers, generated figures, and result tables for the reproduction and robustness analysis.
Official repository containing the code used to train and evaluate the ME-DST models introduced in the paper.
Implementation of faithfulness-aware decoding used for the advanced-decoding baseline.
FactPEGASUS code and models used to test whether the proposed augmentation transfers to another factuality-aware contrastive pipeline.
Official CLIFF implementation used as the contrastive-learning baseline and as the training framework combined with the proposed counterfactual augmentation.
Official ERA repository containing the EPL training code, online RL framework, environment setup, evaluation integration, and links to the curated prior datasets.
Repository hosting the ESG-FTSE corpus of news articles with ESG relevance labels.
Repository released by the authors containing code for the agentic benchmark assessment and related experiments.
Repository associated with the paper's contamination-detection work for LLM evaluation. The paper links it as code and data; the currently visible README describes a lightweight tool for identifying and analysing potential contamination without access to LLM training data.
Repository URL listed by the paper for the implementation of the confidence IQN experiments.
Repository containing the paper's data-processing, rephrasing, fine-tuning, detector-evaluation, and post-processing code for reproducing the reported experiments.
A production-grade evaluation toolkit for LLM agent outputs, including metrics for diversity, reliability, cascade uncertainty, perturbation consistency, consistency, factual grounding, hallucination, explainability, and drift.
Repository containing the AGENTbench harness used to evaluate coding agents under NONE, LLM, and HUMAN repository-level context settings on AGENTbench and SWE-bench Lite.
Repository associated with the CogEval cognitive-map study containing conversation artifacts, task templates, and a conversation visualizer.
Public GitHub repository released by the authors to support reproducibility and further research on financial relationship graph evaluation.
Repository containing the HumanEval hand-written programming benchmark and code for evaluating generated solutions.
Repository described as a resource hub for understanding, detecting, and mitigating biases in financial-domain LLMs, including a Structural Validity Checklist, a literature review dashboard, and an automatic bias detection dashboard.
Official repository containing data-download scripts, annotation tools, data-construction code, API and open-source model inference code, evaluation code, and reward-model evaluation utilities.
Repository containing the code released for the ClinMM-Bench study.
Repository associated with the M4 competition dataset and methods, used by the paper for benchmark data and base learner forecasts.
Repository containing the source code for the paper's FFORMA and ES-RNN ensemble experiments.
Repository for LogiEval, the paper's prompt-style logical-reasoning benchmark suite for evaluating large language models.
LogiQA 2.0 repository referenced for the benchmark and for the newly constructed 2022-onward out-of-distribution logical-reasoning data.
Official repository containing the LoCoMo data release, conversation-generation code, prompts, and evaluation scripts.
Phoenix is cited among tools that provide analytics and evaluation orchestration capabilities for agent or LLM evaluation.
DeepEval is listed among tools that support analytics, evaluation orchestration, and debugging for LLM or agent evaluation workflows.
OpenAI Evals is discussed as an open-source framework for specifying evaluation tasks and metrics and automating execution and reporting.
HAL is cited as a holistic agent leaderboard or harness for centralized and reproducible agent evaluation.
Inspect AI is cited as a framework for large language model evaluations and included among evaluation tooling examples.
Repository named in the paper for ICD coding explainability evaluation resources, including RD-IV-10-related artifacts and generated rationales.
Paper-provided implementation link for the evaluation-awareness scaling-law experiments; the arXiv HTML resolves through an Anonymous Github mirror.
Official repository for the survey, containing the paper's benchmark reference framework, figures, and benchmark bibliography.
Repository containing the EviReform source code, configuration, prompt assets, released evaluation data, index artifacts, metric/statistics code, and reproduction instructions.
R code, datasets, and experiment scripts for EvoAAA, the evolutionary autoencoder architecture search methodology introduced in the paper.
Repository containing code and technical details for the Multi-Agent Scoring System for essay assessment.
OpenAI's released distributed implementation of the evolution-strategies algorithm studied in the paper.
Repository providing BanditBench and inference code; the paper also notes installation via pip install banditbench.
Official repository for the CodeAct framework, evaluation code, CodeActAgent deployment components, scripts, and links to the released data and models.
Repository identified by the paper as containing the code and data for the software-developing agent framework evaluated in the study.
The repository is linked by the paper as the location for data and code and contains files including a notebook, UNSW-NB15 dataset archive, and feature metadata.
Repository named by the authors as containing all code for the experiments that apply feature importance, SHAP, and LIME to PPO portfolio-management predictions.
Existing Reinforcement learning in portfolio management repository that the authors identify as the starting framework for integrating explainability into a PPO-based model.
The cpath package implements the paper's counterfactual-path method for R and Python.
UnifiedSKG is the structured knowledge grounding model used in the paper's text-to-SQL case study.
Official implementation of Pattern-Exploiting Training and iterative PET introduced in the paper.
Repository for the x-stance multilingual stance-detection dataset evaluated by the paper.
Repository containing the benchmark data, task files, representative logs, and evaluation scripts for AutoGen, MetaGPT, and TaskWeaver.
Repository for the MachineSoM experiments, including sampled evaluation data, prompts, agent-society simulation code, agent-count/round/strategy ablations, ANOVA evaluation, and conformity/consensus plotting utilities.
Implements SimCLR-style HAR training and evaluation on MotionSense, including preprocessing, transformations, model definitions, utilities, and a demonstration notebook.
GPT-Engineer is listed as a code-domain LLM-based single-agent system and cited as a GitHub project that generates code repositories from prompts.
GPTresearcher is listed as a research-domain LLM-based autonomous agent for online comprehensive research.
AIlegion is listed as a universal LLM-powered autonomous agent platform.
LoopGPT is listed as a universal modular Auto-GPT-style LLM agent framework.
AGiXT is listed as a universal AI automation platform with instruction management, memory, and plugins.
LangChain is discussed as an open-source framework supporting LLM-based agent software development and tool integration.
DemoGPT is listed as a code-support LLM-based agent system for creating LangChain applications through prompts.
AgentGPT is discussed as an agent framework offering browser-based assembly, configuration, deployment, fine-tuning, and local data incorporation.
Auto-GPT is discussed as an open-source agent template/framework for decomposing objectives and executing tasks in a loop.
SmolModels / smol-ai developer is listed as a code-domain LLM-based agent system with self-feedback and tool use.
WorkGPT is discussed as an open-source GPT agent framework for invoking APIs.
SuperAGI is listed as a universal open-source autonomous AI agent framework.
XLang is discussed as an open-source framework for building and evaluating language model agents through executable language grounding.
BabyAGI is listed as an LLM-based agent that creates tasks from objectives and stores or retrieves task results.
Repository for the CogMir framework's core data assets and high-level experimental prompt-design logic, including datasets corresponding to Appendix C and prompt templates corresponding to Section 4 and Appendix D.
BabyAGI is described as an OpenAI-powered task management system that uses vector databases such as Chroma or Weaviate to manage, prioritize, execute, store, and recall task-related information.
Code for defining text-to-text tasks and mixtures, preprocessing and evaluating datasets, training and fine-tuning T5 models, and reproducing the paper's experiments, with links to released checkpoints.
Repository for ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook, including experiment code, datasets, scripts, and setup instructions.
Repository containing the 50-claim development dataset, the 25-claim post-finalization dataset, and dataset statistics used in the paper.
Repository containing materials from Stages 1, 2, and 3 of the expert formalization study evaluating the super-pattern.
Repository containing the paper's released Self-Contrast code and data.
Open-source implementation of the paper's GPT-2 generation, candidate ranking, and training-data memorization attack workflow.
Repository containing FactReview, RefCopilot, demos, source code, scripts, tests, and documentation for evidence-grounded reviews of ML papers.
Repository containing pilot and main JSON datasets, prompt generation code, evaluation code, prompt templates, and unit-group definitions for the FAITH paper.
Author-linked PyTorch codebase for the paper's transformer self-supervision experiments, including SynCo-style synthetic negatives, DeiT/Swin configurations, pretraining, and linear evaluation.
PyTorch code, configurations, training and unmasking scripts, evaluation utilities, and pretrained checkpoints for ImageNet 256x256 and 512x512 MaskDiT models.
Code implementing the Favi-Score introduced and evaluated in the paper.
Code repository linked by the paper for the FedSPM method and experiments.
Official repository for reproducing the paper's output-refinement and policy-refinement experiments.
Repository explicitly published with the paper for the FEVER annotation interfaces; the current repository also contains dataset preparation, scoring, and baseline components.
Repository explicitly published with the paper for the FEVER baseline pipeline implementing evidence retrieval and textual entailment.
Repository associated with the Cross-Attentive Time-Series Trend Network described and evaluated in the paper.
Official repository for the paper, containing code for synthetic hallucination generation, reward-model training and evaluation, sample hallucination data, and links to released data.
Open-source repository associated with PIXIU and FinBen, containing financial LLM resources, evaluation datasets, benchmark materials, code, and links to related models and leaderboards.
Repository implementing FinBERT and providing training, prediction, and model resources associated with the paper.
Repository indicated by the authors for the FinBERT2 work, including the specialized encoder and related downstream variants or resources.
ProgramFC repository used as the implementation basis for the LLM-based composite fact-checking system in the experiment.
Repository for FAVOR with model files, inference code, environment specification, example data, and checkpoint setup instructions.
Official repository providing the paper's Fine-Grained RLHF implementation, QA-FEEDBACK data, reward-model training code, RLHF scripts, trained-model references, and annotation interfaces.
Repository containing preprocessing, model-definition, training, testing, and performance-analysis code for mapping CSU veterinary medical summaries to SNOMED-CT diagnosis codes.
Official repository for offline reward-model training and preference-based language-model fine-tuning, including smaller fine-tuned models and a subset of collected human labels.
Official repository implementing the paper's RL4VLM training pipeline, GymCards environment, modified LLaVA components, and PPO training for GymCards and ALFWorld.
GitHub repository for a Chinese financial news sentiment classification dataset containing train and test CSV files and financial news sentiment labels.
Repository path containing the AdvBench harmful-behaviors data from which the paper uses a 50-prompt subset across 32 categories.
Repository containing code for FinEAS and the paper's BERT, BiLSTM, and FinBERT financial-news sentiment experiments, together with reported result tables.
Repository containing data preprocessing code, FineFT algorithm training/validation/testing scripts, VAE routing components, trading-environment implementation, baseline code, and analysis utilities.
Google Research Big Vision repository containing the UViM codebase used for the paper's depth, panoptic-segmentation, and colorization evaluations.
Official Google Research directory containing the FSQ paper README and reference FSQ Colab/code artifact.
Official MaskGIT JAX implementation used as the basis for the paper's MaskGIT FSQ-versus-VQ experiments.
Python source code repository for FINMEM, the LLM trading agent with layered memory and character design.
Repository for the FinReport code and datasets released by the paper.
Astock dataset used for stock and news data, train-validation-test splitting, OOD analysis, and backtesting.
Repository for the paper's dataset construction pipeline, data collection module, FinRpt framework modules, benchmark evaluation code, fine-tuning setup, reinforcement-learning setup, and website front-end code.
GitHub repository associated with the paper's benchmark for online financial RAG evaluation.
Repository released by the authors for FinTexTS framework code and pilot study implementation.
Open-source implementation repository for FinWorld, the end-to-end financial AI research and deployment platform introduced in the paper.
Contains FireAct prompts, task and tool definitions, trajectory-generation and evaluation code, fine-tuning scripts, example training data, and model references.
Open-source implementation of FlashAttention referenced by the paper.
Source code and experiment resources for the Fleet of Agents framework introduced and evaluated in the paper.
Repository containing the Flow multi-agent workflow automation implementation, including workflow management code, prompts, validators, notebooks, and generated examples.
Code repository for the FlowAgent framework introduced by the paper.
Official repository containing FlowBench source data organization, turn-level and session-level evaluation code, scripts, prompts, and setup instructions.
GitHub Gist with a replenishment plan generated by the Flowr DC Replenishment Planning Agent, including outlet allocations, route assignments, vehicle assignments, route summary, consolidation opportunities, and human review queue.
GitHub Gist with a purchase-order report generated by the Flowr Procurement and Ordering Agent, including order quantities, supplier justifications, delivery estimates, consolidated supplier orders, and human review flags.
Repository listed by the paper for code associated with dataset analysis, object-detection benchmarking, and cost-aware sequence active-learning experiments.
Repository made available by the authors for the proposed models used to forecast extreme Bitcoin volatility movements.
Repository for the FiGASR package and related sentiment-indicator resources.
Repository containing Python code for fine-grained aspect-based sentiment analysis in the economic news setting.
Public multivariate time-series dataset repository containing the exchange-rate data used as real-data-E.
Lag-Llama pretrained model repository used as the probabilistic zero-shot forecaster in the experiments.
Official implementation of the Diffusion Model-Based Predictor baseline for robust offline RL against state-observation perturbations.
Repository containing the implementation and results for LSTM and GRU time-series forecasting experiments discussed by the paper.
Repository containing FoT code, task and benchmark scripts, datasets, model and method modules, and evaluation instructions for Game of 24, GSM8K, MATH-500, and AIME.
Repository containing more detailed prompts and implementation code for the LAWN antenna self-evolution framework discussed in the paper.
Repository stated by the authors to contain the complete source code employed in the research.
Official code for the paper, including the local Qwen3-4B/BGE-M3 RAG pipeline, controlled diagnostic experiment, BEIR evaluation, cross-encoder comparison, and gating analyses.
Repository for the paper 'From Coarse to Fine: Self-Adaptive Hierarchical Planning for LLM Agents', containing implementation-related folders such as agents, configs, envs, plan generation, prompts, tasks, utilities, and experiment scripts.
Repository for the paper From Emergence to Control: Probing and Modulating Self-Reflection in Language Models, describing probing vectors, model insertion, and reflection analysis for controlling self-reflection in LLMs.
Repository for ALARM, including the front-end GUI, back-end algorithms, and the anomaly/feature-importance simulation code described by the authors.
A maintained paper list and resource collection about LLM-as-a-judge.
Repository for the paper's semi-automated ontology and knowledge-graph construction pipeline, including prompts, code, data, generated artifacts, results, and evaluation materials.
Repository containing the reproducibility-related publication data and analysis code from the authors' prior biodiversity deep-learning study, which supplied the source dataset for the current pipeline.
Repository accompanying the review, containing the detailed thematic scoring by co-authors, supplementary review material, and diagrams.
Repository titled for the paper 'From Large AI Models to Agentic AI: A Tutorial on Future Intelligent Communications' and identified by GitHub as the code repository for the paper.
BeeAI is described as the experimental platform central to IBM's ACP, supporting local-first orchestration, agent discovery, REST endpoints, SDKs, telemetry, and multi-agent execution.
The MCP servers repository is cited as an ecosystem of reference and integration servers for file management, databases, Google Drive, Git, GitHub, GitLab, Slack, Google Maps, image generators, and search APIs.
OpenAI Swarm is reviewed as a lightweight, stateless abstraction for multi-agent systems with agent definitions, dynamic handoffs, context management, direct function calling, streaming, and backend flexibility.
Open-source Microsoft GraphRAG repository implementing the graph-based indexing and retrieval/summarization approach described in the paper.
Repository reported by the paper as containing code and data for the proposed news-aware LLM time series forecasting framework.
Open-source OpenCode repository corresponding to one of the agentic tools evaluated by the paper.
Open-source Kilo Code repository corresponding to the agentic coding tool selected for the paper's second prototype.
Repository containing code and data for the HippoRAG family, including the framework introduced and evaluated in this paper.
Repository path for a Workflow Composer that transforms natural-language research questions into executable HyperFlow workflows for the 1000 Genomes Project, including source code, tests, Skills/resources, CLI commands, and evaluation-related materials.
A companion GitHub repository associated with the survey on agentic workflow optimization.
Repository for the paper containing raw experimental data, reasoning processes and outputs, keyword-statistic results, LLM-as-a-judge scores, and score-analysis spreadsheets.
Official companion repository for the tutorial, containing the paper materials and a resource browser organized around its world-model and world-action-model taxonomy.
Repository associated with the paper<ef><bf><bd>s recursors/refiners work, containing generated Prolog programs, models, execution traces, and related materials for the implemented system.
AWorld-RL is the linked project repository that houses FunReason-MT materials and describes the introduced multi-turn function-calling data-synthesis framework.
The FunReason v1 paper explicitly directs readers to this GitHub repository for code and dataset; the URL currently redirects to the renamed BalanceSFT repository.
Repository identified by the paper as containing the pre-processed dataset, raw news article data, and implementation code for M2VN.
Repository containing GAAMA's typed memory graph, semantic and PPR retrieval components, prompts, storage adapters, and LoCoMo evaluation scripts.
Repository containing retrieval, gain-signal synthesis, selector training, and evaluation code for GainRAG.
Repository for the Game-theoretic LLM paper, including source code, setup instructions, complete-information game experiments, workflow experiments, and Deal-or-No-Deal experiments.
Official GameplayQA benchmark codebase containing data-processing, model-evaluation, judging, ablation, evaluation, and plotting workflows.
Web-based tool developed for synchronized single- and multi-video timeline annotation and verification used in constructing GameplayQA.
Gapetron is the modular large-scale pretraining toolkit used to train the Gaperon model suite and released as a primary implementation artifact of the paper.
Repository reported by the author as containing the code and dataset used in the paper.
Official implementation and evaluation code for GEAR, including generation benchmarks and a CUDA-supported GEAR-KIVI implementation.
Repository containing the code used to construct and evaluate nearest-neighbor language models, including datastore building and FAISS-backed retrieval.
ytopt is a machine-learning-based autotuning and hyperparameter-optimization framework used in Section IV-B to search coefficient spaces for the reviewed scaling laws.
The Lila benchmark repository supplies the program-form mathematical reasoning data used in the paper's mathematical program-synthesis experiments.
Official AASbyLLM research repository containing the prototype implementation, simplified source code, AAS samples, prompts, raw evaluation results, evaluation spreadsheet, figures, and demos associated with the paper.
Repository released by the authors for the GAR method, including code and retrieval results.
Public repository for the paper's generative-agent architecture and Smallville simulation code.
Repository linked directly by the paper; it provides the satellite-domain dataset/knowledge material and a simple notebook example for validating the generative AI agent.
Official repository for the ToxiGen synthetic toxic/benign text dataset evaluated as an alternative and complementary augmentation source.
PyTorch repository containing generative sparse-index-tracking code, comparison code, a GECCO 2023 directory, backtesting material, and instructions for obtaining the associated dataset.
Code for training WSGAN with a StyleGAN2-ADA base architecture on weakly supervised CIFAR10 and LSUN datasets.
Code for jointly training the DCGAN-based WSGAN and label model, together with weak-label files and instructions for the principal datasets.
Public repository from which the authors select 96 model-specific jailbreak prompts used as the jailbreak query group.
Official code repository for GRT, including task configurations, VLM-based keypoint preparation, population-based deformation search, simulator evaluators, and analysis scripts.
Repository explicitly linked by the paper for GestureGPT prompts and corresponding data samples used to guide the three-agent architecture.
Official source repository for the Gibson Environment, including installation, assets integration, rendering, agent examples, and training demos.
Official repository containing Gorilla inference resources, APIBench data, evaluation scripts, model outputs, and materials for reproducing the paper's results.
OpenAI Evals, the framework the report states it is open-sourcing for creating and running model benchmarks and inspecting performance sample by sample.
Repository for the SeeAct generalist web agent, including code, data links, and evaluation tools associated with the paper.
Repository containing code and instructions for preparing nuScenes-derived prompts, fine-tuning GPT-3.5, generating motion-planning outputs, and evaluating the GPT-Driver approach.
Public prompts and code for the GPT-based automated review generation workflow used in the study.
Author-owned repository containing ROG experiment code, FedAvg attack scripts, compression configurations, model components, and minimal example data.
Repository linked by the paper as the implementation of Grammar Search for multi-agent systems.
Repository providing the authors' implementation of a Graph Attention Network layer and an execution example.
Code and sample artifacts for concept-specific KG generation, UMLS subgraph sampling, node and edge clustering, personalized KG composition, BAT model training, prediction, and baseline execution.
Source code for GraphGPT and the Graph Eulerian Transformer workflow.
RAGChecker is an open-source visual analytics tool that compares LLM outputs against source documents, supports GraphEval+ and SICI-style detection, and presents claim reliability through an interactive quadrant-based visualization.
Open R1 provides the GRPO/SFT training framework that the study extends and is also the source of the no-reflection comparison used in the reflection-reward ablation discussion.
Repository supplied by the author for the paper's GRPO-with-reflection implementation, training workflow, evaluation code, and reported experimental results.
Repository accompanying the paper with GSM-Symbolic templates and generated benchmark data, including GSM-Symbolic, GSM-Symbolic-P1, and GSM-Symbolic-P2 resources.
Repository for the GTA benchmark, dataset, code, and evaluation materials for general tool agents.
Official GuardAgent code repository containing the guard agent implementation, prompts, callable tools, and runner scripts.
Official repository for the EICU-AC and Mind2Web-SC benchmark resources introduced by the paper.
Official repository for H3M-SSMoEs containing Python code, model components, training and backtesting scripts, and links to datasets and model weights.
Repository explicitly linked by the paper for the HaGRID dataset, downsampled/trial versions, pretrained models, and dynamic gesture recognition demo.
Official repository for the HalluLens benchmark, including materials for the extrinsic hallucination evaluation tasks and associated evaluation workflow.
The FacTool repository contains a dedicated Halu-J directory and the resources released for the critique-based hallucination judge and ME-FEVER.
Official open-source implementation and data repository for HarmBench, including benchmark data, red-teaming baselines, evaluation classifiers, pipeline scripts, and adversarial-training code.
Repository stated as the release location for HDFlow code and data.
Documentation and examples for obtaining embeddings from the HeAR health-acoustic foundation model through its research API.
Repository directory containing CT Foundation API documentation, demos, and resources for generating embeddings from CT volumes.
Repository associated with the paper's released LOFin benchmark and HiREC implementation.
Official repository linked by the paper for HippoRAG code and data.
Hosts the paper project page, benchmark overview, examples, statistics, comparison graphics, and model leaderboard for HLV-1K.
Open-source implementation of the HAL evaluation harness introduced and evaluated in the paper.
Open-source HomeRobot codebase containing shared agents and interfaces, Habitat-based simulation support, hardware control for the Stretch robot, and OVMM baseline implementations.
Repository containing code to reproduce the HCNN experiments reported in the paper.
PyTorch implementation of the Hopfield, HopfieldPooling, and related continuous modern Hopfield-layer functionality introduced and evaluated in the paper.
Repository containing the baseline model code and pipeline for HotpotQA data download, preprocessing, training, prediction, and evaluation.
Repository containing annotated transcripts of each participant made available for future studies.
TheAgentCompany repository contains sandboxed work environments, task directories, evaluators, task instructions, and supporting files for many task instances listed in the paper's appendix task table.
Repository for coding-agent token-consumption analysis, including dataset-building scripts, multi-model analysis scripts, phase-level token decomposition, and self-prediction correlation computation.
Python codebase for running the ensemble generalization-gap experiments, computing dataset complexity metrics, and generating per-dataset outputs and figures.
Open-Instruct repository released with the paper to support reproduction and further research on open instruction tuning, including T"ULU-related artifacts.
GitHub directory linked by the paper for the deterministic prediction task source code, including Pauli string multiplication, divide-and-conquer, letter replacement, and addition-related files.
Repository containing the dataset and experimental code for the study of memory addition, deletion, and experience-following behaviour in LLM agents.
Repository containing the prototype implementation for customizing and probing leaderboards with the paper's evaluation approach.
The repository provides code folders for HAG-XAI object detection, HAG-XAI image classification, FullGradCAM for Yolo-v5s, and FullGradCAM for Faster-RCNN, along with links to experimental materials, human attention data, and pretrained model files.
Repository linked directly from the paper; it contains the implementation notebook, Appendix.pdf, Focus data, and transformed MLC data.
Repository containing data and analysis code for the human-alignment AI-assisted decision-making study.
Contains the Auto_Driving_Highway code, prompt materials, results, and instructions for training an RL agent with an LLM in the reward loop.
Azure Verified Modules is used by the paper as a cloud-native curated module ecosystem that demonstrates governance, standards, testing, versioning, and consistent interfaces.
Repository indicated by the paper for prompts, code, anonymised data, and the full questionnaire related to the AI Narrative Test.
Repository for the S&P 500 membership forecasting project, including EDA.ipynb, Modeling_Process.ipynb, model-interpretability figures, and Python dependencies.
Source code for the HybRank hybrid and collaborative passage-reranking model.
Repository linked by the paper as the code for the HyGRL framework.
Repository containing the HypeLoRA MLP and Transformer hyper-networks, dynamic LoRA layers, RoBERTa builders, GLUE data loading, calibration metrics, experiment configurations, and experiment-running utilities.
Official implementation repository for HyperAgent, including the multi-agent software engineering framework and benchmark reproduction scripts.
GitHub repository for the ICICLE method introduced and evaluated in the paper.
Repository containing ToolEmu code, emulators, evaluators, curated toolkit and test-case assets, scripts, and notebooks.
Repository for the IDQL method introduced in the paper, including offline-training and fine-tuning scripts and the diffusion/IQL learner implementation.
Author-released implementation of PromptInject, the modular framework used to assemble prompts and evaluate LLM robustness to adversarial prompt attacks.
GitHub repository released by the authors for IL-PCSR and developed models.
Repository containing data preparation, BERT-based and T5 training and evaluation scripts, late-fusion evaluation, and experiment configurations for the paper's CBM models.
Repository containing the ImageRAG codebase, configurations, scripts, evaluation workflow, and pointers to released data, caches, and checkpoints.
Complete codebase and setup instructions for the sentiment-driven stock prediction experiments.
Repository maintained by the authors as an official page and living resource list for the survey on implicit reasoning in LLMs.
Official HarmBench repository used to generate adversarial safety-evaluation test cases for the downstream RLHF experiment.
Open-source repository cited as the source for the Reuters & Bloomberg news-title stock-prediction dataset used to build headline vectors.
Repository titled Anote-Text-Classification containing dataset folders, trial runs, requirements, README explanations, and model performance comparisons for GPT-3.5 Turbo, SetFit, and BERT across the evaluated datasets.
Repository for the CARE native retrieval-augmented reasoning framework, including scripts, evaluation resources, documentation, and training examples.
Official FactCC implementation and model used to score whether generated summary claims are factually consistent with source documents.
Preliminary implementation of the paper's multiagent debate experiments, with code for arithmetic, GSM8K, biography, and MMLU tasks.
Repository for Fusion-in-Decoder, providing the Natural Questions version augmented with DPR-retrieved passages that RETRO uses for its question-answering experiment and representing a principal comparison system.
NexusRaven-V2 repository linked by the paper for the Nexus function-calling evaluation benchmark.
Repository containing notebooks for SFT and LoRA-based DPO training, generation and reward-model evaluation of the four OPT-350M variants, evaluation data and JSON outputs, plots, and examples of noisy preference pairs.
Code repository for the paper's QE-based machine-translation feedback-training experiments and RAFT+ method.
Code repository for the Synchronously Self-Reviewing fine-tuning method introduced and evaluated in the paper.
Repository for the Unsupervised Passage Re-ranking method introduced in the paper, including the codebase and paper-linked data/checkpoints.
Code repository for the MAP paper, including implementations and evaluation scripts for Tower of Hanoi, CogEval graph tasks, PlanBench, StrategyQA, and transfer experiments.
Microchain is the agent-based library used to inject function declarations, descriptions, and examples into prompts, call functions during the reasoning loop, and record assistant/user chat-completion chains.
S-LoRA is the scalable multi-adapter serving baseline whose unified pool does not retain history KV caches in the evaluated configuration.
vLLM is the serving engine extended by FastLibra and a principal baseline with static LoRA/KV cache partitioning and LRU management.
Repository containing code and standardized data for direct experiments, indirect matched-content experiments, the AllSides news-choice case study, and the Amazon seller-choice case study; it also documents the inference environment and points to hosted aggregated outputs.
Public repository for InlineCoder, the framework introduced and evaluated in the paper.
Repository containing the MMT-VQA Fairseq-based implementation, training and evaluation scripts, dataset preparation instructions, and access information for Multi30K-VQA.
Official repository listed by the paper for the InfiR model family and associated model resources.
Repository linked by the paper for InfoMosaic-Bench/InfoMosaic-Flow resources.
Published ETT dataset collected by the authors and used as a core benchmark dataset in the paper.
Source code for the Informer model and experiments.
Aider source repository analyzed for user-driven loop design, repo-map retrieval, edit formats, and summarization behavior.
OpenCode source repository analyzed for tool interface design, event bus, SQLite session persistence, dynamic tools, and role-based sub-agents.
Moatless Tools source repository analyzed for MCTS orchestration, tree-structured state, action classes, semantic search, in-memory shadow mode, and actor-critic routing.
AutoCodeRover source repository analyzed for phased scaffold control, search-only tools, AST-aware retrieval, SBFL, and Docker-based execution.
Cline source repository analyzed for recursive control flow, IDE coupling, shadow git checkpoints, delegation, and LLM-initiated compaction.
Prometheus source repository analyzed for LangGraph-based phased control, graph-scoped state, knowledge graph retrieval, per-node tool scoping, and multi-tier persistence.
Gemini CLI source repository analyzed as one of the 13 coding agent scaffolds.
Codex CLI source repository analyzed for event-driven ReAct control, dynamic tool rebuilding, sandboxing, Guardian safety routing, memory extraction, and sub-agent delegation.
Agentless source repository analyzed for fixed-pipeline architecture, hierarchical localization, sampling, and JSONL pipeline state.
OpenHands source repository analyzed for event-sourced architecture, tool interfaces, Docker execution, and delegation mechanisms.
mini-swe-agent source repository analyzed as a deliberately minimal baseline scaffold with a single bash tool and simple ReAct loop.
SWE-agent source repository analyzed for ReAct control loop, tool bundles, retry behavior, Docker isolation, and compaction processors.
DARS-Agent source repository analyzed for depth-first tree search, SWE-agent-derived tools, greedy LLM critic selection, and Docker reset/replay state recovery.
A topic-agnostic, provenance-first pipeline for legitimate AI-assisted drafting of a Related Work section using human-authored structured notes, strict no-invention constraints, interaction logs, generated taxonomy, draft output, audit table, provenance card, and related artifacts.
Repository associated with the paper's survey of instruction-tuning research.
Python repository associated with hybrid physics-based and data-driven building energy modeling, with folders for evaluation, feature generation, forecasting, models, preprocessing, and utilities.
Official DVLR repository containing training, MathVerse evaluation, example, and environment files for the proposed decoupled visual interpretation and linguistic reasoning framework.
Repository containing code notebooks, data files, tickers, metrics/metadata, SQL queries, and the list of companies associated with the paper's algorithmic stock-market trading system.
Repository for the MiniGrid gridworld environment used for the paper's four-room and six-room navigation experiments.
Repository for the FastAPI control server, callback-augmented interactive trainer, React/TypeScript dashboard, examples, and LLM-based tuning demonstration.
The paper states that the ICM protocol is open source under the MIT license and that referenced workspaces are available or buildable through this repository.
Repository identified by the paper as containing the code for the GDELT headline extraction, FinBERT sentiment scoring, feature engineering, modeling, and backtesting workflow.
Public code repository for the paper's context-faithfulness experiments.
Repository for InvestLM, the LLaMA-based financial-domain instruction-tuned model released to the research community under the same licensing terms as LLaMA.
Python project for forecasting variance-covariance matrices in a Markowitz framework across cryptocurrency and traditional asset markets; the repository README states that it produced the paper's results.
Repository for IPO Finance Agent containing benchmark code, data directories, rubric artifacts, model-result files, and domain/workflow analysis outputs.
Repository containing the IQ-Learn implementation and usage materials for the paper's algorithm.
Repository for the IRPAPERS benchmark introduced by the paper.
Experimental code used for the retrieval and question-answering evaluations reported in the paper.
Official Python repository accompanying the paper, organized into pretraining and fine-tuning code.
Open-source baseline compliance assessment agent for the CISO persona.
Repository containing the sample ITBench scenarios released for community familiarization and development.
Open-source baseline SRE agent introduced and evaluated with ITBench.
Code and data repository for reproducing the paper's evaluator training, SFT+ILR, SFT+DPO, naive-ILR, and supervision-quality experiments.
Repository for JailbreakEval, an integrated toolkit containing multiple mainstream safety evaluators and supporting voting-based judgments of jailbreak success.
Repository storing submitted jailbreak prompts, responses, classifications, and metadata for attacks and defenses tracked by JailbreakBench.
Official JailbreakBench codebase implementing dataset access, model querying, jailbreak and refusal judges, red-teaming evaluation, defenses, logging, and submission workflows.
Repository containing Stage 1 JEPA+DAAM training, Stage 2 decoder training, FSQ and mixed-radix packing, a HiFi-GAN decoder with optional DAAM gating, and DeepSpeed integration.
Repository associated with the Jr. AI Scientist system; the paper points readers there for issues, comments, questions, and planned codebase release.
FastChat's LLM-judge artifact containing the MT-bench evaluation machinery, judge prompts, and released benchmark/preference resources associated with the paper.
Official K-COMP codebase with retrieval, data-processing, training, inference scripts, environment configuration, short medical descriptions, and links to model checkpoints and datasets.
Facebook/FAIR Memory Networks repository containing a KVmemnn directory with the Key-Value Memory Network model and scripts for building, training, evaluating, and interactively inspecting WikiMovies memory data.
Repository path containing code or supplementary material for the shell-based keyword-search agent used in the paper.
Repository for KG-Reasoner containing KG retrieval, GNN ranking, backtracking, RL training, reward server, evaluation scripts, and training/test data directories.
Official implementation of the KnowAgent framework, including HotpotQA and ALFWorld path-generation scripts, trajectory filtering and merging, and LoRA-based knowledgeable self-learning.
Repository containing the question-generation compression workflow, paper-card generation, syntactic multihop experiments, datasets, evaluation scripts, and reported result files.
Official repository released with the paper, containing extensible implementations of KTO, DPO, offline PPO, ORPO, and other human-aware loss functions.
Repository for the technical report, providing code for high-frequency trading prediction under label imbalance, including MLP, LSTM, BERT, and Mamba backbones plus class weighting and data balancing options. The original dataset is not provided because of copyright restrictions.
Demonstration repository for the paper, including environment setup, dataset preparation, unsupervised detector execution, TS2Vec representation training, and feature preprocessing.
Repository for the KPI anomaly-detection dataset used as one of LEIAD's three benchmark datasets.
Official LaMMA-P repository containing code, PDDL resources, scripts, Fast Downward submodule setup, and MAT-THOR test dataset files for running the method in AI2-THOR.
Open-source GPTSwarm implementation for building graph-based LLM agents and composite swarms, with modules for graph execution, LLM backends, memory, environments, and agent optimization.
Repository linked by the paper for code and data supporting Uncertainty Quantification with Attention Chain.
Official repository accompanying the GPT-3 paper, containing synthetic arithmetic and word-scrambling datasets, dataset statistics, 175B samples, a model card, and benchmark-overlap examples.
Repository for PRONTOQA containing data-generation and analysis code plus released model outputs; the paper states that these artifacts reproduce its analysis and figures.
The repository contains an mgsm directory with TSV files for the ten translated languages plus English and manually translated few-shot exemplars.
Official demonstration code implementing the paper's language-model planning and admissible-action grounding workflow.
PIXIU provides FinMA models, FLARE financial evaluation benchmark tasks, and instruction data used as a baseline or source in the paper.
Curated collection of papers associated with the survey's coverage of LLM-agent research.
Open-source CAMEL framework for autonomous cooperation among communicative agents using inception prompting and role-play.
Open-source multi-agent collaborative framework associated with MetaGPT, discussed as a representative framework that embeds human workflow processes and SOPs into language-agent collaboration.
Open-source AutoGen framework for creating LLM applications using customizable agents that can be programmed through natural language and code.
Author-maintained repository for tracking LLM-based multi-agent papers and organizing them into streams such as frameworks, orchestration and efficiency, problem solving, world simulation, datasets, and benchmarks.
A GitHub repository made public by the authors to curate papers related to LLM safety.
Repository containing the paper list associated with the survey on LLM-based agents for software engineering.
Official repository containing the paper's human-agent collaboration datasets, training/testing code for HotpotQA, StrategyQA, and InterCode, processed training data, and original evaluation outputs.
Repository containing the mathematical problem dataset, evaluation code, and model results associated with the paper.
Repository containing the data and code for the LLM biased reinforcement learning experiments.
The repository contains task implementations for the Iowa Gambling Task, Cambridge Gambling Task, and Wisconsin Card Sort Test, LLM integration utilities, oTree interface components, run scripts, configuration files, and links to analytical code and data.
Official code repository for the Rememberer agent and Reinforcement Learning with Experience Memory experiments.
Repository released by the authors for reproducing the Zero-shot-CoT experiments.
Google DeepMind repository containing code for prompt optimization, prompt evaluation, linear regression, and traveling-salesman experiments described in the paper.
Repository for TraceLLM, the LLM-based synthetic microservice trace generator and related experimental code.
Official source-code repository for the ICPI algorithm and experiments introduced in the paper.
Repository for the paper's LLM-based anomaly detection implementation, including data-processing scripts, raw data archive, demo scripts for SFT, transfer learning, LoRA, online detection, catastrophic forgetting, and ICL.
A GitHub repository linked by the authors as a resource for recent work on LLMs for ML workflows.
The repository contains the paper's source code in a Jupyter notebook and the RAG knowledge-base text used for the demonstration.
Repository for transformer and foundation models for financial time-series forecasting, including data folders, model implementations, scripts, result files, notebooks, and reproduction instructions.
Fin-LLAMA: efficient fine-tuning of quantized LLMs for finance.
Cornucopia-LLaMA-Fin-Chinese: Chinese finance-oriented LLaMA model referenced by the survey.
Repository containing the entity-linking pipeline, relevant-document counting code, and data used for the paper's analysis.
Repository linked by the paper for released code; it contains Product-Key Memory Layer support and a PKM-layer notebook.
An up-to-date resource list for large multimodal agents associated with the survey paper.
Repository implementing the GANPO latent adversarial regularization framework introduced by the paper.
Source-code repository for the TACO-RL algorithm, configurations, training pipeline, and CALVIN-based experiments introduced in the paper.
Microsoft UniLM's LayoutLMv3 implementation, fine-tuning examples, and links to pre-trained and task-fine-tuned models.
Repository backing the paper's companion website and editable table of reviewed studies, access modes, reproducibility attributes, comparison practices, and leaked datasets.
The official code repository for experiments and evaluation associated with the Leaky Thoughts paper.
Repository containing the annotation backend, web frontend, model API, example notebooks, and explanation-supported training components for named entity recognition, relation extraction, and sentiment analysis.
Repository linked by the paper as the available code for the conformal abstention and uncertainty-evaluation work.
Official implementation and experiments for Graph Neural Controlled Differential Equations.
Repository described as the official codebase for the ACL submission titled 'Learning Faster with Better Tokens: Parameter-Efficient Vocabulary Adaptation for Specialized Text Summarization'.
Contains data resources and code for the two-stage training procedure, inference, and evaluation of fine-grained attributed generation.
Repository for reproducing the FAIR paper, including scripts for inferring student mistakes, collecting teacher responses, training distilled student models, and testing accuracy.
Repository containing synthetic-data preparation, GRPO and SFT training code, experiment recipes, model evaluation scripts, and configurations used to reproduce the synthetic-to-real reasoning experiments.
Official implementation of the paper's TraceCodegen training framework, including preprocessing, execution, buffer-based self-sampling, training configurations, and inference.
Official implementation and pipeline repository for representation learning in time-domain high-energy astrophysics, including event-file representations, feature extraction, dimensionality reduction, clustering, datasets, encoders, and demonstration notebook.
Repository titled 'BERTOps: Learning Representations on Logs for AIOps' containing data, results, source code, annotated datasets, dataset distributions, and scripts for preparing a pretrained ITOps-domain model.
Official accompanying code repository for DemPref, including experiment code, raw simulation data, and Jupyter notebooks used to reproduce figures.
Code accompanying the paper's limited-expert-prediction learning-to-defer experiments.
Repository containing code and data for the FILCO project, including context scoring, dataset preparation, model training, inference, and evaluation scripts.
Official implementation of ProverGen, the framework that generates ProverQA, which is the primary benchmark used for PRoSFI training and evaluation.
Repository containing code for the paper's Robot Language Model approach to grounded task planning.
Repository released by the authors for Learning to Self-Verify Makes Language Models Better Reasoners.
Contains code for the supervised baseline, trained reward model, PPO fine-tuned policy, model card, and links to the released human-feedback and evaluation data.
Official implementation and pretrained model weights for the CLIP method introduced and evaluated in the paper.
Official repository for LeetCodeDataset, containing versioned data, data-processing code, and the eval_lcd evaluation toolkit.
Repository explicitly linked by the paper for the open-sourced Lemur models and implementation resources.
Repository for the ICML 2026 paper; it is the designated implementation and results release target for the benchmark.
Repository accompanying the paper with PRM800K labels, labeler instructions, grading logic, MATH train/test splits, and scored evaluation samples.
Official experiment code for training LEVER verifiers, executing generated programs, and reproducing the paper's language-to-code evaluations.
CAIL2019 is used as an additional legal case similarity setting involving civil cases such as private lending, IP disputes, and maritime law.
Repository associated with the paper's rationale-augmented dialogue understanding experiments and released resources.
Code, model-training scripts, refined UMLS relation data, architecture assets, and setup instructions for the DR.KNOWS system introduced and evaluated in the paper.
The repository contains training and evaluation code and pretrained-model support for Fusion-in-Decoder models.
Official source-code repository linked by the paper for the LeVo song-generation system.
Repository containing the LitSearch dataset and code for constructing or evaluating the scientific literature retrieval benchmark.
Repository named IBM/live-api-bench with code for converting BIRD benchmark SQL queries into API call sequences and producing slot-filling and selection-style benchmark outputs.
Repository for the LiveTradeBench platform/package used to run, monitor, and benchmark LLM-based trading agents across U.S. stock and Polymarket environments.
Contains the LiveVectorLake Python implementation, chunk-level CDC components, Milvus and Delta Lake integrations, query engine, tests, generated test data, benchmark scripts, documentation, and architecture materials.
Official repository linked by the paper for access to the LLaMA model family and associated inference resources.
Repository for the LlamaDuo LLMOps pipeline implementation.
Repository for the LLF-Bench environments, installation instructions, wrappers, and task implementations introduced by the paper.
Repository containing the nudging experimental framework, configuration for nudge types and models, and R analysis code for statistical tests and plots.
Repository associated with the WORKS 2025 Flowcept Agent materials, including software, synthetic workflow, data, analysis code, query set, and prompts referenced for reproducibility.
Flowcept code repository used as the provenance capture and observability foundation for the agent architecture and implementation.
Repository for modernbert_predict_masked.
Repository for medsam_inference.
Repository for flowmap_overfit_scene.
Repository for esm_fold_predict.
Repository for stamp_extract_features and stamp_train_classification_model.
Public repository for TOOLMAKER code and TM-BENCH benchmark.
Repository for pathfinder_verify_biomarker.
Repository for musk_extract_features.
Repository for conch_extract_features.
Repository for uni_extract_features.
Repository for nnunet_train_model.
Repository for medsss_generate.
Repository for tabpfn_predict.
Repository for retfound_feature_vector.
Repository for cytopus_db.
Repository containing the cross-provider validation framework, SEC 10-K test corpus, synthetic financial database, 480 run traces, reproducibility manifests, and setup instructions for release v0.1.0.
Repository containing a Python pipeline for extracting LLM uncertainty features, analysing and selecting features, balancing imbalanced data, training calibrated Ridge and XGBoost meta-models, tuning thresholds, and evaluating cost-aware uncertainty models.
Repository containing scripts and source code corresponding to the paper's main experiments, figures, and tables.
Official implementation of Chameleon, the plug-and-play compositional reasoning system reproduced and structurally analyzed in the paper.
Official repository containing the prompts, outputs, token-count materials, and supporting files for the paper's five experiments.
CAMEL is an open-source multi-agent framework for role-playing and agent collaboration.
Code repository for improving factuality and reasoning through multi-agent debate.
MetaGPT is a multi-agent framework that models a software company using role assignments and SOP-style workflows.
AutoAgents generates different roles for GPTs to form a collaborative entity for complex tasks.
Microsoft AutoGen, a framework for building multi-agent AI applications.
Code repository for Solo Performance Prompting / multi-persona self-collaboration.
AgentVerse provides task-solving and simulation frameworks for multiple LLM-based agents.
ChatDev implements LLM-powered multi-agent collaboration for software development.
Repository connected to AI Scientist-generated papers reported as having passed peer review at an ICLR workshop.
Code repository for MAD, a multi-agent debate framework using large language models.
A curated collection of resources associated with the survey, described by the authors as containing over 200 related papers on agent hallucinations.
Repository containing code, scripts, data folders, requirements, and reproduction instructions for LLM-DSE: Searching Accelerator Parameters with LLM Agents.
Repository reported by the paper as containing the source code and data for the LLM-BLM study.
Repository for reproducing LLM-Explorer experiments and implementation details.
Official repository linked from the paper's project page; it contains the Chat with NeRF/LLM-Grounder implementation, interactive demo code, and notebooks for reproducing the paper's results.
Official repository for LLM-Planner. It provides an hlp directory with the high-level prompt generator and kNN dataset from the paper, plus an e2e directory with an end-to-end agent using LLM-Planner.
Repository for the paper's LLM-REVal framework, including simulation components for LLM-driven research and review workflows.
Repository containing the LLM-SR code and the generated Oscillation 1, Oscillation 2, and E. coli Growth benchmark datasets.
Repository for BIG-Bench Mistake, including the dataset, prompting materials, annotation guidelines, and released code referenced throughout the paper.
Contains the DELEGATE-52 relay runners, direct and agentic model wrappers, prompts, and 52 domain-specific parsers and evaluators.
Official implementation of the Chronos time-series foundation model used for zero-shot inference and sequential fine-tuning.
Configuration files for the CNN-Transformer statistical-arbitrage benchmark replicated in the paper.
Repository directory containing the IPCA, PCA, and Fama-French residual-return datasets used in the paper's backtests.
Repository for the extensible Judge-Bench collection, shared data schema, prompts, and evaluation code used to compare LLM judgments with human annotations.
Official code repository for the paper, containing evaluation scripts, configuration files, a CSV of evaluation results, notebooks, figures, and a modified Lingua training submodule.
Official repository containing the LLMSecEval dataset, code-generation application, and CodeQL-based security-analysis materials introduced and demonstrated in the paper.
Repository for the Needle-In-A-Haystack long-context retrieval test adapted in the paper's fixed- and random-needle experiments.
Official repository for the LLoCO framework and experiments.
Official LongBench repository used for the paper's SingleDoc, MultiDoc, and summarization evaluation; baseline numbers are taken from this repository.
Google DeepMind repository containing LMAct environments, expert agents, prompt construction, evaluation code, experiment configuration, and instructions for downloading expert demonstrations.
Repository for Local-Splitter, an MCP-compatible and OpenAI-compatible outbound LLM request shim that uses a local small model as a triage layer to reduce cloud token usage.
GitHub repository linked by the paper for LocalEval resources; the repository page inspected stated that available resources were being prepared.
Public repository for LoCoBench-Agent, including the benchmark framework, evaluation setup, data-download instructions, and metrics for long-context software engineering agent evaluation.
Repository containing LogicBench data, evaluation code, and supporting reasoning-chain materials.
Public-facing repository for the paper's KD experiments, configuration files, training code, plotting scripts, and geometric feature analysis utilities.
Official repository for the LongBench benchmark, datasets, and evaluation code introduced and evaluated in the paper.
Repository for the LongMemEval benchmark, evaluation code, history-construction tools, and memory-system experiments.
Repository containing LongReasonArena benchmark data, input-generation utilities, inference code, and evaluation scripts.
Repository containing code, data, and prompts for evaluating LLMs as path planners, including the artifact associated with 'Look Further Ahead: Testing the Limits of GPT-4 in Path Planning'.
Public implementation of the Loquetier virtualized multi-LoRA framework, including kernel source, runtime code, examples, tests, and licenses.
Repository containing preprocessing code, prompts, configurations, dataset splits, response extraction, and LoRAX load-testing scripts used in the report.
Open-source multi-LoRA inference server using shared base weights, dynamic adapter loading, cross-adapter batching, and adapter-weight caching.
Official repository containing the loralib Python package, LoRA integration examples, model checkpoints, and reproduction code for RoBERTa, DeBERTa, and GPT-2 experiments.
Repository containing the data, curve-fitting code, theory code, and notebooks used to generate the paper's empirical and appendix figures.
Training code used for the loss-to-loss prediction experiments, including sweep configuration and OLMo-based model training infrastructure.
Official repository containing the paper's QA and key-value datasets, prompt construction code, data-generation scripts, tests, and experiment instructions.
Repository for the LoTR method introduced and experimentally evaluated in the paper.
Repository for LPS-BENCH containing benchmark examples, mock tools, evaluators, prompt templates, schemas, scripts, and the multi-agent case synthesis pipeline.
Repository released for the Lynx hallucination-detection models and HaluBench research artifacts, including code, training data, and model generations.
Repository released by the authors for the embedding model family and the paper's model/code/data resources.
Official repository containing the M3Bench dataset organization, PyBullet and Isaac Sim evaluation workflow, TongVerse setup, task configurations, and instructions for evaluating generated trajectories.
Repository for the general-purpose MadEvolve code-evolution framework with MAP-Elites, island populations, multiple LLM providers, evaluation backends, and analysis tools.
Repository for the Self-Supervised Audio Spectrogram Transformer used as the architectural and empirical baseline for MAE-AST.
Repository for MaGNet containing Python implementation files for MAGE, hypergraph modules, 2D attention modules, training, datasets/model-weight download links, and backtesting.
Official code repository for Maieutic Prompting, including tree generation, inference code, benchmark data files, and pre-generated maieutic trees.
Repository for the MALLM-GAN method, including the main model code, an Adult-dataset notebook, baseline pipeline, sampling utilities, evaluation utilities, and dependency specifications.
Repository linked by the paper for Mamba model code and pretrained checkpoints.
Repository containing the ManipulaTHOR environment wrapper, ArmPointNav task and samplers, APND dataset instructions, baseline configurations, actor-critic models, evaluation scripts, and pretrained-model guidance.
Repository containing the authors' simulator and market-making agents for scaled beta policy experiments.
Repository for the FOREC/Cross-Market Product Recommendation baseline used for model parameters and comparisons.
Repository linked by the paper for the efficient cross-market recommendation implementation associated with the proposed market-aware models.
Repository released by the authors for Markov Chain of Thought code and associated research artifacts.
Repository for MASEval, the framework-agnostic multi-agent system evaluation library introduced and evaluated in the paper.
PyTorch/GPU re-implementation of MAE with visualization, pre-training, linear-probing and fine-tuning code, plus pretrained checkpoints used for the paper's reported models.
Code repository for the Point-MAE framework introduced and evaluated in the paper.
Repository hosting Audio-MAE code and pretrained models for masked spectrogram autoencoding and downstream audio tasks.
Provides code and model assets for MASS pre-training and fine-tuning, including unsupervised and supervised NMT, text summarization, and conversational response generation.
Repository for the MathCoder family, including inference and evaluation code and links to the MathCodeInstruct dataset and released model checkpoints.
Hosts the MathPile project documentation and source-processing code associated with the corpus introduced and evaluated in the paper.
Official MathVista repository containing benchmark data access instructions, evaluation scripts, model-output templates, leaderboard submission resources, and code associated with the paper.
Official repository for the MatPlotAgent framework and MatPlotBench benchmark introduced and evaluated in the paper.
Author-owned repository with ChartQA, FigureQA, PlotQA, and test-file directories for the paper's complex chart-question-answering data.
Official code repository for running the MDAgents framework and reproducing benchmark experiments across supported medical datasets and LLM backends.
Official repository for the mDPO method, including an mDPO trainer, Bunny training code, and data links.
Sibyl System repository included in the selected AutoGen application sample.
AutoTx repository for planning and executing on-chain transactions.
GPT-Academic repository for LLM-assisted academic reading, writing, translation, and code/project analysis workflows.
Composio platform/repository evaluated as a flexible agent application or platform with multiple autonomy-related configurations.
h2oGPT repository for private local GPT-style chat and document interaction.
GraphRag_Ollama repository combining AutoGen, GraphRAG, Ollama, and related tooling.
Langflow platform for building and deploying AI-powered agents and workflows.
Letta platform for stateful agents with advanced memory.
AutoGen open-source framework for building AI agent systems using language models, multi-agent conversations, and tool use.
AutoGen Studio application within the AutoGen repository.
Dream Team repository for building a team of AI agents with AutoGen.
Repository containing the paper's self-ask implementation/demo and released datasets, including materials for Compositional Celebrities and Bamboogle.
GitHub source for the multiple-choice Truthful-QA variant used in the model-level ranking experiment.
CHALE repository used as a hallucination-evaluation dataset with non-hallucinated, half-hallucinated, and hallucinated answer categories.
Official repository for Measuring Massive Multitask Language Understanding, containing evaluation and calibration code and links to download the test.
Search/RAG infrastructure repository.
Large language model training framework repository.
NLP framework repository.
Glasgow Haskell Compiler repository.
Haskell Cabal build/package repository.
Transformer model library repository.
Property-based testing library repository.
JavaScript DOM implementation repository.
Python spreadsheet/data-analysis tool repository.
Machine-learning library repository.
JavaScript standard library monorepo.
Official MechAgents repository containing Colab notebooks for the two-agent elasticity and hyperelasticity workflows, the multi-agent linear-elasticity workflow, and the direct two-agent versus multi-agent comparison.
Repository associated with the paper's Time Series Transformer mechanistic interpretability experiments.
Repository for the MedBayes-Lite clinical uncertainty governance layer and associated experimental implementation.
Official repository for the MegaMath dataset project, including released web and code pipeline materials and instructions for accessing dataset variants.
Public codebase for the MELT on-device LLM evaluation system, including PhoneLab and JetsonLab infrastructure, framework integrations, model conversion/evaluation code, prompt analysis, and result parsing.
Repository containing the official Python implementation of MEME, including code for argument extraction, mode identification/alignment, and training scripts; the README notes that the dataset used in the project is private due to compliance requirements.
Repository for the MeMemo browser-based HNSW retrieval toolkit, documentation, and RAG Playground example application.
Canonical repository for the MemGPT system, now named Letta, implementing stateful LLM agents with persistent memory and related tooling.
Repository for MemR3, the memory retrieval via reflective reasoning controller.
Official open-source implementation of the MemTools framework introduced and evaluated in the paper.
Repository providing data and code for reproducing analyses, with folders for one-dimensional generated regression, two-armed bandit, real-world regression, and an MMLU benchmark.
Official project repository for the MetaGPT framework introduced and evaluated in the paper.
Repository containing the MetaOptimize implementation, package files, example usage, and experiment code for CIFAR10, ImageNet, TinyStories, and continual CIFAR100 experiments.
Official MetaTool repository containing ToolE data, tool descriptions and embeddings, scenario lists, prompt templates, model-generation scripts, and evaluation code.
Public implementation companion containing the intent-to-specification pre-experiment stage, SevenNet-based experiment utilities and MCP server scripts, and discussion, revision, CLI, and Streamlit interface components.
Official repository for the Mind2Web dataset, benchmark processing and evaluation resources, and MindAct fine-tuning and model code.
Contains the released evaluation code, Graphviz-based synthetic mind-map generator, crawled and synthetic annotation preparation tools, and links to the benchmark datasets.
Repository linked by the paper for the MindWatcher agent framework, models, benchmark resources, and related implementation artifacts.
Repository for MiniCheck code, model usage, synthetic data generation code, benchmark evaluation demo, and links to LLM-AggreFact and Hugging Face model resources.
Repository for the Minions communication protocol enabling small on-device models to collaborate with frontier cloud models.
Official repository for reproducing MINT evaluation, benchmark data, prompts, and supporting code.
Code repository for the MISS generative medical VQA framework and its training approach.
Repository containing the paper's mKG-RAG implementation and associated resources.
MedicalZooPytorch repository used in the benchmark's OOD training set.
Text classification repository listed as TCL in the benchmark's OOD training repositories.
DeepFloyd IF repository used for multi-modal image tasks.
Deep Graph Library repository used for graph-model tasks.
PyTorch-GAN repository used for image-GAN tasks.
ESM repository used for protein/biomedical tasks.
Public ML-Bench code and benchmark resources released by the paper.
BERT repository used for ML-Bench tasks.
PyTorch Image Models repository used as an OOD evaluation repository.
Grounded Segment Anything repository used as an OOD evaluation repository.
Muzic repository used for music/audio tasks.