The papers behind how we build

All entries

5 entries

1. 2023ICLR 2024PublishedCurated

   SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

   Jimenez et al.

   A benchmark built from real issue reports and pull requests across popular Python repositories. A model is handed a codebase and a GitHub issue and has to produce a patch that makes the repository test suite pass, which is a far harder target than generating plausible-looking code.

   EvaluationAgents & Tool Use

   arXiv
2. 2023NeurIPS 2023PublishedCurated

   Tree of Thoughts: Deliberate Problem Solving with Large Language Models

   Yao et al.

   Generalises chain-of-thought into a search tree. The model proposes multiple partial solutions, evaluates them against each other, and can back out of a branch that is not working, rather than committing to one linear line of reasoning.

   ReasoningAgents & Tool Use

   arXiv
3. 2023UIST 2023PublishedCurated

   Generative Agents: Interactive Simulacra of Human Behavior

   Park et al.

   Agents that keep a natural-language memory stream, reflect over it to form higher-level conclusions, and plan their day from those conclusions. The paper studies what emerges when twenty-five such agents share a small sandbox world.

   Agents & Tool Use

   arXiv
4. 2023NeurIPS 2023PublishedCurated

   Reflexion: Language Agents with Verbal Reinforcement Learning

   Shinn et al.

   Instead of updating weights, the agent writes down what went wrong after a failed attempt and carries that reflection into the next attempt. The reflection is stored in natural language and used as additional context, so no gradient step is required.

   Agents & Tool UseReasoning

   arXiv
5. 2023NeurIPS 2023PublishedCurated

   Toolformer: Language Models Can Teach Themselves to Use Tools

   Schick et al.

   A model decides for itself when to call an external API, inserts the calls into its own training data, and keeps only the ones that actually reduce its prediction loss. No hand-written tool demonstrations are needed.

   Agents & Tool Use

   arXiv

Browse by topic