Tree of Thoughts: Deliberate Problem Solving with Large Language Models

Abstract

Generalises chain-of-thought into a search tree. The model proposes multiple partial solutions, evaluates them against each other, and can back out of a branch that is not working, rather than committing to one linear line of reasoning.

@inproceedings{yao2023tree,
  author    = {Shunyu Yao and Dian Yu and Jeffrey Zhao and Izhak Shafran and Thomas L. Griffiths and Yuan Cao and Karthik Narasimhan},
  title     = {Tree of Thoughts: Deliberate Problem Solving with Large Language Models},
  booktitle = {Advances in Neural Information Processing Systems 36 (NeurIPS 2023)},
  year      = {2023},
  eprint    = {2305.10601},
  archivePrefix = {arXiv},
  url       = {https://arxiv.org/abs/2305.10601}
}