Tree of Thoughts (ToT) extends CoT by exploring multiple reasoning possibilities at each step. It first decomposes the problem into multiple thought steps and generate multiple thoughts per step, creating a tree structure. The search process can be BFS or DFS with each state evaluated by a classifier (via a prompt) or majority vote.