Machine learningLLMs & Text

Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs

The research identifies underthinking in large language models, where models frequently switch reasoning thoughts, and proposes a decoding strategy to encourage deeper exploration of each reasoning path, improving accuracy across challenging datasets.