Switch language한국어
Back to the list

Talk like caveman | Hacker News

TL;DR AI

Key summary

2 min read
  1. Commenters debated whether reducing token count makes LLMs less capable because tokens are the model's computation units.

  2. Some said forcing concise output can prevent necessary internal computation and increase errors, while others argued overthinking can also harm answers.

  3. Participants noted chain-of-thought handling, internal high-dimensional representations, and claims of ~75% token reduction with retained accuracy.

  4. They also discussed that longer outputs may raise the chance of low-probability token runs and hallucinations.

Read the original