Switch language한국어
Back to the list

Show HN: How LLMs Work – Interactive visual guide based on Karpathy's lecture | Hacker News

TL;DR AI

Key summary

2 min read
  1. A Hacker News post shared an interactive visual guide based on Karpathy’s lecture on how LLMs work.

  2. The demo explains variable-length token inputs, including padding and masking for sequences of different lengths.

  3. It also shows how embedding layers turn tokens into vectors and how context disambiguates meaning.

  4. The guide ends by illustrating the projection back from hidden representations to token space.

Read the original