Principles of Mechanical Sympathy | Hacker News

Most AI runtimes can execute only one model inference call at a time.

Request volume is described as low relative to meaningful system limits.

Parallelism helps when different parts of a problem do not interact much.

High-frequency trading works well because the shared resource is contentious and local.

The global sequence is also described as a contentious, local shared resource.