Adrastean

Adrastean — frontier research and company building

An interactive visualization of language generation, candidate probabilities, and attention. Language generation is a continuous process of prediction and revision. Each selected token becomes part of the context for future decisions. Earlier choices influence which possibilities remain likely later in the sequence. Small changes can propagate through many subsequent predictions. Meaning emerges gradually as the sequence unfolds.

30x slowed down [2.6 t/sec]
Adrastean - Frontier Research and Company Building