Where the gaze spends its tokens

Shift the attention mass toward the center and watch how little is left for the periphery.

Query position3
focus key-
max weight-

Causal mask: a query can only attend to keys at or before its position.