Sekos

Research · Every channel

The tensor, at full width.

The day and month states, one pixel per channel, one row per value or prompt, one panel per layer. Nothing is projected; “clock order” only re-sorts the channels by their position on the circle.

Model
Channels
Width

Loading…

value (centred per channel)top strip: each channel’s angle on the circle (hue) and weight (brightness)
Hover the tensor to read a channel.

Secondary figure: the circle. A 2-D projection, the first Fourier plane of the stated values at this layer. Labels: stated values. Rings: computed values (the mean of every shifted prompt whose answer is that value). Dots and diamonds: single and two-step prompts, coloured by their true answer.

How to read it. Rows: the stated values (“Today is Monday. Today, it is”), the computed values, and six prompts per value. Values are centred per channel over the rows shown and scaled per layer; the page shows 8-bit images of the measured fp32 states. The layer list gives, for each layer, how often a shifted prompt lands on its result's stated value (bar), on its start (grey), and the causal swap rate where it was tested.