AVB
@neural_avb
One of my most aha moments in understanding transformers:
"Stop thinking about a transformer as a pipeline: as if each layer transforms the output of the layer before it."
"Start thinking as a residual stream"
Each transformer block has a residual connection that adds the
"Stop thinking about a transformer as a pipeline: as if each layer transforms the output of the layer before it."
"Start thinking as a residual stream"
Each transformer block has a residual connection that adds the
12 706