Qwen3-8B-concept-vectors

Behavioral concept vectors for Qwen/Qwen3-8B

1036 contrastive behavioral directions read off the residual stream of Qwen/Qwen3-8B, extracted from AntonKorznikov/feature_stories by difference of means over matched concept/antagonist story pairs.

Files

We analyze layers 11, 14, 18, 22, and 25 of 36.

pairs.parquet has one row per pair in the same order as the pair axis, so row i names and scores tensor row i. It also carries the concept and antagonist labels, the ontology class, the narrative guidance, the story counts behind each pole, and per layer the norm and split-half reliability.

diff subtracts the antipole, which this corpus supports because both poles of a row describe the same premise, so topic, genre and language cancel exactly. The two *_centered tensors subtract the corpus mean. The following equality holds: diff == concept_centered - antagonist_centered.

Pooling is the mean over story tokens from position 50 onward. Each story is presented as an assistant turn behind a fixed, concept-free user prompt, with no system prompt.

Layers

Geometry

Values are absolute cosines between the diff directions of two different pairs, split by whether the pairs belong to the same ontology class. For random unit vectors in 4096 dimensions the expected absolute cosine is 0.0125.