gadsby

Gadsby

These are versions of Qwen3-0.6B and Qwen3-8B that modifies the output weights so that any tokens containing the letter 'e' has probability set to zero.

In effect, this model never outputs the letter 'e'.

The models are offered as GGUFs quantized to Q4.

Hint: as the model can quickly get stuck in a low probability hole, it is useful to use some kind of beam search or back-tracking algorithm to select tokens.

Observations

• The model can be creative in working around the lack of a letter 'e', for example instead of sheep it can say "adult lamb" or "dominant wool-producing animal".
• Sometimes it drops the 'e' and mis-spells a word
• I did not filter out some cyrillic letters which look like and 'e' and sometimes it uses those (or even Chinese words)
• The smaller model can output refusals if it doesn't find a suitable token
• Instead of greedy sampling or probability sampling, beam search with back-tracking is useful to avoid leading the generation into an 'e' dominated dead-end

Example

PROMPT: "tell me about different farm animals, esp. those that are used for wool"

Farm animals play a vital part in human civilization, providing food, labor, and various products such as wool, milk, and transportation. Among farm animals, wool-producing animals hold a significant position in many agricultural and pastoral traditions. Wool is a natural, insulating, and highly sought commodity, and it is primarily grown from animals that naturally carry a thick coat of hair. In this discussion, I'll focus on wool-producing farm animals, with a particular focus on dominant wool-producing animals, and also touch on non-wool farm animals for a broad comparison.

1. Wool-Producing Farm Animals

A. Lambs (Wool from Lambs)

• Primary Wool-Producing Animal: **Wool is primarily from lambs, which is a young dominant wool-producing animal.
• Common Wool-Producing Lamb Variants:
• Shropshir – Known for high-quality, long, and soft wool.
• Ramboult – Known for high wool production and good quality.
• Suffolk – Known for high wool production and good quality.