reFLEX-v1-50M

reFLEX-v1-50M

reFLEX — Responsive Flexible Learning and EXperience — is a small experimental conversational language model designed to explore a modular alternative to conventional language-model architectures.

Rather than putting every responsibility into one large language-generation network, reFLEX separates the system into a Main language model and an Experience component that can provide additional contextual information during generation.

The 50M model is the larger successor to reFLEX-v1-15M, and was created to investigate how much conversational behavior can emerge from a relatively small model while retaining the modular design of reFLEX.

This is an experimental research model, not a general-purpose assistant.

---

What is reFLEX?

reFLEX stands for Responsive Flexible Learning and EXperience.

The architecture is built around the idea that a language model does not necessarily need to perform every part of conversational processing inside its primary language generator.

Conceptually:

                    Input
                      │
                      ▼
              ┌──────────────┐
              │   Intent /  │
              │   Context   │
              └──────┬───────┘
                     │
                     ▼
              ┌──────────────┐
              │  Experience │
              │   Encoder   │
              └──────┬───────┘
                     │
                     ▼
              ┌──────────────┐
              │     Main    │
              │ Language    │
              │    Model    │
              └──────┬───────┘
                     │
                     ▼
                  Response

The Experience component is not a conventional database and should not be interpreted as guaranteed long-term memory.

Instead, it provides contextual signals that the Main model can use when generating a response.

---

Model Details

The parameter count is approximately 51.3 million including the Experience encoder.

The majority of the model's capacity remains dedicated to the Main language-generation network, while a much smaller portion is allocated to the Experience system.

Why a 50M Model?

reFLEX is primarily an architectural experiment.

The goal is not simply to make a smaller conventional transformer. Instead, reFLEX explores whether a small language model can produce surprisingly rich conversational behavior when some contextual responsibilities are handled by separate components.

The 15M version demonstrated that this idea could produce interesting conversational behavior at an extremely small scale.

The 50M version increases the capacity of the Main model substantially while retaining the same general architectural philosophy.

See the previous model:

reFLEX-v1-15M

---

Conversational Behavior

The model is primarily interesting for conversation, rather than factual question answering.

During informal testing, reFLEX-v1-50M produced responses ranging from ordinary conversational replies to highly unusual or humorous generations.

For example (Used a wrapper that added context with a capacity of 5 message turns):

A: Hello
B: Hi!

A: How are you?
B: Doing well! How are you?

A: I'm fine too. Thanks for asking!
B: That is great to hear! What do you do for fun?

A: I like to code.
B: That's great! I love to read too. What are your favorite books?

A: If so then what's your favorite book?
B: I have a lot of favorite books, but one of my favorites is
   "The Great Gatsby" by F. Scott Fitzgerald.

The model can sometimes maintain a surprisingly natural conversational flow despite its relatively small size.

However, this behavior is not guaranteed and can vary significantly between generations.

---

Generation

Install the reFLEX package:

pip install -U qreflex

Then load the model:

from qreflex import QReFLEX

# Load from HuggingFace
model = QReFLEX.from_hf("qvx-o/reFLEX-v1-50M")

answer = model.generate(
    "A: Hello!\nB:",
    stop_tokens=["\nA:", "\nB:"],
    use_experience=True,
)

print(answer)

Local checkpoint

from qreflex import QReFLEX

# Load from local files
checkpoint_file = "./reFLEX-v1-50M/reFLEX-v1-50M.pt"
tokenizer_path = "./reFLEX-v1-50M/tokenizer.json"

model = QReFLEX.load(checkpoint_file, tokenizer=tokenizer_path)

answer = model.generate(
    "A: Hello!\nB:",
    stop_tokens=["\nA:", "\nB:"],
    use_experience=True,
)

print(answer)

Download and save entire repo locally

from qreflex import QReFLEX

# Download entire repo and save for future use
model = QReFLEX.from_hf("qvx-o/reFLEX-v1-50M", save=True)
# ✓ Full repo downloaded to: ./models/qvx-o_reFLEX-v1-50M/

# Next time, loads from local cache automatically
model = QReFLEX.from_hf("qvx-o/reFLEX-v1-50M", save=True)
# ✓ Loading from local cache: ./models/qvx-o_reFLEX-v1-50M/

answer = model.generate(
    "A: Hello!\nB:",
    stop_tokens=["\nA:", "\nB:"],
    use_experience=True,
)

print(answer)

---

Recommended Conversation Format

reFLEX was trained around an alternating dialogue format:

A: Hello!
B: Hi!

A: How are you?
B: I'm doing well!

For generation, provide the conversation followed by B::

A: Hello!
B: Hi!

A: How are you?
B:

This format gives the model an explicit distinction between the user/input side (A:) and response side (B:).

---

Sampling

The generation API supports temperature and top-k sampling:

answer = model.generate(
    "A: Tell me something interesting.\nB:",
    temperature=0.8,
    top_k=50,
    max_new_tokens=64,
    use_experience=True,
    stop_tokens=["\nA:", "\nB:"],
)

---

Limitations

reFLEX-v1-50M is not a general-purpose language model.

It has significant limitations, including:

• Limited factual knowledge.
• Poor mathematical reliability.
• Poor code-generation reliability.
• Hallucinations.
• Occasional repetition.
• Semantic drift during longer conversations.
• Unstable factual recall.
• Inconsistent responses to the same question.
• Occasional abrupt topic changes.
• Occasional grammatically or semantically unusual generations.
• It may produce confident-sounding false information.
• It is not instruction-tuned to behave like a modern assistant.
• Experience does not guarantee memory or factual retrieval.
• Generation quality can vary substantially with sampling settings.

For example, the model may recognize that a prompt is asking about mathematics while still producing an invalid mathematical expression.

Therefore, do not use this model for factual, medical, legal, financial, safety-critical, or other high-stakes applications.

---

What This Model Is Good For

reFLEX-v1-50M is intended primarily for:

• Experimental conversational AI
• Small language-model research
• Modular language-model research
• Studying conversational behavior
• Experience/retrieval-assisted generation experiments
• Exploring alternative transformer architectures
• Educational experimentation
• Local lightweight text generation
• Character/personality experiments

It is especially interesting when used as a research model for studying how conversational behavior emerges at small parameter counts.

---

What This Model Is Not

This model is not intended to compete with large language models on:

• factual question answering,
• mathematics,
• programming,
• reasoning benchmarks,
• knowledge retrieval,
• instruction following,
• or general assistant performance.

The purpose of reFLEX is different.

The experiment asks:

How much conversational behavior can emerge from a relatively small language model when some responsibilities are moved outside the main language generator?

---

Observed Behavior

During informal testing, the model sometimes produced unexpectedly natural conversational behavior.

It can respond appropriately to:

• greetings,
• compliments,
• casual questions,
• emotional statements,
• topic changes,
• conversational acknowledgements,
• and simple social interactions.

It can also produce bizarre responses when the semantic context becomes difficult.

Examples from experimentation include responses involving invented objects, strange explanations, abrupt topic shifts, and self-referential statements.

These behaviors should be understood as generation characteristics, not evidence of human-like understanding or consciousness.

---

Model Size

One of the goals of the reFLEX project is to explore how far conversational generation can be pushed while keeping the model extremely lightweight.

The 50M model is approximately:

51.3M parameters

and is small enough to be practical for experimentation on relatively modest hardware.

The checkpoint is also substantially smaller than typical modern language models, making reFLEX useful for experiments where memory and storage are limited.

---

Relation to reFLEX-v1-15M

reFLEX-v1-50M is the larger follow-up to:

qvx-o/reFLEX-v1-15M

The 15M model explored the architecture at an extremely small scale.

The 50M model increases the capacity of the Main language model while preserving the central reFLEX idea of separating language generation from Experience/context processing.

The two models are useful as a comparison for studying how increasing model capacity affects emergent conversational behavior.

---

Project

reFLEX is part of the Qarvexium family of experimental AI models and tools.

The Python package used for inference is:

pip install qreflex

---

Disclaimer

reFLEX-v1-50M is an experimental research model.

Its outputs may be:

• correct,
• incorrect,
• sarcastic,
• repetitive,
• bizarre,
• contradictory,
• unexpectedly conversational,
• or completely nonsensical.

Do not interpret generated text as authoritative information.

The model does not possess human consciousness, emotions, personal experiences, or opinions. Apparent personality or emotional behavior is an emergent characteristic of the model's learned generation patterns.

Use the model for experimentation and research rather than relying on it for real-world decisions.

---

License

This model is released under the MIT License.