juwel-beryl

JUWEL Beryl

80-layer vision-language base. The required base for all 16 JUWEL GEM adapters.

Read this first: safety refusals have been removed

Beryl is abliterated — refusal directions were ablated, so it will not reliably decline harmful requests. It ships with no safety layer. If you deploy it, you are responsible for adding your own filtering, policy, and human oversight. Do not treat this as an aligned assistant model. See USE_POLICY.md.

What this is

Internal lineage: theron-base-v9 plus one capability-injection rung. Layers 0–63 are the parent's frozen weights; layers 64–79 were added and trained.

Load it

from transformers import AutoModelForImageTextToText, AutoTokenizer

model = AutoModelForImageTextToText.from_pretrained(
    "VextLabsinc/juwel-beryl", torch_dtype="auto", device_map="auto")
tok = AutoTokenizer.from_pretrained("VextLabsinc/juwel-beryl")

Use AutoModelForImageTextToText, not AutoModelForCausalLM — this is a vision-language architecture and the causal-LM class will not load it.

Footprint: ~82 GB in BF16 (2x 48 GB GPUs or better), ~41 GB at FP8, ~21 GB at NF4.

The GEM adapters

Beryl is the base for 16 domain LoRA adapters (VextLabsinc/gem-*: ruby/code, aquamarine/math, spinel/reasoning, lapis/language, bloodstone/medical, sardonyx/legal, tanzanite/finance, peridot/science, topaz/engineering, citrine/business, opal/education, jade/humanities, pearl/reconciler, plus alexandrite, tourmaline, turquoise). Each is native to this exact 80-layer geometry (layers_to_transform 0–79, r=64) and is not interchangeable with other JUWEL bases.

from peft import PeftModel
model = PeftModel.from_pretrained(model, "VextLabsinc/gem-ruby")

Evaluation

Status: PENDING. No benchmark numbers are published for this model yet, and that is a real absence rather than a hidden result.

Until 2026-07-28 the GEM adapters named a 144-layer base in their cards while being native to 80 layers, so nothing in the release was loadable as trained and no valid benchmark could be produced. Publishing Beryl is what makes the fleet runnable. Structural compatibility is verified — all 560 target modules per adapter resolve against this model's tensor index — but output-quality evaluation requires GPU time and has not been completed.

When numbers arrive they will be BF16, measured on our own weights on our own hardware, with per-sample audit trails. We do not publish a score we cannot reproduce, and we will not present quantized screening runs as headline results.

Limitations

• No refusal behavior. See the warning above. This is the single most important limitation.
• Outputs can be wrong, biased, or harmful. Not a substitute for licensed professionals in medicine, law, finance, or security.
• Unevaluated: no published capability numbers, so treat any assumption about its ability as unverified.
• The 16 added layers were trained on a smaller data budget than the frozen parent.

Intended use

Research, evaluation, and authorized professional workflows where a human remains responsible for outcomes, and where the deployer supplies their own safety layer.

Prohibited use

See USE_POLICY.md. In short: no unauthorized system access, no malware or fraud, no CSAM, no weapons development, nothing violating applicable law. Publishing weights is not permission to break the law, and Vext Labs does not endorse misuse.

Liability

Provided AS IS under LICENSE. To the maximum extent permitted by law, Vext Labs, Inc. disclaims all warranties and is not liable for damages arising from use or misuse. You are solely responsible for lawful, authorized use.

Contact

https://vextlabs.ai · https://juwel.ai · [email protected]