Downloads · 30 days
207
13% of all-time downloads
BlackRiverAI/QwiVer3.6-35B-A3B-GGUF
QwiVer3.6-35B-A3B-GGUF is a image-text-to-text model from BlackRiverAI. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
207
13% of all-time downloads
All-time downloads
1.6K
Public
Repo size
92.7 GB
Likes
5
Public
Click a slice to open those files.
.gguf92.7 GB · 100%
From the Hugging Face model README
BlackRiver AI's flagship local coding + agent model
35B total · ~3B active · 262K native context · Vision · Native MTP · GGUF
BlackRiver AI · Files · A.I Joe
</div>[!IMPORTANT] BlackRiver internal verdict: QwiVer3.6-35B-A3B consistently outperforms the upstream Qwen3.6-35B-A3B in our daily-use and real-world workflow evaluation.
It became the model we keep open.
QwiVer is not a renamed quantization and it is not an untouched Qwen checkpoint behind BlackRiver branding.
It is the released result of a BlackRiver curriculum post-training → Phase 10.2 adapter selection → exact BF16 merge → MTP-aware GGUF conversion → structural and inference validation pipeline.
The target was simple: take one of the most interesting small-active MoE architectures available and push its working behavior toward the kind of model we actually want beside us all day — deliberate, persistent, code-aware, tool-minded and difficult to derail once it has a job.
The result is our daily driver.
QwiVer3.6-35B-A3B inherits an unusually efficient sparse architecture:
| QwiVer3.6-35B-A3B | |
|---|---|
| Total parameters | ~35B |
| Parameters active per token | ~3B |
| Layers | 40 |
| Experts | 256 |
| Active experts | 8 routed + 1 shared |
| Native context | 262,144 tokens |
| Modalities | Text + Vision |
| Reasoning | Thinking mode |
| Speculative decoding | Native MTP preserved |
| Primary release format | GGUF |
| Primary runtime | llama.cpp |
That is the appeal of the architecture: a 35B parameter pool behind a roughly 3B-active path.
QwiVer keeps that efficiency while changing the behavior riding on top of it.
Qwen3.6-35B-A3B is already a strong model.
That is precisely why we chose it.
BlackRiver was not trying to rescue a weak foundation. We wanted to see how far a highly capable sparse MoE could be pushed with targeted post-training aimed at actual software-engineering and agentic work instead of generic benchmark cosmetics.
The upstream checkpoint remained our control throughout development.
The release decision was made for a much less abstract reason:
When both models were available, we kept choosing QwiVer.
For BlackRiver's day-to-day use, QwiVer is the stronger working model.
Same exceptional sparse architecture. Different behavior.
The superiority claim above refers to BlackRiver's internal A/B evaluation and sustained daily use, not to imported upstream benchmark numbers.
We do not relabel Qwen's published scores as QwiVer scores.
That is the shortest description after using QwiVer as a daily model.
Not because a ~3B-active local MoE suddenly has the knowledge coverage, compute budget or absolute ceiling of frontier-scale systems.
The comparison is about working behavior:
That behavioral character is the reason QwiVer replaced upstream Qwen3.6-35B-A3B in our own daily workflow.
[!NOTE] "GPT-5.6 Sol / Fable 5 feeling" is BlackRiver's subjective behavioral shorthand from daily use. It is not a claim of benchmark equivalence, identical capability, endorsement, or affiliation.
QwiVer is most at home when it has context, tools and an actual job.
Codebase navigation, multi-file reasoning, implementation, refactoring, debugging and iterative engineering where the model must maintain a coherent picture of a real project.
OpenCode-style environments, shell agents, MCP tools, local OpenAI-compatible harnesses, browser/tool workflows and systems where the model must continue after the first answer.
The native 262,144-token context window gives QwiVer room for large repositories, technical documents, logs and persistent task state.
Pair the language-model GGUF with the supplied BF16 multimodal projector for compatible vision input.
QwiVer is built for the idea that a serious working model can live on your own machine, behind your own tools, with your own files, without renting every token.
The public release descends from the selected Phase 10.2 curriculum adapter.
| Training / release property | Value |
|---|---|
| Curriculum examples | 1,531 |
| Training tokens | 3,999,924 |
| Optimizer steps | 383 |
| Base precision | BF16 |
| Adapter strategy | LoRA |
| Selected adapter | Phase 10.2 |
| Release strategy | Exact adapter merge into BF16 base |
| Native context retained | 262,144 tokens |
The adapter is not required at inference time.
For the public release, Phase 10.2 was merged directly into the exact BF16 language-model base before GGUF conversion.
The model you download is therefore the merged QwiVer model, not an upstream Qwen quant with an external adapter bolted on at runtime.
Qwen3.6-35B-A3B BF16 foundation
│
▼
BlackRiver curriculum
post-training
│
▼
Phase 10.2 LoRA
│
▼
exact BF16 merge
│
▼
MTP-aware GGUF conversion
│
▼
structural + inference validation
│
▼
QwiVer3.6-35B-A3B
Every public QwiVer GGUF descends from the merged BlackRiver checkpoint.
That distinction matters.
QwiVer inherits Qwen3.6's sparse Mixture-of-Experts design.
Instead of activating the entire ~35B parameter pool for each token, the router selects a much smaller expert path.
| Architecture property | Value |
|---|---|
| Total parameters | ~35B |
| Activated parameters | ~3B |
| Layers | 40 |
| Experts | 256 |
| Routed experts active | 8 |
| Shared experts active | 1 |
| Native context | 262,144 |
| Vision | Yes |
| MTP | Preserved |
Large pool. Small active path.
That is what makes QwiVer especially interesting for high-memory local systems: the model has a much larger parameter reservoir than its per-token active compute would suggest.
Pick the footprint. Keep the model.
| File | Approx. size | BlackRiver positioning |
|---|---|---|
QwiVer3.6-35B-A3B-UD-Q2_K_XL.gguf | 12.57 GB | Minimum memory |
QwiVer3.6-35B-A3B-UD-Q3_K_XL.gguf | 17.23 GB | Lightweight |
QwiVer3.6-35B-A3B-UD-Q4_K_XL.gguf | 22.85 GB | BlackRiver default |
QwiVer3.6-35B-A3B-UD-Q8_K_XL.gguf | 39.10 GB | Maximum quantized fidelity |
For most machines with enough memory, start with:
QwiVer3.6-35B-A3B-UD-Q4_K_XL.gguf
Q4_K_XL is the BlackRiver default because it keeps a strong fidelity/footprint balance while leaving meaningful room for KV cache and long-context operation.
Choose Q8 when memory is abundant and preserving the merged model as faithfully as practical matters more than footprint.
QwiVer retains the multimodal architecture.
Use:
mmproj-QwiVer3.6-BF16.gguf
alongside the selected QwiVer language-model GGUF.
For text-only operation the projector is not required.
The public GGUF releases preserve the Multi-Token Prediction components required by compatible modern llama.cpp builds.
BlackRiver's release validation verified the expected MTP tensors in each production quantization.
A conservative starting point:
--spec-type draft-mtp
--spec-draft-n-max 2
Speculative-decoding gains vary by hardware, backend, workload and sampling configuration, so measure it on the machine that will actually run the model.
This is a practical BlackRiver baseline, not a universal optimum:
ctx-size = 262144
parallel = 1
n-gpu-layers = all
flash-attn = on
cache-type-k = q8_0
cache-type-v = q8_0
temp = 0.6
top-p = 0.95
top-k = 20
min-p = 0.0
spec-type = draft-mtp
spec-draft-n-max = 2
For coding and agentic work, the 0.6 / 0.95 / 20 sampling profile is a strong place to begin.
llama-server.exe `
-m ".\QwiVer3.6-35B-A3B-UD-Q4_K_XL.gguf" `
--mmproj ".\mmproj-QwiVer3.6-BF16.gguf" `
-ngl 999 `
-fa on `
--jinja `
-c 262144 `
-np 1 `
--cache-type-k q8_0 `
--cache-type-v q8_0 `
--spec-type draft-mtp `
--spec-draft-n-max 2 `
--temp 0.6 `
--top-p 0.95 `
--top-k 20 `
--min-p 0.0
For text-only inference, remove the --mmproj argument.
A 262K architectural context limit does not mean every hardware configuration can practically allocate a 262K KV cache. Size context for the memory available on the target system.
QwiVer retains Qwen3.6's reasoning behavior and can emit Qwen-style thinking blocks when the selected template/runtime enables them.
For difficult repository work, planning, debugging and multi-step agentic tasks, this is generally how BlackRiver uses the model.
For low-latency conversational work, direct/non-thinking operation can still make sense.
QwiVer is designed to sit behind systems such as:
The model is especially compelling when the runtime can give it real tools and real state instead of forcing every task through a chat-only interface.
QwiVer's development, merge, conversion and daily local evaluation were built around BlackRiver's AMD Strix Halo workstation:
llama.cpp Vulkan for production-style local GGUF inferenceThe GGUF release itself is not AMD-specific.
Compatible llama.cpp deployments can target Vulkan, CUDA, Metal, CPU and other supported backends.
We care about benchmark numbers.
We care more about whether the model survives real work.
BlackRiver evaluates QwiVer through a mixture of structural validation, controlled comparisons and repeated practical use:
QwiVer3.6-35B-A3B is the BlackRiver winner over upstream Qwen3.6-35B-A3B for our daily coding and agentic workflows.
That is why this model exists and why this is the version we release.
We intentionally do not copy upstream Qwen benchmark numbers into a table and pretend they are QwiVer results.
Any future public head-to-head numbers should be run under matched conditions:
same task · same harness · same runtime · same quantization class · same context · same sampler · same hardware
Until then, the claim on this card is exactly what it says: a BlackRiver internal A/B + sustained daily-use verdict.
Post-training changes behavior.
QwiVer should not be expected to reproduce upstream Qwen's exact response style, prioritization, refusal boundaries or decision patterns.
That is intentional.
The point of QwiVer is not to preserve every behavior of the control model. The point is to produce the BlackRiver version we would rather run.
Greater willingness to act does not make a model automatically correct, however. Tool-enabled deployments should still use appropriate filesystem permissions, sandboxes, backups, command review and network boundaries.
QwiVer can still:
Do not treat it as the sole authority for high-stakes medical, legal, financial, security or safety-critical decisions.
The more autonomy you give a model, the more important the surrounding engineering becomes.
| Stage | Model / artifact |
|---|---|
| Upstream foundation | Qwen/Qwen3.6-35B-A3B |
| Training base | unsloth/Qwen3.6-35B-A3B |
| BlackRiver adapter | Phase 10.2 curriculum LoRA |
| Merge | Exact BF16 merge |
| Release | QwiVer3.6-35B-A3B GGUF family |
| Vision projector | mmproj-QwiVer3.6-BF16.gguf |
| Runtime target | llama.cpp |
Architecture, pretrained/post-trained foundation, multimodal system and the original Qwen3.6-35B-A3B release.
Training / BF16 workflow and ecosystem contributions used in the QwiVer development pipeline.
GGUF inference, multimodal runtime and MTP-capable local execution.
Curriculum design, post-training, Phase 10.2 selection, evaluation, exact BF16 merge, MTP-preserving release engineering, quantization, validation and publication.
Creator: A.I Joe
Publisher: BlackRiver AI Ltd
Download the GGUF that fits your machine. Keep the weights local. Give it tools. Give it a job.
Local model. Frontier instincts.
</div>