Downloads · 30 days
146
25% of all-time downloads
dougeeai/AtomicFission-7B-v1-GGUF
AtomicFission-7B-v1-GGUF is a machine learning model from dougeeai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF quantized versions of AtomicFission-7B-v1 for efficient CPU/GPU inference.
Downloads · 30 days
146
25% of all-time downloads
All-time downloads
587
Public
Repo size
38.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf38.6 GB · 100%
From the Hugging Face model README
GGUF quantized versions of AtomicFission-7B-v1 for efficient CPU/GPU inference.
These are GGUF format quantizations of AtomicFission-7B-v1, a Mistral-7B model fine-tuned on publicly available nuclear documentation. The model specializes in nuclear engineering topics including reactor physics, safety systems, and operational procedures.
| Filename | Size | Quality | Use Case | RAM Required |
|---|---|---|---|---|
| AtomicFission-7B-v1-Q8_0.gguf | 7.7GB | Near lossless | Maximum quality, research | ~8.5GB |
| AtomicFission-7B-v1-Q6_K.gguf | 5.9GB | Very High | Quality-focused deployment | ~6.5GB |
| AtomicFission-7B-v1-Q5_K_M.gguf | 5.1GB | High - Recommended | Best balance | ~5.5GB |
| AtomicFission-7B-v1-Q5_K_S.gguf | 5.0GB | High | Slightly faster than K_M | ~5.5GB |
| AtomicFission-7B-v1-Q4_K_M.gguf | 4.3GB | Good - Faster than Q5 | Standard deployment | ~5GB |
| AtomicFission-7B-v1-Q4_K_S.gguf | 4.1GB | Good | Faster inference | ~4.5GB |
| AtomicFission-7B-v1-Q3_K_M.gguf | 3.5GB | Acceptable | Limited resources | ~4GB |
| AtomicFission-7B-v1-Q2_K.gguf | 2.7GB | Low | Maximum compression | ~3.5GB |
# Download a model
wget https://huggingface.co/dougeeai/AtomicFission-7B-v1-GGUF/resolve/main/AtomicFission-7B-v1-Q5_K_M.gguf
# Run inference
./main -m AtomicFission-7B-v1-Q5_K_M.gguf \
-p "Question: What is reactor criticality?\nAnswer:" \
-n 200 --gpu-layers 35
Create a Modelfile:
FROM ./AtomicFission-7B-v1-Q5_K_M.gguf
TEMPLATE """Question: {{ .Prompt }}
Answer: """
Then: ollama create atomicfission -f Modelfile
Strengths:
Optimal Prompt Format:
Question: [Your nuclear engineering question]
Answer:
Inference speed scales inversely with model size. Q4_K variants offer the best speed/quality trade-off for most users.
This model is for educational and research purposes only. It should NOT be used for:
The model may hallucinate technical details. Always verify information with authoritative sources and qualified nuclear professionals.
This is an independent personal project not affiliated with any government agency, company, or employer.
Apache-2.0 (inherited from Mistral-7B base model)
If you use this model in research, please cite:
@misc{atomicfission2024,
title={AtomicFission-7B-v1: A Nuclear Reactor Operations Language Model},
author={dougeeai},
year={2024},
publisher={HuggingFace}
}
Full model card and transformers format: dougeeai/AtomicFission-7B-v1