Downloads · 30 days
9
24% of all-time downloads
Pinecone-Rune-12b-Token-Surgery-Chatml-v0.1a
Nitral-Archive/Pinecone-Rune-12b-Token-Surgery-Chatml-v0.1a
Pinecone-Rune-12b-Token-Surgery-Chatml-v0.1a is a machine learning model from Nitral-Archive. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
38
Public
Parameters
12.2B
24.5 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors24.5 GB · 100%
At a glance
- Model type
- mistral
- Access
- Public
- Created
- Aug 3, 2025
- Updated
- Aug 3, 2025
- SHA
- 3ee9e75b
Base models
Model card
From the Hugging Face model README
Original base model Entropicengine/Pinecone-Rune-12b
Modified base model used for this train: Nitral-AI/Pinecone-Rune-12b-chatmlified
Only around 750 entries in rank/alpha 32 4bit-qlora at 3e-6 for 2 epochs. bs 4 grad accum 4, for ebs 16 with cosine.
Dataset here: https://huggingface.co/datasets/Nitral-AI/antirep_sharegpt
Example Notebook using l4/t4: https://huggingface.co/Nitral-AI/Pinecone-Rune-12b-Token-Surgery-Chatml/tree/main/TokenSurgeon-Example
Boring Training graph.
Starting loss: 1.74 Final loss 0.95
- Type
- mistral
- Created
- Aug 3, 2025
- Updated
- Aug 3, 2025