Downloads · 30 days
78
1% of all-time downloads
lodrick-the-lafted/Grafted-Hermetic-Platypus-B-2x7B
Grafted-Hermetic-Platypus-B-2x7B is a text generation model from lodrick-the-lafted. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<img src=https://huggingface.co/lodrick-the-lafted/Grafted-Hermetic-Platypus-B-2x7B/resolve/main/ghp.png
Downloads · 30 days
78
1% of all-time downloads
All-time downloads
10K
Public
Parameters
12.9B
25.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors25.8 GB · 100%
From the Hugging Face model README
<img src=https://huggingface.co/lodrick-the-lafted/Grafted-Hermetic-Platypus-B-2x7B/resolve/main/ghp.png>
MoE merge of
<br /> <br />Both the default Mistral-Instruct tags and Alpaca are fine, so either:
<s>[INST] {sys_prompt} {instruction} [/INST]
or
{sys_prompt}
### Instruction:
{instruction}
### Response:
The tokenizer default is Alpaca this time around.
<br /> <br />from transformers import AutoTokenizer
import transformers
import torch
model = "lodrick-the-lafted/Grafted-Hermetic-Platypus-A-2x7B"
tokenizer = AutoTokenizer.from_pretrained(model)
pipeline = transformers.pipeline(
"text-generation",
model=model,
model_kwargs={"torch_dtype": torch.bfloat16},
)
messages = [{"role": "user", "content": "Give me a cooking recipe for an orange pie."}]
prompt = pipeline.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_p=0.95)
print(outputs[0]["generated_text"])
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 64.65 |
| AI2 Reasoning Challenge (25-Shot) | 59.47 |
| HellaSwag (10-Shot) | 82.95 |
| MMLU (5-Shot) | 62.15 |
| TruthfulQA (0-shot) | 61.49 |
| Winogrande (5-shot) | 77.43 |
| GSM8k (5-shot) | 44.43 |