Downloads · 30 days
3
10% of all-time downloads
SOLAR-10.7B-v1.0-Instruct-gguf
myunghoonse/SOLAR-10.7B-v1.0-Instruct-gguf
SOLAR-10.7B-v1.0-Instruct-gguf is a text generation model from myunghoonse. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
31
Public
Repo size
21.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Aug 11, 2024
- Updated
- Aug 11, 2024
- SHA
- 3bbf73cb
Model card
From the Hugging Face model README
SOLAR-10.7B-v1.0-Instruct-gguf
Model Details
Model Developers
- myeonghoon kim
Model Architecture
- SOLAR-10.7B-v1.0-Instruct-gguf is an auto-regressive language model based on the LLaMA2 transformer architecture.
- This model is converted to GGUF format.
Base Model
Training Dataset
Model comparisons1
Ko-LLM leaderboard(11/23; link)
| Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|---|---|---|---|---|---|---|
| [...your_model_name...] | NaN | NaN | NaN | NaN | NaN | NaN |
Model comparisons2
AI-Harness evaluation; link
| Model | Copa | Copa | HellaSwag | HellaSwag | BoolQ | BoolQ | Sentineg | Sentineg |
|---|---|---|---|---|---|---|---|---|
| 0-shot | 5-shot | 0-shot | 5-shot | 0-shot | 5-shot | 0-shot | 5-shot | |
| SOLAR-10.7B-v1.0-Instruct | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
Implementation Code
### KO-Platypus
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
repo = "[...your_model_repo...]"
OpenOrca = AutoModelForCausalLM.from_pretrained(
repo,
return_dict=True,
torch_dtype=torch.float16,
device_map='auto'
)
OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- ko
- Created
- Aug 11, 2024
- Updated
- Aug 11, 2024