Downloads · 30 days
5
26% of all-time downloads
blueapple8259_-_TinyKo-v5-b-8bits
RichardErkhov/blueapple8259_-_TinyKo-v5-b-8bits
blueapple8259_-_TinyKo-v5-b-8bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
19
Public
Parameters
39.1M
52.8 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors52.8 MB · 90%
Parameter types
How the weights are stored.
I825.6M · 66%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
TinyKo-v5-b - bnb 8bits
- Model creator: https://huggingface.co/blueapple8259/
- Original model: https://huggingface.co/blueapple8259/TinyKo-v5-b/
Original model description:
license: mit datasets:
- maywell/korean_textbooks language:
- ko
TinyKo-v5-a모델에서 약간의 파인튜닝을 한 진행한 모델입니다.
주의: 성능이 매우 떨어지며 할루시네이션이 매우 심합니다.
모델 정보
model type: llama
hidden size: 6
hidden size: 127
num attention heads: 16
num key value heads: 4
- Type
- llama
- Created
- Oct 18, 2024
- Updated
- Oct 18, 2024