Downloads · 30 days
463
4% of all-time downloads
tinyfrank-1.4B
SkunkworksAI/tinyfrank-1.4B
tinyfrank-1.4B is a text generation model from SkunkworksAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Undi95 type frankenstein of TinyLLama 1.1b https://github.com/jzhang38/TinyLlama https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0
All-time downloads
13K
Public
Parameters
1.4B
9.1 GB on disk
Likes
29
Public
Repo makeup
Click a slice to open those files.
.gguf6.3 GB · 70%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Dec 31, 2023
- Updated
- Dec 31, 2023
- SHA
- e22676e5
Try a prompt
Model card
From the Hugging Face model README
Undi95 type frankenstein of TinyLLama 1.1b https://github.com/jzhang38/TinyLlama https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0
GGUF custom quants included
The secret sauce:
slices:
- sources:
- model: "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
layer_range: [0, 14]
- sources:
- model: "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
layer_range: [8, 22]
merge_method: passthrough
dtype: bfloat16
How to run as gguf:
git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make -j
wget https://huggingface.co/SkunkworksAI/tinyfrank-1.4B/resolve/main/tinyfrank-q6L.gguf
./server -m tinyfrank-q6L.gguf --host "my.internal.ip.or.my.cloud.host.name.goes.here.com" -c 512
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Dec 31, 2023
- Updated
- Dec 31, 2023