Downloads · 30 days
3.5K
6% of all-time downloads
Jellyfish-13B-imatrix-GGUF
duyntnet/Jellyfish-13B-imatrix-GGUF
Jellyfish-13B-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/NECOUDBFM/Jellyfish-13B
All-time downloads
54.4K
Public
Repo size
227 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf227 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Jul 2, 2024
- Updated
- Jul 3, 2024
- SHA
- bec39774
Try a prompt
Model card
From the Hugging Face model README
Quantizations of https://huggingface.co/NECOUDBFM/Jellyfish-13B
Experiment
Quants ending in "_X" are experimental quants. These quants are the same as normal quants, but their token embedding weights are set to Q8_0 except for Q6_K and Q8_0 which are set to F16. The change will make these experimental quants larger but in theory, should result in improved performance.
List of experimental quants:
- Q2_K_X
- Q4_K_M_X
- Q5_K_M_X
- Q6_K_X
- Q8_0_X
Inference Clients/UIs
From original readme
Model Details
Jellyfish-13B is a large language model equipped with 13 billion parameters. It's tailored specifically for data preprocessing tasks, including entity matching, data imputation, error detection, and schema matching.
Prompt Template
### Instruction:
<prompt> (without the <>)
### Response:
- Task
- Text Generation
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Jul 2, 2024
- Updated
- Jul 3, 2024