Downloads · 30 days
12
2% of all-time downloads
ausboss/llama7b-wizardlm-unfiltered-4bit-128g
llama7b-wizardlm-unfiltered-4bit-128g is a text generation model from ausboss. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
12
2% of all-time downloads
All-time downloads
762
Public
Repo size
4 GB
Likes
6
Public
Click a slice to open those files.
.safetensors4 GB · 100%
From the Hugging Face model README
Lora fine tune trained on this dataset
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{data_point["instruction"]}
### Response:
{data_point["output"]}
CUDA_VISIBLE_DEVICES=0 python llama.py model c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors 4bit-128g.safetensors