Downloads · 30 days
21
27% of all-time downloads
WizardLM-70B-V1.0-BF16
Thireus/WizardLM-70B-V1.0-BF16
WizardLM-70B-V1.0-BF16 is a text generation model from Thireus. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
- Model creator: WizardLM - Original model: WizardLM 70B V1.0
All-time downloads
79
Public
Parameters
69B
138 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors138 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Sep 19, 2023
- Updated
- Sep 19, 2023
- SHA
- f6c50f8e
Try a prompt
Model card
From the Hugging Face model README
WizardLM 70B V1.0 – bfloat16 (BF16)
- Model creator: WizardLM
- Original model: WizardLM 70B V1.0
Conversion process:
Use the following script to convert your local pytorch_model bin files to bfloat16 + safetensors all in one go:
- https://github.com/oobabooga/text-generation-webui/blob/main/convert-to-safetensors.py (best for sharding and float16/FP16 or bfloat16/BF16 conversion)
Example to convert WizardLM 70B V1.0 directly to bfloat16 safetensors in 10GB shards:
python convert-to-safetensors.py --bf16 ~/original/WizardLM-70B-V1.0 --output ~/float16_safetensored/WizardLM-70B-V1.0-BF16 --max-shard-size 10GB
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Sep 19, 2023
- Updated
- Sep 19, 2023