Downloads · 30 days
15
23% of all-time downloads
Mistral-7B-v0.1-sharded
kkboy1/Mistral-7B-v0.1-sharded
Mistral-7B-v0.1-sharded is a text generation model from kkboy1. Use it when you need the model to write or continue text. It is set up for transformers.
Just a version of https://huggingface.co/mistralai/Mistral-7B-v0.1 which is sharded to 2GB as to reduce the ram required when loading.
All-time downloads
65
Public
Repo size
14.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Nov 3, 2023
- Updated
- Nov 3, 2023
- SHA
- 1d6658d9
Try a prompt
Model card
From the Hugging Face model README
Just a version of https://huggingface.co/mistralai/Mistral-7B-v0.1 which is sharded to 2GB as to reduce the ram required when loading.
original_base_model: MistralForCausalLM = AutoModelForCausalLM.from_pretrained( pretrained_model_name_or_path="mistralai/Mistral-7B-v0.1", device_map="auto", torch_dtype=torch.float16, offload_folder="offload", trust_remote_code=True, low_cpu_mem_usage=True )
original_base_model.save_pretrained( save_directory="kkboy1/Mistral-7B-v0.1-sharded", max_shard_size="2GB", push_to_hub=True )
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Nov 3, 2023
- Updated
- Nov 3, 2023