Downloads · 30 days
108
1% of all-time downloads
BigCodeLlama-92b
nisten/BigCodeLlama-92b
BigCodeLlama-92b is a text generation model from nisten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
The following models were included in the merge: ../CodeLlama-70b-Python-hf ../CodeLlama-70b-Instruct-hf
All-time downloads
11.4K
Public
Parameters
92.1B
234 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors184 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Jan 30, 2024
- Updated
- Feb 24, 2024
- SHA
- 5a3ecf5b
Try a prompt
Base models
Model card
From the Hugging Face model README
BigCodeLLama 92b LFG 🚀
Experimental 92B CodeLlaMA frankenstein to see how it benchmarks
Models Merged with base codellama/CodeLlama-70b-Instruct-hf
Models Merged
The following models were included in the merge:
- ../CodeLlama-70b-Python-hf
- ../CodeLlama-70b-Instruct-hf
Configuration
The following YAML configuration was used to produce this model:
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 69]
model:
model:
path: ../CodeLlama-70b-Instruct-hf
- sources:
- layer_range: [42, 80]
model:
model:
path: ../CodeLlama-70b-Python-hf
Gguf available here https://huggingface.co/nisten/BigCodeLlama-92b-GGUF
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- Jan 30, 2024
- Updated
- Feb 24, 2024