Downloads · 30 days
20
25% of all-time downloads
Llama3-70B-Fusion-ChatQA-Chinese
CaceAI/Llama3-70B-Fusion-ChatQA-Chinese
Llama3-70B-Fusion-ChatQA-Chinese is a text generation model from CaceAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Llama3-70B-Fusion-ChatQA-Chinese is a merge of the following models using mergekit: shenzhi-wang/Llama3-70B-Chinese-Chat nvidia/Llama3-ChatQA-1.5-70B
All-time downloads
79
Public
Parameters
70.6B
141 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors141 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- May 15, 2024
- Updated
- May 15, 2024
- SHA
- 7254ba6e
Try a prompt
Model card
From the Hugging Face model README
Llama3-70B-Fusion-ChatQA-Chinese
Llama3-70B-Fusion-ChatQA-Chinese is a merge of the following models using mergekit:
Configuration
```yaml models:
- model: meta-llama/Meta-Llama-3-70B
- model: shenzhi-wang/Llama3-70B-Chinese-Chat parameters: density: 0.5 weight: 0.6
- model: nvidia/Llama3-ChatQA-1.5-70B parameters: density: 0.5 weight: 0.4 merge_method: dare_ties base_model: meta-llama/Meta-Llama-3-70B parameters: int8_mask: true dtype: bfloat16 ```
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- May 15, 2024
- Updated
- May 15, 2024