Downloads · 30 days
30
7% of all-time downloads
Marcoroni-70B-v1-AWQ
poisson-fish/Marcoroni-70B-v1-AWQ
Marcoroni-70B-v1-AWQ is a text generation model from poisson-fish. Use it when you need the model to write or continue text. It is set up for transformers.
This is AIDC-ai-business/Marcoroni-70B-v1 quantized to LMDeploy 4bit AWQ with the following config:
All-time downloads
445
Public
Repo size
77.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin36.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Sep 25, 2023
- Updated
- Sep 28, 2023
- SHA
- e74089cb
Try a prompt
Model card
From the Hugging Face model README
This is AIDC-ai-business/Marcoroni-70B-v1 quantized to LMDeploy 4bit AWQ with the following config:
python3 -m lmdeploy.lite.apis.auto_awq \
--model ./Marcoroni-70B-v1 \
--w_bits 4 \
--w_group_size 128 \
--work_dir ./quant
Original Model Card:
Marcoroni-70B
Model Details
- Trained by: trained by AIDC AI-Business.
- Model type: Marcoroni-70B is an auto-regressive language model based on the Llama 2 transformer architecture.
- Language(s): English
- License for Marcoroni-70B base weights: Non-Commercial Creative Commons license (CC BY-NC-4.0)
Prompting
Prompt Template for alpaca style
### Instruction:
<prompt> (without the <>)
### Response:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Sep 25, 2023
- Updated
- Sep 28, 2023