Downloads · 30 days
6
9% of all-time downloads
Nous-Hermes-llama-2-7b-pruned50-quant-pt
mgoin/Nous-Hermes-llama-2-7b-pruned50-quant-pt
Nous-Hermes-llama-2-7b-pruned50-quant-pt is a text generation model from mgoin. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
70
Public
Repo size
27 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Oct 25, 2023
- Updated
- Oct 25, 2023
- SHA
- 0ada6c4e
Try a prompt
Model card
From the Hugging Face model README
python ~/code/sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py NousResearch/Nous-Hermes-llama-2-7b open_platypus --recipe ~/code/sparseml/src/sparseml/transformers/sparsification/obcq/llama-hermes-skip5-50p.yaml --eval wikitext2 --save True
2023-10-25 09:52:15 sparseml.modifiers.obcq.utils.helpers INFO Evaluating perplexity...
2023-10-25 09:52:43 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.5703, device='cuda:0')
2023-10-25 09:53:17 sparseml.modifiers.obcq.utils.helpers INFO tensor(8.2167, device='cuda:0')
2023-10-25 09:53:49 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.5748, device='cuda:0')
2023-10-25 09:54:21 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7005, device='cuda:0')
2023-10-25 09:54:53 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.5876, device='cuda:0')
2023-10-25 09:55:25 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.5569, device='cuda:0')
2023-10-25 09:55:56 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7773, device='cuda:0')
2023-10-25 09:56:27 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7879, device='cuda:0')
2023-10-25 09:56:59 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7593, device='cuda:0')
2023-10-25 09:57:31 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.6666, device='cuda:0')
2023-10-25 09:57:55 sparseml.modifiers.obcq.utils.helpers INFO tensor(7.7227, device='cuda:0')
2023-10-25 09:57:55 sparseml.modifiers.obcq.utils.helpers INFO Perplexity: 7.722705
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Oct 25, 2023
- Updated
- Oct 25, 2023