Downloads · 30 days
27
14% of all-time downloads
hermes-2-pro-llama-3-8b-bnb-4bit
vickiitb/hermes-2-pro-llama-3-8b-bnb-4bit
hermes-2-pro-llama-3-8b-bnb-4bit is a text generation model from vickiitb. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
This model is a 4bit quantified version of Hermes-2-Pro-Llama-3-8b and is meant to be used with toolcalls which are supported by Hermes.
All-time downloads
187
Public
Parameters
8.2B
5.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
U87.2B · 87%
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
This model is a 4bit quantified version of Hermes-2-Pro-Llama-3-8b and is meant to be used with tool_calls which are supported by Hermes.
It is faster to respond to queries using the tool_call construct even when working with external vector databases
Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: Vikas Lal Sahita
- Funded by [optional]: Self
- Shared by [optional]: [More Information Needed]
- Model type: [More Information Needed]
- Language(s) (NLP): [More Information Needed]
- License: [More Information Needed]
- Finetuned from model [optional]: [More Information Needed]
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Languages
- en
- Created
- Oct 19, 2024
- Updated
- Nov 7, 2024