Downloads · 30 days
18
21% of all-time downloads
Not-WizardLM-2-7B-ov-int8
fakezeta/Not-WizardLM-2-7B-ov-int8
Not-WizardLM-2-7B-ov-int8 is a text generation model from fakezeta. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
To use with LocalAI this is an example model definition:
All-time downloads
87
Public
Repo size
7.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin7.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Apr 20, 2024
- Updated
- Apr 20, 2024
- SHA
- a7494742
Try a prompt
Model card
From the Hugging Face model README
To use with LocalAI this is an example model definition:
name: WizardLM2
backend: transformers
parameters:
model: fakezeta/Not-WizardLM-2-7B-ov-int8
context_size: 8192
threads: 6
f16: true
type: OVModelForCausalLM
prompt_cache_path: "cache"
prompt_cache_all: true
template:
use_tokenizer_template: true
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Apr 20, 2024
- Updated
- Apr 20, 2024