Downloads · 30 days
9
13% of all-time downloads
Not-WizardLM-2-7B-ov-int4
fakezeta/Not-WizardLM-2-7B-ov-int4
Not-WizardLM-2-7B-ov-int4 is a text generation model from fakezeta. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
To use with LocalAI this is an example model definition:
All-time downloads
68
Public
Repo size
4.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin4.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Apr 20, 2024
- Updated
- Apr 20, 2024
- SHA
- c4dba9b0
Try a prompt
Model card
From the Hugging Face model README
To use with LocalAI this is an example model definition:
name: WizardLM2
backend: transformers
parameters:
model: fakezeta/Not-WizardLM-2-7B-ov-int4
context_size: 8192
threads: 6
f16: true
type: OVModelForCausalLM
prompt_cache_path: "cache"
prompt_cache_all: true
template:
use_tokenizer_template: true
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Apr 20, 2024
- Updated
- Apr 20, 2024