Downloads · 30 days
17
20% of all-time downloads
failspy_Phi-3-mini-4k-geminified-2_2bpw_exl2
Zoyd/failspy_Phi-3-mini-4k-geminified-2_2bpw_exl2
failspy_Phi-3-mini-4k-geminified-2_2bpw_exl2 is a text generation model from Zoyd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Exllamav2 quant (exl2 / 2.2 bpw) made with ExLlamaV2 v0.1.3
All-time downloads
86
Public
Repo size
1.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- phi3
- Access
- Public
- Created
- Jun 4, 2024
- Updated
- Jun 4, 2024
- SHA
- f220ee48
Model card
From the Hugging Face model README
Exllamav2 quant (exl2 / 2.2 bpw) made with ExLlamaV2 v0.1.3
Other EXL2 quants:
| Quant | Model Size | lm_head |
|---|---|---|
| <center>2.2</center> | <center>1217 MB</center> | <center>6</center> |
| <center>2.5</center> | <center>1342 MB</center> | <center>6</center> |
| <center>3.0</center> | <center>1558 MB</center> | <center>6</center> |
| <center>3.5</center> | <center>1774 MB</center> | <center>6</center> |
| <center>3.75</center> | <center>1882 MB</center> | <center>6</center> |
| <center>4.0</center> | <center>1990 MB</center> | <center>6</center> |
| <center>4.25</center> | <center>2099 MB</center> | <center>6</center> |
| <center>5.0</center> | <center>2423 MB</center> | <center>6</center> |
| <center>6.0</center> | <center>2870 MB</center> | <center>8</center> |
| <center>6.5</center> | <center>3089 MB</center> | <center>8</center> |
| <center>8.0</center> | <center>3620 MB</center> | <center>8</center> |
Phi-3-mini-128k-instruct- abliterated-v3 -geminified
Credit to u/Anduin1357 on reddit for the name who wrote this comment
My Jupyter "cookbook" to replicate the methodology can be found here, refined library coming soon
What's this?
Well, after my abliterated models, I figured I should cover all the possible ground of such work and introduce a model that acts like the polar opposite of them. This is the result of that, and I feel it lines it up in performance to a certain search engine's AI model series.
Summary
This is microsoft/Phi-3-mini-128k-instruct with orthogonalized bfloat16 safetensor weights, generated with a refined methodology based on that which was described in the preview paper/blog post: 'Refusal in LLMs is mediated by a single direction' which I encourage you to read to understand more.
This model has been orthogonalized to act more like certain rhymes-with-Shmemini models.
- Task
- Text Generation
- Library
- transformers
- Type
- phi3
- License
- mit
- Languages
- multilingual
- Created
- Jun 4, 2024
- Updated
- Jun 4, 2024