Downloads · 30 days
129
6% of all-time downloads
glm-4-9b-chat-abliterated
byroneverson/glm-4-9b-chat-abliterated
glm-4-9b-chat-abliterated is a text generation model from byroneverson. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Check out the <a href="https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated/blob/main/abliterate-glm-4-9b-chat.ipynb"jupyter notebook</a for details of how this model was abliterated from glm-4-9b-chat.
All-time downloads
2.3K
Public
Parameters
9.4B
18.9 GB on disk
Likes
14
Public
Repo makeup
Click a slice to open those files.
.safetensors18.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- chatglm
- Access
- Public
- Created
- Aug 24, 2024
- Updated
- Sep 2, 2024
- SHA
- d8967daa
Base models
Model card
From the Hugging Face model README
glm-4-9b-chat-abliterated
Version 1.1 (Updated 9/1/2024): Layer 16 is used for abliteration instead of 20. Refusal mitigation tends to work better with this layer. PCA and cosine similarity tests seem to agree.
Check out the <a href="https://huggingface.co/byroneverson/glm-4-9b-chat-abliterated/blob/main/abliterate-glm-4-9b-chat.ipynb">jupyter notebook</a> for details of how this model was abliterated from glm-4-9b-chat.
The python package "tiktoken" is required to quantize the model into gguf format. So I had to create <a href="https://huggingface.co/spaces/byroneverson/gguf-my-repo-plus-tiktoken">a fork of GGUF My Repo (+tiktoken)</a>.
- Task
- Text Generation
- Library
- transformers
- Type
- chatglm
- License
- other
- Languages
- zh, en
- Created
- Aug 24, 2024
- Updated
- Sep 2, 2024