Downloads · 30 days
0
AI-LA
AlessandraAbreu/AI-LA
AI-LA is a machine learning model from AlessandraAbreu. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Most AI research focuses on adding capabilities to LLMs. In contrast, little has been done on how to remove these capabilities from pre-trained LLMs.
Access
Public
Updated Nov 26, 2023
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
Other1.5 KB · 63%
At a glance
- License
- mit
- Access
- Public
- Created
- Nov 26, 2023
- Updated
- Nov 26, 2023
- SHA
- 08421795
Model card
From the Hugging Face model README
AI-LA: Aphasia in Artificial Intelligence Large Language Models
Most AI research focuses on adding capabilities to LLMs. In contrast, little has been done on how to remove these capabilities from pre-trained LLMs.
Finding an approach that scores well on specificity and generalization
A model editing technique scores well on specificity if related facts do not change after the model is edited. A technique scores well on generalization if the fact change is robust to adding or changing the context.
There are three types of approaches to updating parameters - fine-tuning, hyper-networks, and causal tracking.
In this model, I will test all three types!
MODEL GOAL
Reproduce
- Fine-tuning
- Hyper-networks
- causal tracking
Talk to me: https://www.linkedin.com/in/alessandra-faria-b0816053/
- License
- mit
- Created
- Nov 26, 2023
- Updated
- Nov 26, 2023