Downloads · 30 days
19
23% of all-time downloads
Mistral-7B-Instruct-v0.1_asm_60e4dc58
ai-aerospace/Mistral-7B-Instruct-v0.1_asm_60e4dc58
Mistral-7B-Instruct-v0.1_asm_60e4dc58 is a text generation model from ai-aerospace. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
First model fine tune trained from https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1. Code to create this here: https://colab.research.google.com/drive/1Wsi7q1sBJlXrVZAbxhMRZuKnhSFeU9mu?usp=sharing
All-time downloads
83
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Dec 24, 2023
- Updated
- Dec 24, 2023
- SHA
- 608f6aab
Try a prompt
Base models
Model card
From the Hugging Face model README
First model fine tune trained from https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1. Code to create this here: https://colab.research.google.com/drive/1Wsi7q1sBJlXrVZAbxhMRZuKnhSFeU9mu?usp=sharing
Parameters used for fine tuning:
model_params={ "project_name": project_name, "model_name": model_name, "repo_id": username+'/'+repo_name, "block_size": block_size, "model_max_length": max_token_length, "logging_steps": -1, "evaluation_strategy": "epoch", "save_total_limit": 1, "save_strategy": "epoch", "mixed_precision": "fp16", "lr": 0.00003, "epochs": 3, "batch_size": 1, "warmup_ratio": 0.1, "gradient_accumulation": 1, "optimizer": "adamw_torch", "scheduler": "linear", "weight_decay": 0, "max_grad_norm": 1, "seed": 42, "quantization": "int4", "lora_r": 16, "lora_alpha": 32, "lora_dropout": 0.05 }
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Created
- Dec 24, 2023
- Updated
- Dec 24, 2023