Downloads · 30 days
0
ARWKV-7B-Preview-0.1-Pytorch
OpenMOSE/ARWKV-7B-Preview-0.1-Pytorch
ARWKV-7B-Preview-0.1-Pytorch is a machine learning model from OpenMOSE. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model only works with RWKV-Infer and RWKV-LM-RLHF. This is a completely early model. No warranty. Use at your own risk.
Access
Public
Updated Feb 18, 2025
Repo size
16.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth16.6 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Feb 12, 2025
- Updated
- Feb 18, 2025
- SHA
- 973e43b4
Base models
Model card
From the Hugging Face model README
This model only works with RWKV-Infer and RWKV-LM-RLHF. This is a completely early model. No warranty. Use at your own risk.
slightly fine-tuned CJE 900k including Deepseek R1 magpie.
v7 FLA ctx5120, 1k slided overlap training. SFT(with loss smooting=0.001) DoRA(total 0.5B parameters), Emb frozen.
if you want use reasoning mode, set system prompts below
Answer user questions in Reasoning mode.
for using
- install RWKV-Infer(see how to install)
- loadmodel(choose fp16 or fp6 or fp5 (dont choose FP8))
- need 19GB VRAM in FP16, 12GB VRAM in FP6
curl http://127.0.0.1:9000/loadmodel -X POST -H "Content-Type: application/json" -d '{"model_filename":"models/ARWKV-7B-CJE-30%.pth","model_viewname":"ARWKV-7B-CJE-30%","model_strategy":"fp16"}'
- you can use this model via OpenAI CompatibleAPI http://127.0.0.1:9000/v1 and set modelname "ARWKV-7B-CJE-30%"
- its good for sillytavern
- License
- apache-2.0
- Created
- Feb 12, 2025
- Updated
- Feb 18, 2025