Downloads · 30 days
17
27% of all-time downloads
LWM-Text-Chat-256K-AWQ
LoneStriker/LWM-Text-Chat-256K-AWQ
LWM-Text-Chat-256K-AWQ is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
64
Public
Parameters
6.7B
3.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.9 GB · 100%
Parameter types
How the weights are stored.
I326.5B · 96%
Try a prompt
Model card
From the Hugging Face model README
<br>
<br>
LWM-Text-Chat-256K Model Card
Model details
Model type: LWM-Text-Chat-256K is an open-source model trained from LLaMA-2 on a subset of Books3 filtered data. It is an auto-regressive language model, based on the transformer architecture.
Model date: LWM-Text-Chat-256K was trained in December 2023.
Paper or resources for more information: https://largeworldmodel.github.io/
License
Llama 2 is licensed under the LLAMA 2 Community License, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
Where to send questions or comments about the model: https://github.com/LargeWorldModel/lwm/issues
Training dataset
- 37K subset of Books3 documents with 200K to 500K tokens
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Feb 17, 2024
- Updated
- Feb 17, 2024