scaled-llama-7b-lora-16k-rp2

jordiclive/scaled-llama-7b-lora-16k-rp2

scaled-llama-7b-lora-16k-rp2 is a text generation model from jordiclive. Use it when you need the model to write or continue text. It is set up for transformers.

- huggyllama/llama-7b Trained on Packed 16k sequences of the RedPajama dataset for 1 Epoch. - Merged Model. If require LoRA parameters/config, they are in the adapter folder.

Downloads · 30 days

2% of all-time downloads

All-time downloads

455

Public

Repo size

27.3 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin13.8 GB · 100%

At a glance

Task: Text Generation
Library: transformers
Model type: llama
Access: Public
Created: Jul 12, 2023
Updated: Jul 13, 2023
SHA: 2b634599

Try a prompt

Datasets

togethercomputer/RedPajama-Data-1T-Sample

Model card

From the Hugging Face model README

Linear Scaled RoPE LLama LoRA 16k

import torch
from transformers import LlamaTokenizerFast, AutoModelForCausalLM

model_name = "jordiclive/scaled-llama-7b-lora-16k-rp2"


model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype=torch.float16,trust_remote_code=True
)
tokenizer = LlamaTokenizerFast.from_pretrained(
        model_name)


tokenizer.model_max_length = 16384
tokenizer.pad_token = tokenizer.eos_token
model.max_sequence_length = tokenizer.model_max_length

huggyllama/llama-7b Trained on Packed 16k sequences of the RedPajama dataset for 1 Epoch.
Merged Model. If require LoRA parameters/config, they are in the adapter folder.

Task: Text Generation
Library: transformers
Type: llama
Created: Jul 12, 2023
Updated: Jul 13, 2023