Downloads · 30 days
14
21% of all-time downloads
sxiong/TG-LLM-TGQA-Story2TG-Llama-2-13B-LoRA
TG-LLM-TGQA-Story2TG-Llama-2-13B-LoRA is a text generation model from sxiong. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as mit.
TG-LLM consists of supervised fine-tuned models designed for temporal reasoning with large language models (LLMs). It includes two primary tasks:
Downloads · 30 days
14
21% of all-time downloads
All-time downloads
68
Public
Repo size
682 MB
Likes
0
Public
Click a slice to open those files.
.safetensors682 MB · 100%
From the Hugging Face model README
TG-LLM consists of supervised fine-tuned models designed for temporal reasoning with large language models (LLMs). It includes two primary tasks:
Base Model: meta-llama/Llama-2-13b-chat-hf
LoRA Configuration:
lora_alpha: 8r: 8target_modules: ["q_proj", "k_proj", "o_proj", "v_proj"]bias: "none"For more details, please visit the TG-LLM GitHub repository.
import torch
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base_id = "meta-llama/Llama-2-13b-chat-hf"
adapter_id = "sxiong/TG-LLM-TGQA-Story2TG-Llama-2-13B-LoRA"
tokenizer = AutoTokenizer.from_pretrained(adapter_id)
base_model = AutoModelForCausalLM.from_pretrained(
base_id,
torch_dtype=torch.bfloat16,
device_map="auto",
)
model = PeftModel.from_pretrained(base_model, adapter_id)
model.eval()
@inproceedings{xiong2024large,
title={Large language models can learn temporal reasoning},
author={Xiong, Siheng and Payani, Ali and Kompella, Ramana and Fekri, Faramarz},
booktitle={Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
pages={10452--10470},
year={2024}
}