Skip to content

nikita-sh

LLMLingua__NousResearch-Llama-2-7b-inf

nikita-sh/LLMLingua__NousResearch-Llama-2-7b-inf

LLMLingua__NousResearch-Llama-2-7b-inf is a text generation model from nikita-sh. Use it when you need the model to write or continue text. It is set up for transformers.

https://github.com/microsoft/LLMLingua https://llmlingua.com/ To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with mini…

Downloads · 30 days

10

3% of all-time downloads

All-time downloads

379

Public

Parameters

6.7B

41.7 GB on disk

Likes

2

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin27 GB · 67%

Parameter types

How the weights are stored.

F166.7B · 100%

Try a prompt

Task
Text Generation
Library
transformers
Type
llama
Languages
en
Created
Feb 2, 2024
Updated
Feb 6, 2024