h2oai

h2ogpt-32k-codellama-34b-instruct

h2oai/h2ogpt-32k-codellama-34b-instruct

h2ogpt-32k-codellama-34b-instruct is a text generation model from h2oai. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.

Same as h2oai/h2ogpt-16k-codellama-34b-instruct but with config.json modified to be 32k for embeddings, which still functions fine as 16k model and allows stretching into 32k in vLLM that otherwise cannot modify maxim…