flushnet-local-llama-3.1-8b-q4km-layers

Flushnet Local Llama 3.1 8B Instruct Q4_K_M Layers

Built with Llama.

This repository contains a Mesh-LLM layer package derived from a locally provisioned Meta Llama 3.1 8B Instruct Q4_K_M GGUF model. It is intended for Mesh-LLM-compatible runtimes that support model-package.json and per-layer GGUF artifacts.

Contents

• model-package.json — package manifest
• shared/ — metadata, embeddings, and output tensors
• layers/ — 32 per-layer GGUF artifacts

This is not a conventional single-file GGUF download. Use it with a compatible Mesh-LLM package-aware runtime. The original monolithic GGUF source file is not included in this repository.

Provenance

The package was assembled locally from a Meta Llama 3.1 8B Instruct Q4_K_M GGUF source. The original acquisition location was not preserved in the local package metadata. The manifest retains artifact hashes for the published package.

License and acceptable use

This repository distributes a quantized derivative of Meta Llama 3.1. Use, redistribution, and any derived distribution are governed by the Meta Llama 3.1 Community License Agreement and the Meta Llama Acceptable Use Policy. A copy of the community license is included in LICENSE.

By downloading or using these files, you are responsible for complying with the applicable Llama license and acceptable use policy. This repository is provided without warranty.

Compatibility

The package was prepared for AI-MAX / Mesh-LLM experiments. Verify runtime compatibility and available memory before deployment. Remote CPU-backed storage is not native GPU memory; required data must be staged into local Metal or GPU memory for inference.