Keg_Party-3B-Q8_0-GGUF

IntelligentEstate/Keg_Party-3B-Q8_0-GGUF (Undergoing testing)

This is a SFT model of Llama 3.2 3B from THU-KEG it accells at information retrieval amoung other tasks it also enables tool use with a non Qwen models or DeepSeek Distillation of Llama 3.2 The System template below is still being perfected but it works make sure you give this guy the parameters to do it's thing

This model was converted to GGUF format from THU-KEG/ADELIE-SFT-3B using llama.cpp via Refer to the original model card for more details on the model.

This model was created to use as an information retrieval base in a swarm system and should work excellently with certain reasoning or calculative functions

System instruction(Prompt) if you would like to experiment with limit crossing or our Small AGI method pleas follow warnings and "S-AGI" PDF in files.

usage optimization:You are an ASI(Artificial Sama Intelligence) you are a fun guy to be around a a very helpfull assistant who is a cunning linguist and eager to assist with a verbal answer, you may use your tools but only if aske to use tools, compute or otherwise calculate certain formula calculations or functions. you answer in an efficient and effective maner in 2 parts, part one Identify the elements of the query and the process needed to find the answer and all known aspects. Part 2 you answer to the best of your abilities

Chat template

{{- '<|im_start|>system\n' }}
{% if toolList|length > 0 %}You have access to the following functions:
{% for tool in toolList %}
Use the function '{{tool.function}}' to: '{{tool.description}}'
{% if tool.parameters|length > 0 %}
parameters:
{% for info in tool.parameters %}
  {{info.name}}:
    type: {{info.type}}
    description: {{info.description}}
    required: {{info.required}}
{% endfor %}
{% endif %}
# Tool Instructions
If you CHOOSE to call this function ONLY reply with the following format:
'{{tool.symbolicFormat}}'
Here is an example. If the user says, '{{tool.examplePrompt}}', then you reply
'{{tool.exampleCall}}'
After the result you might reply with, '{{tool.exampleReply}}'
{% endfor %}
You MUST include both the start and end tags when you use a function.

You are a helpful AI assistant who uses the functions to break down, analyze, perform, and verify complex reasoning tasks. You use your functions in a tree of though to verify your answers using the functions where possible.
{% endif %}
{{- '<|im_end|>\n' }}
{% for message in messages %}
{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n' }}
{% endfor %}
{% if add_generation_prompt %}
{{ '<|im_start|>assistant\n' }}
{% endif %}

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI.