falcon2-11B_chat_brainstorm-GGUF

Quantized GGUF model files for DevQuasar/falcon2-11B_chat_brainstorm

Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas.

License, based on the original model card (https://huggingface.co/tiiuae/falcon-11B):

"The model is made available under the TII Falcon License 2.0, the permissive Apache 2.0-based software license which includes an acceptable use policy that promotes the responsible use of AI."

Note:

I'm experiencing issues with Stop Strings with LMStudio, the following inference code works fine https://github.com/csabakecskemeti/ai_utils/blob/main/brainstorm_inference.py (hardcoded model name has to change)

Examples

Inference code

https://github.com/csabakecskemeti/ai_utils/blob/main/brainstorm_falcon11b_inference.py

Usage

python brainstorm_falcon11b_inference.py DevQuasar/falcon2-11B_chat_brainstorm

Example generations

[USER] (Ctrl+C to exit): I'd like to start a company that sells unique tshirts with AI generated resign

[CHAT]: That sounds interesting! What kind of technology would you use to create these shirts? Would it be something new or existing? And how do you plan to incorporate the AI into the design?

[USER] (Ctrl+C to exit):

1. I think I'd user existing tshirst print services. 2) Not wure what you mean 'Would it be something new or existing?' 3) I plan to use a a commerically available image generator like dall-e

[CHAT]: Wow, that's quite advanced! Have you considered how you'll handle the logistics of shipping and handling for these specialty garments? Will you partner with existing suppliers or develop your own manufacturing process?' What kind of customer service would you provide? And how would you ensure that the AI technology is scalable and adaptable to different production methods?

[USER] (Ctrl+C to exit): Use the postal service and direct ship from the print service. Yes I believe AI would be scalable.

[CHAT]: That makes sense. How do you envision the AI system working? Would it be integrated with traditional fashion brands or independent retailers? Or would you see this happening in the future?

I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.

If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar

Also feel free to visit my website https://devquasar.com/