CrabfishAI_-_InstructWise2-248M-awq

Quantization made by Richard Erkhov.

Github

Discord

Request more models

InstructWise2-248M - AWQ

• Model creator: https://huggingface.co/CrabfishAI/
• Original model: https://huggingface.co/CrabfishAI/InstructWise2-248M/

Original model description:

tags:

• autotrain

• text-generation base_model: Locutusque/TinyMistral-248M datasets:

• CrabfishAI/ReasoningQuestions

• OpenAssistant/oasst_top1_2023-08-25

• nRuaif/OpenOrca-GPT3.5 widget:

• text: |- <|im_start|>user Find me a list of some nice places to visit around the world.<|im_end|>

  <|im_start|>assistant

• text: |- <|im_start|>user Tell me a story about some magical place.<|im_end|>

  <|im_start|>assistant

• text: |- <|im_start|>user Write a python code to print numbers from 1 to 100 in sequence.<|im_end|>

  <|im_start|>assistant

• text: |- <|im_start|>user What is biology?<|im_end|>

  <|im_start|>assistant

• text: >- <|im_start|>user I love taking photos of nature. Can you come up with a 3-day itinerary visiting the most photogenic places in Iceland?<|im_end|>

  <|im_start|>assistant inference: parameters: max_new_tokens: 32 repetition_penalty: 1.15 do_sample: true temperature: 0.5 top_p: 0.5 license: apache-2.0 language:

• en

---

InstructWise 470M - A virtual assistant.

• Update: We're back! with more smaller and better performing model, this time with Mistral this model performs incredibly well when considerd its size, we would strongly recommend to give this model a try.
• InstructWise with Llama2 at: CrabfishAI/InstructWise-462M

Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you!

Introduction- InstructWise is a series of model created to act as helpful virtual assistant while maintaing the memory efficiency.

Credits

• Base Model: Locutusque/TinyMistral-248M
• Dataset Used: (Mentioned in page)
• License: Apache License 2.0

Features

• Maintaining performance while being memory efficient: Ram usage- 5.6GB Vram usage- 0.6GB (approximately)
• Act as helpful virtual assistant: InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information.
• Coding: Model can perform coding as well.
• Assisting capabilities: can assist with wide rang of taskes.

Uses

InstructWise finds application in various domains, including:

• Assistance in Writing: Aid authors, bloggers, and students in drafting articles and essays.
• Chatbot Development: Power conversational agents with human-like responses.
• Prototyping and Idea Generation: Facilitate brainstorming sessions for product development.
• Personal Assistant Applications: Assist users in drafting emails and messages. and many more.

Direct Use Cases

InstructWise can be directly employed for:

1. Educational Support:

   • Assist users in learning new topics with detailed explanations and step-by-step instructions.

2. Content Creation:

   • Generate creative content based on prompts, aiding content creators in the writing process.

3. Code Assistance:

   • Provide guidance on coding queries, improve code documentation, and generate code snippets for developers.

4. Interactive Conversations:

   • Enhance chatbots or virtual assistants with informative and helpful responses for users.

5. Q&A Platforms:

   • Power question and answer platforms, offering detailed and insightful answers on various topics.

6. Technical Writing Support:

   • Assist writers and technical communicators with suggestions for clarity and informativeness.

7. Idea Expansion:

   • Facilitate the expansion and development of ideas by providing detailed insights and suggestions.

Limitation

1. Content Quality: The model's output may vary in quality, and there's a possibility it might generate content that is nonsensical, irrelevant, or grammatically incorrect.

2. Bias and Sensitivity: The model is trained on diverse data, but it may inadvertently exhibit biases or generate content that is sensitive or inappropriate. Exercise caution and review generated text before use.

3. Inappropriate Language: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.

Disclaimer

• Use with Caution: This model is a tool that should be used with caution. Always review and validate the generated text before incorporating it into any application or publication.

• Not for Critical Applications: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.

• Ongoing Improvement: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.

Recommended Prompt Format to use:

<|im_start|>user
[Your prompt here]<|im_end|>
<|im_start|>assistant