Alpaca-LoRA-7B-elina

This is LoRA checkpoint fine-tuned with the following CLI. The fine-tuning process is logged in W&B dashboard. I have used DGX workstation with 8 x A100(40G).

python finetune.py \
    --base_model='elinas/llama-7b-hf-transformers-4.29' \
    --data_path='alpaca_data.json' \
    --num_epochs=20 \
    --cutoff_len=1024 \
    --group_by_length \
    --output_dir='./lora-alpaca-7b-elinas' \
    --lora_target_modules='[q_proj,k_proj,v_proj,o_proj]' \
    --lora_r=16 \
    --lora_alpha=32 \
    --batch_size=1024 \
    --micro_batch_size=37

This LoRA checkpoint is recommended to be used with transformers >= 4.29 which should be installed with the following command currently(4/30/2023).

pip install git+https://github.com/huggingface/transformers.git

Please find out the example usage and results in the accompanied notebook. For the example outputs are listed below as well.

1. Instruction: Compose an engaging travel blog post about a recent trip to Hawaii, highlighting cultural experiences and must-see attractions.

Aloha! Have you ever dreamed of exploring the beautiful tropical paradise that is Hawai'i? If so, then it’s time for your journey of discovery to begin! I recently had the privilege of embarking on an epic adventure through one of America’s most exciting destinations—and here are some of my favorite memories from the experience.

From the stunning sights of Honolulu like Diamond Head Crater to the breathtaking beauty of Maui’s Wailea coastline, there were plenty of jaw-dropping moments during this journey across five islands in fourteen days. My top pick would have to be our visit to the island of Kauai, home to iconic natural landmarks such as the Napali Coast, which was truly spectacular. The Na Pali Cliffs stretch over two thousand feet above sea level while providing impressive views of the Pacific Ocean below. It felt almost otherworldly seeing these cliffs rise straight up out of the ocean; I can hardly believe they exist in reality at all! Other memorable stops included Oahu, where we toured Pearl Harbor; Molokai with its lush greenery, waterfalls, and untamed nature; Lana'i with its unique flora and fauna; and Haleakala National Park, where we marveled at incredible vistas of the mountain range. We even managed to take part in traditional luaus, hiking volcanos, and snorkeling amidst colorful fishes and corals - needless to say, each day brought us new surprises and fresh adventures. With its amazingly diverse landscape and culture, Hawai'i offers visitors something truly special. This remarkable place has become a treasured memory for me and will remain forever close to heart.

2. Instruction: Can you help me write a resignation letter to my current employer, while leaving on good terms and expressing gratitude for the opportunities provided?

Dear [Name of Employer],

It is with both sadness and excitement that I am writing this email. After much thoughtful consideration over the last few months, I have decided to pursue other career pathways which better align with my skills and ambitions going forward. As such, it brings me great joy to inform you today that I will be moving onto new opportunities in two weeks time.

I would like to take this opportunity to thank all those who work here at XYZ Co., as they made me feel welcome and valued from day one. It has been an absolute privilege to learn so many new things under your guidance during these past several years - including the importance of teamwork, the value of integrity and how to approach problems with creativity. The experiences gained through working together in our daily tasks have helped shape my professional journey and become more effective communicator throughout. For all of this I cannot truly find words to properly convey my appreciation.

On behalf of myself and family, we wish every success for yourself, the company and everyone involved in making us happy during these times. We look back fondly upon our days spent together, and know you’ll continue making positive impacts within this world far into the future. Thank you again for everything!

3. Instruction: What factors would you consider when designing an inclusive and accessible public transportation system?

When designing a public transportation network, it is important to take into account accessibility for all users. This includes ensuring that the route networks have wheelchair ramps or lifts so people with disabilities can use them without difficulty; providing adequate bus stops along the way which are equipped with signage that displays information such as departure times and routes in order to reduce confusion amongst passengers who need assistance boarding or de-boarding; employment of friendly staff trained on customer service skills; provision of audio announcements of destination at each stop so visually impaired persons can better orient themselves within their surroundings; offering discounts for elderly individuals or those with special needs; allowing passengers with reduced mobility space to move around freely inside the vehicle; etc

4. Instruction: What are some potential implications of using a single-use plastic bottle versus a reusable bottle on both the environment and human health?

Using one single use plastics can have many environmental impacts, such as polluting waterways and oceans with trash, contributing to climate change through the production process of oil extraction, or even causing physical harm in animals due to ingestion. The use of reusable containers reduces these environmental burdens since they will not be discarded after one use unlike their disposable counterparts. From an individual level perspective, reusing bottles can help reduce waste generation and lower costs for individuals over time by eliminating the need to continually purchase more single-use items. Furthermore, there is evidence suggesting that BPA (a chemical used in most plastic bottles) may cause hormone disruption and other detrimental effects to human health at low levels which can accumulate throughout life depending upon exposure. Thus it’s important to consider switching from single-use to reusables when possible.