Downloads · 30 days
0
kittn/hungarian_national_hs_finals_exam_results
hungarian_national_hs_finals_exam_results is a machine learning model from kittn. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Raw outputs from running Qwen-72B and deepseek-llm-67b-base on keirp/hungariannationalhsfinalsexam. For more details about the test itself, check that repo.
Downloads · 30 days
0
Access
Public
Updated Dec 3, 2023
Repo size
—
Likes
1
Public
Click a slice to open those files.
.csv335 KB · 99%
From the Hugging Face model README
Raw outputs from running Qwen-72B and deepseek-llm-67b-base on keirp/hungarian_national_hs_finals_exam. For more details about the test itself, check that repo.
Tests were run with the default settings from the repo, i.e temperature=0.1, top_p=0.95, prompt="few_shot" in float16 on a 4xA100 node with tp=4.
The only possibly relevant change was setting max_model_len=3072, though I don't think it matters since the few shot prompt is ~700 tokens and max_tokens=1024.
Keiran was nice enough to do the grading for me. Results can be found in his twitter post.