Downloads · 30 days
5
1% of all-time downloads
nkkbr/whisper-large-v3-zatoichi-ja-EX-11
whisper-large-v3-zatoichi-ja-EX-11 is a automatic speech recognition model from nkkbr. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
5
1% of all-time downloads
All-time downloads
371
Public
Parameters
1.5B
154 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.2 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of openai/whisper-large-v3 on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 1.2137 | 0.0165 | 5 | 1.1909 | 101.7395 |
| 0.9531 | 0.0330 | 10 | 1.1502 | 107.7651 |
| 0.9252 | 0.0495 | 15 | 1.0472 | 123.3510 |
| 0.8932 | 0.0660 | 20 | 0.9606 | 129.6131 |
| 0.9091 | 0.0825 | 25 | 0.8648 | 131.0326 |
| 0.7438 | 0.0990 | 30 | 0.7895 | 111.1188 |
| 0.8716 | 0.1155 | 35 | 0.7227 | 100.2227 |
| 0.5675 | 0.1320 | 40 | 0.6827 | 89.2986 |
| 0.7042 | 0.1485 | 45 | 0.6500 | 88.6307 |
| 0.5532 | 0.1650 | 50 | 0.6178 | 93.4178 |
| 0.6312 | 0.1815 | 55 | 0.5932 | 88.1575 |
| 0.5095 | 0.1980 | 60 | 0.5764 | 75.9811 |
| 0.5476 | 0.2145 | 65 | 0.5538 | 87.9210 |
| 0.5563 | 0.2310 | 70 | 0.5410 | 85.4161 |
| 0.52 | 0.2475 | 75 | 0.5213 | 79.2792 |
| 0.5081 | 0.2640 | 80 | 0.5149 | 80.1141 |
| 0.5793 | 0.2805 | 85 | 0.5010 | 75.6749 |
| 0.4723 | 0.2970 | 90 | 0.4830 | 76.7604 |
| 0.4491 | 0.3135 | 95 | 0.4706 | 65.8363 |
| 0.4955 | 0.3300 | 100 | 0.4561 | 72.7804 |
| 0.3731 | 0.3465 | 105 | 0.4477 | 68.6891 |
| 0.4322 | 0.3630 | 110 | 0.4342 | 67.8959 |
| 0.429 | 0.3795 | 115 | 0.4291 | 65.2519 |
| 0.351 | 0.3960 | 120 | 0.4156 | 64.5004 |
| 0.3896 | 0.4125 | 125 | 0.4093 | 63.9994 |
| 0.3437 | 0.4290 | 130 | 0.4062 | 59.6994 |
| 0.4279 | 0.4455 | 135 | 0.3955 | 56.4013 |
| 0.4909 | 0.4620 | 140 | 0.3910 | 58.0712 |
| 0.4073 | 0.4785 | 145 | 0.3826 | 59.5603 |
| 0.393 | 0.4950 | 150 | 0.3666 | 56.3039 |
| 0.3687 | 0.5116 | 155 | 0.3533 | 55.5107 |
| 0.2573 | 0.5281 | 160 | 0.3468 | 61.2302 |
| 0.3782 | 0.5446 | 165 | 0.3464 | 59.5046 |
| 0.2342 | 0.5611 | 170 | 0.3404 | 53.5068 |
| 0.2788 | 0.5776 | 175 | 0.3341 | 54.8845 |
| 0.2982 | 0.5941 | 180 | 0.3245 | 49.3877 |
| 0.3323 | 0.6106 | 185 | 0.3160 | 50.9741 |
| 0.2502 | 0.6271 | 190 | 0.3076 | 46.5767 |
| 0.2774 | 0.6436 | 195 | 0.2983 | 47.4812 |
| 0.2222 | 0.6601 | 200 | 0.2944 | 43.8492 |
| 0.4682 | 0.6766 | 205 | 0.2912 | 48.0379 |
| 0.2746 | 0.6931 | 210 | 0.2780 | 44.5032 |
| 0.2503 | 0.7096 | 215 | 0.2758 | 42.4715 |
| 0.182 | 0.7261 | 220 | 0.2692 | 47.4534 |
| 0.2015 | 0.7426 | 225 | 0.2679 | 45.5747 |
| 0.252 | 0.7591 | 230 | 0.2601 | 49.8887 |
| 0.3192 | 0.7756 | 235 | 0.2474 | 41.0938 |
| 0.245 | 0.7921 | 240 | 0.2454 | 39.4100 |
| 0.2497 | 0.8086 | 245 | 0.2414 | 37.2669 |
| 0.2723 | 0.8251 | 250 | 0.2389 | 34.8177 |
| 0.1762 | 0.8416 | 255 | 0.2310 | 37.3643 |
| 0.2104 | 0.8581 | 260 | 0.2279 | 42.9446 |
| 0.1759 | 0.8746 | 265 | 0.2235 | 38.1575 |
| 0.2121 | 0.8911 | 270 | 0.2167 | 32.0623 |
| 0.1745 | 0.9076 | 275 | 0.2190 | 30.9769 |
| 0.1773 | 0.9241 | 280 | 0.2088 | 30.0167 |
| 0.2825 | 0.9406 | 285 | 0.2055 | 30.0028 |
| 0.1991 | 0.9571 | 290 | 0.2021 | 31.6170 |
| 0.1667 | 0.9736 | 295 | 0.1965 | 31.7284 |
| 0.0955 | 0.9901 | 300 | 0.1998 | 28.1241 |
| 0.1192 | 1.0066 | 305 | 0.1973 | 30.8377 |
| 0.1002 | 1.0231 | 310 | 0.1945 | 27.5536 |
| 0.1089 | 1.0396 | 315 | 0.1899 | 25.9672 |
| 0.0831 | 1.0561 | 320 | 0.1867 | 27.2474 |
| 0.0739 | 1.0726 | 325 | 0.1830 | 25.9254 |
| 0.0945 | 1.0891 | 330 | 0.1823 | 24.9095 |
| 0.2 | 1.1056 | 335 | 0.1815 | 26.4403 |
| 0.0988 | 1.1221 | 340 | 0.1729 | 25.5914 |
| 0.1132 | 1.1386 | 345 | 0.1784 | 26.0924 |
| 0.1152 | 1.1551 | 350 | 0.1691 | 23.4205 |
| 0.1342 | 1.1716 | 355 | 0.1726 | 23.8659 |
| 0.1288 | 1.1881 | 360 | 0.1689 | 22.5995 |
| 0.1594 | 1.2046 | 365 | 0.1705 | 23.3092 |
| 0.1166 | 1.2211 | 370 | 0.1715 | 25.7863 |
| 0.0804 | 1.2376 | 375 | 0.1619 | 21.7228 |
| 0.0785 | 1.2541 | 380 | 0.1606 | 25.5358 |
| 0.183 | 1.2706 | 385 | 0.1575 | 21.6532 |
| 0.0984 | 1.2871 | 390 | 0.1544 | 24.8400 |
| 0.1231 | 1.3036 | 395 | 0.1533 | 19.8441 |
| 0.1264 | 1.3201 | 400 | 0.1456 | 21.1105 |
| 0.1295 | 1.3366 | 405 | 0.1447 | 17.6454 |
| 0.0998 | 1.3531 | 410 | 0.1396 | 17.9237 |
| 0.0561 | 1.3696 | 415 | 0.1402 | 19.0509 |
| 0.0855 | 1.3861 | 420 | 0.1391 | 17.8681 |
| 0.0847 | 1.4026 | 425 | 0.1441 | 18.6195 |
| 0.0385 | 1.4191 | 430 | 0.1415 | 18.4247 |
| 0.0887 | 1.4356 | 435 | 0.1418 | 18.9396 |
| 0.0917 | 1.4521 | 440 | 0.1382 | 18.8561 |
| 0.0827 | 1.4686 | 445 | 0.1371 | 18.6335 |
| 0.15 | 1.4851 | 450 | 0.1344 | 17.9655 |
| 0.1635 | 1.5017 | 455 | 0.1341 | 17.9377 |
| 0.0967 | 1.5182 | 460 | 0.1285 | 15.1962 |
| 0.0792 | 1.5347 | 465 | 0.1238 | 15.7111 |
| 0.0806 | 1.5512 | 470 | 0.1228 | 15.5163 |
| 0.1056 | 1.5677 | 475 | 0.1255 | 15.5024 |
| 0.1258 | 1.5842 | 480 | 0.1238 | 14.7092 |
| 0.0916 | 1.6007 | 485 | 0.1207 | 14.9179 |
| 0.0756 | 1.6172 | 490 | 0.1186 | 14.8344 |
| 0.0606 | 1.6337 | 495 | 0.1144 | 14.3613 |
| 0.1108 | 1.6502 | 500 | 0.1156 | 14.3334 |
| 0.0736 | 1.6667 | 505 | 0.1133 | 14.8901 |
| 0.0545 | 1.6832 | 510 | 0.1097 | 14.1804 |
| 0.0621 | 1.6997 | 515 | 0.1117 | 13.6376 |
| 0.09 | 1.7162 | 520 | 0.1106 | 13.4150 |
| 0.0479 | 1.7327 | 525 | 0.1088 | 13.9716 |
| 0.181 | 1.7492 | 530 | 0.1080 | 12.8862 |
| 0.053 | 1.7657 | 535 | 0.1081 | 14.3752 |
| 0.0571 | 1.7822 | 540 | 0.1061 | 13.1367 |
| 0.0678 | 1.7987 | 545 | 0.1062 | 11.5781 |
| 0.0927 | 1.8152 | 550 | 0.1036 | 11.3693 |
| 0.099 | 1.8317 | 555 | 0.1023 | 11.5363 |
| 0.0627 | 1.8482 | 560 | 0.1026 | 12.0651 |
| 0.0936 | 1.8647 | 565 | 0.1000 | 10.7988 |
| 0.0683 | 1.8812 | 570 | 0.0990 | 11.5920 |
| 0.0749 | 1.8977 | 575 | 0.0960 | 10.7570 |
| 0.044 | 1.9142 | 580 | 0.0969 | 10.6457 |
| 0.0744 | 1.9307 | 585 | 0.0948 | 9.9917 |
| 0.0447 | 1.9472 | 590 | 0.0947 | 9.9917 |
| 0.0848 | 1.9637 | 595 | 0.0934 | 10.3256 |
| 0.1366 | 1.9802 | 600 | 0.0938 | 10.8823 |
| 0.0474 | 1.9967 | 605 | 0.0919 | 9.4489 |
| 0.0451 | 2.0132 | 610 | 0.0949 | 10.1308 |
| 0.026 | 2.0297 | 615 | 0.0974 | 10.2143 |
| 0.0356 | 2.0462 | 620 | 0.0955 | 10.1726 |
| 0.0435 | 2.0627 | 625 | 0.0934 | 10.7431 |
| 0.0341 | 2.0792 | 630 | 0.0944 | 10.9379 |
| 0.0541 | 2.0957 | 635 | 0.0902 | 10.8405 |
| 0.0523 | 2.1122 | 640 | 0.0927 | 10.0056 |
| 0.0311 | 2.1287 | 645 | 0.0905 | 8.9062 |
| 0.0328 | 2.1452 | 650 | 0.0907 | 9.2124 |
| 0.0116 | 2.1617 | 655 | 0.0908 | 10.0195 |
| 0.0171 | 2.1782 | 660 | 0.0908 | 10.1308 |
| 0.0448 | 2.1947 | 665 | 0.0900 | 9.1706 |
| 0.0304 | 2.2112 | 670 | 0.0872 | 8.5583 |
| 0.0189 | 2.2277 | 675 | 0.0865 | 8.1826 |
| 0.0249 | 2.2442 | 680 | 0.0863 | 8.4331 |
| 0.0356 | 2.2607 | 685 | 0.0876 | 10.1447 |
| 0.033 | 2.2772 | 690 | 0.0874 | 9.6855 |
| 0.0242 | 2.2937 | 695 | 0.0894 | 9.3098 |
| 0.0332 | 2.3102 | 700 | 0.0851 | 8.4609 |
| 0.0397 | 2.3267 | 705 | 0.0841 | 9.0454 |
| 0.0308 | 2.3432 | 710 | 0.0830 | 7.9043 |
| 0.0281 | 2.3597 | 715 | 0.0830 | 8.7810 |
| 0.0517 | 2.3762 | 720 | 0.0841 | 9.1010 |
| 0.0338 | 2.3927 | 725 | 0.0836 | 8.2800 |
| 0.0354 | 2.4092 | 730 | 0.0834 | 8.1130 |
| 0.0225 | 2.4257 | 735 | 0.0836 | 8.4748 |
| 0.0234 | 2.4422 | 740 | 0.0818 | 8.0852 |
| 0.0296 | 2.4587 | 745 | 0.0812 | 7.4868 |
| 0.0155 | 2.4752 | 750 | 0.0809 | 7.5703 |
| 0.0217 | 2.4917 | 755 | 0.0805 | 7.7790 |
| 0.0161 | 2.5083 | 760 | 0.0795 | 7.4450 |
| 0.0194 | 2.5248 | 765 | 0.0773 | 6.9441 |
| 0.0296 | 2.5413 | 770 | 0.0783 | 7.1250 |
| 0.0163 | 2.5578 | 775 | 0.0786 | 6.7910 |
| 0.0214 | 2.5743 | 780 | 0.0808 | 7.1667 |
| 0.0203 | 2.5908 | 785 | 0.0815 | 7.1806 |
| 0.0342 | 2.6073 | 790 | 0.0805 | 7.3337 |
| 0.0336 | 2.6238 | 795 | 0.0800 | 7.1806 |
| 0.0809 | 2.6403 | 800 | 0.0792 | 6.6379 |
| 0.0294 | 2.6568 | 805 | 0.0771 | 6.4848 |
| 0.0302 | 2.6733 | 810 | 0.0780 | 7.3476 |
| 0.0146 | 2.6898 | 815 | 0.0770 | 7.5842 |
| 0.0188 | 2.7063 | 820 | 0.0775 | 7.1945 |
| 0.0333 | 2.7228 | 825 | 0.0761 | 6.6518 |
| 0.034 | 2.7393 | 830 | 0.0765 | 6.8188 |
| 0.0239 | 2.7558 | 835 | 0.0748 | 6.7214 |
| 0.0243 | 2.7723 | 840 | 0.0749 | 6.4431 |
| 0.0077 | 2.7888 | 845 | 0.0745 | 6.3457 |
| 0.0273 | 2.8053 | 850 | 0.0743 | 6.5127 |
| 0.0255 | 2.8218 | 855 | 0.0751 | 6.7214 |
| 0.0071 | 2.8383 | 860 | 0.0718 | 6.0395 |
| 0.0101 | 2.8548 | 865 | 0.0728 | 6.4153 |
| 0.0253 | 2.8713 | 870 | 0.0732 | 6.3457 |
| 0.0283 | 2.8878 | 875 | 0.0719 | 6.3318 |
| 0.0333 | 2.9043 | 880 | 0.0724 | 6.4848 |
| 0.0304 | 2.9208 | 885 | 0.0694 | 5.8447 |
| 0.0265 | 2.9373 | 890 | 0.0701 | 5.7334 |
| 0.0184 | 2.9538 | 895 | 0.0692 | 5.7334 |
| 0.0357 | 2.9703 | 900 | 0.0687 | 5.8864 |
| 0.0049 | 2.9868 | 905 | 0.0684 | 5.8169 |
| 0.0053 | 3.0033 | 910 | 0.0685 | 6.0256 |
| 0.0049 | 3.0198 | 915 | 0.0680 | 5.6499 |
| 0.0092 | 3.0363 | 920 | 0.0678 | 5.5107 |
| 0.0051 | 3.0528 | 925 | 0.0677 | 5.4272 |
| 0.0042 | 3.0693 | 930 | 0.0677 | 5.4272 |
| 0.0041 | 3.0858 | 935 | 0.0681 | 4.9958 |
| 0.0031 | 3.1023 | 940 | 0.0685 | 5.0932 |
| 0.0043 | 3.1188 | 945 | 0.0689 | 5.1628 |
| 0.003 | 3.1353 | 950 | 0.0690 | 5.0376 |
| 0.0066 | 3.1518 | 955 | 0.0688 | 4.9402 |
| 0.0057 | 3.1683 | 960 | 0.0687 | 4.9541 |
| 0.0077 | 3.1848 | 965 | 0.0680 | 4.9123 |
| 0.0045 | 3.2013 | 970 | 0.0676 | 4.8427 |
| 0.0044 | 3.2178 | 975 | 0.0679 | 4.9541 |
| 0.0099 | 3.2343 | 980 | 0.0683 | 4.8984 |
| 0.0142 | 3.2508 | 985 | 0.0679 | 4.7593 |
| 0.0135 | 3.2673 | 990 | 0.0676 | 4.7175 |
| 0.0035 | 3.2838 | 995 | 0.0684 | 4.7453 |
| 0.0028 | 3.3003 | 1000 | 0.0684 | 4.8706 |
| 0.0035 | 3.3168 | 1005 | 0.0683 | 4.9262 |
| 0.0038 | 3.3333 | 1010 | 0.0682 | 4.9680 |
| 0.0047 | 3.3498 | 1015 | 0.0683 | 4.8427 |
| 0.006 | 3.3663 | 1020 | 0.0684 | 4.8706 |
| 0.0095 | 3.3828 | 1025 | 0.0683 | 4.7314 |
| 0.0026 | 3.3993 | 1030 | 0.0683 | 4.5923 |
| 0.0073 | 3.4158 | 1035 | 0.0682 | 4.5783 |
| 0.0044 | 3.4323 | 1040 | 0.0679 | 4.7175 |
| 0.0054 | 3.4488 | 1045 | 0.0680 | 4.9123 |
| 0.0053 | 3.4653 | 1050 | 0.0677 | 4.7453 |
| 0.0059 | 3.4818 | 1055 | 0.0675 | 4.5227 |
| 0.0023 | 3.4983 | 1060 | 0.0667 | 4.5644 |
| 0.003 | 3.5149 | 1065 | 0.0667 | 4.5923 |
| 0.0104 | 3.5314 | 1070 | 0.0662 | 4.7036 |
| 0.0045 | 3.5479 | 1075 | 0.0659 | 4.6897 |
| 0.0027 | 3.5644 | 1080 | 0.0661 | 4.4809 |
| 0.0041 | 3.5809 | 1085 | 0.0663 | 4.5088 |
| 0.0174 | 3.5974 | 1090 | 0.0660 | 4.5088 |
| 0.0014 | 3.6139 | 1095 | 0.0659 | 4.5644 |
| 0.0065 | 3.6304 | 1100 | 0.0660 | 4.5783 |
| 0.006 | 3.6469 | 1105 | 0.0661 | 4.7036 |
| 0.0017 | 3.6634 | 1110 | 0.0663 | 4.6758 |
| 0.003 | 3.6799 | 1115 | 0.0663 | 4.7036 |
| 0.0021 | 3.6964 | 1120 | 0.0661 | 4.6758 |
| 0.0029 | 3.7129 | 1125 | 0.0659 | 4.6758 |
| 0.0102 | 3.7294 | 1130 | 0.0658 | 4.6897 |
| 0.0086 | 3.7459 | 1135 | 0.0657 | 4.5923 |
| 0.0085 | 3.7624 | 1140 | 0.0655 | 4.5644 |
| 0.0039 | 3.7789 | 1145 | 0.0655 | 4.5227 |
| 0.0042 | 3.7954 | 1150 | 0.0653 | 4.5366 |
| 0.0137 | 3.8119 | 1155 | 0.0653 | 4.5644 |
| 0.007 | 3.8284 | 1160 | 0.0654 | 4.5923 |
| 0.0035 | 3.8449 | 1165 | 0.0654 | 4.5783 |
| 0.0072 | 3.8614 | 1170 | 0.0653 | 4.5783 |
| 0.004 | 3.8779 | 1175 | 0.0652 | 4.6340 |
| 0.0038 | 3.8944 | 1180 | 0.0651 | 4.5923 |
| 0.0087 | 3.9109 | 1185 | 0.0650 | 4.5644 |
| 0.0075 | 3.9274 | 1190 | 0.0649 | 4.4809 |
| 0.0125 | 3.9439 | 1195 | 0.0649 | 4.4531 |
| 0.014 | 3.9604 | 1200 | 0.0649 | 4.4531 |
| 0.0028 | 3.9769 | 1205 | 0.0649 | 4.4253 |
| 0.0048 | 3.9934 | 1210 | 0.0649 | 4.4670 |