Downloads · 30 days
7
2% of all-time downloads
nkkbr/whisper-large-v3-zatoichi-ja-EX-11-combine
whisper-large-v3-zatoichi-ja-EX-11-combine is a automatic speech recognition model from nkkbr. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
2% of all-time downloads
All-time downloads
324
Public
Parameters
1.5B
167 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.2 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of openai/whisper-large-v3 on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 1.2018 | 0.0149 | 5 | 1.1698 | 96.5990 |
| 1.1265 | 0.0298 | 10 | 1.1321 | 97.0134 |
| 1.1797 | 0.0446 | 15 | 1.0587 | 99.4999 |
| 0.9929 | 0.0595 | 20 | 0.9644 | 107.8022 |
| 0.8122 | 0.0744 | 25 | 0.8903 | 107.2449 |
| 0.812 | 0.0893 | 30 | 0.8207 | 112.0320 |
| 0.7927 | 0.1042 | 35 | 0.7541 | 94.5556 |
| 0.7823 | 0.1190 | 40 | 0.7228 | 92.8265 |
| 0.6789 | 0.1339 | 45 | 0.6992 | 87.5822 |
| 0.7488 | 0.1488 | 50 | 0.6767 | 91.2261 |
| 0.6535 | 0.1637 | 55 | 0.6641 | 81.0231 |
| 0.6986 | 0.1786 | 60 | 0.6476 | 83.3095 |
| 0.5254 | 0.1935 | 65 | 0.6327 | 81.7519 |
| 0.4655 | 0.2083 | 70 | 0.6265 | 80.1372 |
| 0.5983 | 0.2232 | 75 | 0.6350 | 88.5539 |
| 0.507 | 0.2381 | 80 | 0.6223 | 87.2392 |
| 0.5127 | 0.2530 | 85 | 0.6163 | 84.9528 |
| 0.5039 | 0.2679 | 90 | 0.6059 | 79.5084 |
| 0.5895 | 0.2827 | 95 | 0.6187 | 85.5387 |
| 0.4107 | 0.2976 | 100 | 0.6105 | 81.7091 |
| 0.479 | 0.3125 | 105 | 0.6007 | 82.8522 |
| 0.4446 | 0.3274 | 110 | 0.6082 | 91.2261 |
| 0.3517 | 0.3423 | 115 | 0.6067 | 83.8382 |
| 0.5291 | 0.3571 | 120 | 0.6068 | 79.7942 |
| 0.4175 | 0.3720 | 125 | 0.6197 | 89.5827 |
| 0.3526 | 0.3869 | 130 | 0.6022 | 76.1646 |
| 0.42 | 0.4018 | 135 | 0.6102 | 90.5259 |
| 0.349 | 0.4167 | 140 | 0.6096 | 81.2947 |
| 0.3708 | 0.4315 | 145 | 0.6075 | 89.9829 |
| 0.3445 | 0.4464 | 150 | 0.6061 | 85.5673 |
| 0.3003 | 0.4613 | 155 | 0.6100 | 82.3807 |
| 0.3418 | 0.4762 | 160 | 0.6125 | 76.2218 |
| 0.3844 | 0.4911 | 165 | 0.6259 | 84.5813 |
| 0.3222 | 0.5060 | 170 | 0.6170 | 83.4095 |
| 0.3529 | 0.5208 | 175 | 0.6169 | 84.2812 |
| 0.271 | 0.5357 | 180 | 0.6160 | 79.5656 |
| 0.2834 | 0.5506 | 185 | 0.6166 | 82.1806 |
| 0.3443 | 0.5655 | 190 | 0.6129 | 81.6948 |
| 0.3763 | 0.5804 | 195 | 0.6072 | 84.4956 |
| 0.2303 | 0.5952 | 200 | 0.6030 | 78.7939 |
| 0.2336 | 0.6101 | 205 | 0.6295 | 87.9108 |
| 0.2431 | 0.625 | 210 | 0.6155 | 80.3229 |
| 0.2912 | 0.6399 | 215 | 0.6291 | 80.4658 |
| 0.2718 | 0.6548 | 220 | 0.6342 | 84.1240 |
| 0.2464 | 0.6696 | 225 | 0.6142 | 74.1783 |
| 0.2501 | 0.6845 | 230 | 0.6260 | 83.7525 |
| 0.2593 | 0.6994 | 235 | 0.6123 | 72.5064 |
| 0.2356 | 0.7143 | 240 | 0.6337 | 78.8797 |
| 0.2042 | 0.7292 | 245 | 0.6247 | 75.9074 |
| 0.2545 | 0.7440 | 250 | 0.6342 | 79.3798 |
| 0.2011 | 0.7589 | 255 | 0.6451 | 86.6390 |
| 0.2384 | 0.7738 | 260 | 0.6417 | 88.6968 |
| 0.1909 | 0.7887 | 265 | 0.6291 | 78.1223 |
| 0.2635 | 0.8036 | 270 | 0.6298 | 81.7233 |
| 0.1938 | 0.8185 | 275 | 0.6284 | 78.9225 |
| 0.1943 | 0.8333 | 280 | 0.6258 | 79.9228 |
| 0.1669 | 0.8482 | 285 | 0.6312 | 78.1509 |
| 0.1512 | 0.8631 | 290 | 0.6386 | 78.1795 |
| 0.2215 | 0.8780 | 295 | 0.6439 | 81.5376 |
| 0.1876 | 0.8929 | 300 | 0.6382 | 78.3224 |
| 0.1737 | 0.9077 | 305 | 0.6532 | 82.8237 |
| 0.1879 | 0.9226 | 310 | 0.6408 | 78.7797 |
| 0.2225 | 0.9375 | 315 | 0.6516 | 82.1949 |
| 0.1489 | 0.9524 | 320 | 0.6515 | 79.0226 |
| 0.2234 | 0.9673 | 325 | 0.6553 | 78.9797 |
| 0.1658 | 0.9821 | 330 | 0.6437 | 79.6656 |
| 0.1474 | 0.9970 | 335 | 0.6404 | 77.4936 |
| 0.1303 | 1.0119 | 340 | 0.6675 | 79.0226 |
| 0.099 | 1.0268 | 345 | 0.6769 | 76.6505 |
| 0.0974 | 1.0417 | 350 | 0.6899 | 81.3089 |
| 0.1253 | 1.0565 | 355 | 0.6581 | 79.6370 |
| 0.126 | 1.0714 | 360 | 0.6435 | 77.0506 |
| 0.1336 | 1.0863 | 365 | 0.6751 | 82.3950 |
| 0.112 | 1.1012 | 370 | 0.6610 | 77.7937 |
| 0.1298 | 1.1161 | 375 | 0.6782 | 81.1946 |
| 0.1422 | 1.1310 | 380 | 0.6674 | 76.4075 |
| 0.0703 | 1.1458 | 385 | 0.6880 | 82.3664 |
| 0.1027 | 1.1607 | 390 | 0.6806 | 77.9080 |
| 0.103 | 1.1756 | 395 | 0.6650 | 79.0797 |
| 0.109 | 1.1905 | 400 | 0.6739 | 81.3804 |
| 0.0933 | 1.2054 | 405 | 0.6904 | 76.0503 |
| 0.0599 | 1.2202 | 410 | 0.6953 | 77.2364 |
| 0.0993 | 1.2351 | 415 | 0.6964 | 77.0220 |
| 0.0803 | 1.25 | 420 | 0.7015 | 80.3801 |
| 0.08 | 1.2649 | 425 | 0.6862 | 79.9228 |
| 0.0973 | 1.2798 | 430 | 0.6969 | 79.1655 |
| 0.1133 | 1.2946 | 435 | 0.6879 | 76.1217 |
| 0.1257 | 1.3095 | 440 | 0.7039 | 77.9508 |
| 0.0734 | 1.3244 | 445 | 0.7010 | 78.3510 |
| 0.0726 | 1.3393 | 450 | 0.7112 | 79.7799 |
| 0.1176 | 1.3542 | 455 | 0.6928 | 74.2784 |
| 0.0837 | 1.3690 | 460 | 0.7186 | 82.6665 |
| 0.1233 | 1.3839 | 465 | 0.6901 | 77.5079 |
| 0.084 | 1.3988 | 470 | 0.6930 | 76.0932 |
| 0.0737 | 1.4137 | 475 | 0.7021 | 76.2361 |
| 0.066 | 1.4286 | 480 | 0.7235 | 76.8934 |
| 0.0704 | 1.4435 | 485 | 0.7375 | 79.0797 |
| 0.0454 | 1.4583 | 490 | 0.7231 | 78.3081 |
| 0.1011 | 1.4732 | 495 | 0.7411 | 84.4527 |
| 0.0804 | 1.4881 | 500 | 0.7145 | 78.3938 |
| 0.0503 | 1.5030 | 505 | 0.7191 | 79.1941 |
| 0.1192 | 1.5179 | 510 | 0.7061 | 76.2218 |
| 0.1012 | 1.5327 | 515 | 0.7024 | 76.9506 |
| 0.0641 | 1.5476 | 520 | 0.7158 | 81.5662 |
| 0.0708 | 1.5625 | 525 | 0.7138 | 78.0080 |
| 0.1119 | 1.5774 | 530 | 0.7174 | 77.3650 |
| 0.0798 | 1.5923 | 535 | 0.7309 | 80.5802 |
| 0.0473 | 1.6071 | 540 | 0.7355 | 78.0937 |
| 0.0902 | 1.6220 | 545 | 0.7263 | 77.7508 |
| 0.1315 | 1.6369 | 550 | 0.7355 | 80.3372 |
| 0.076 | 1.6518 | 555 | 0.7208 | 75.8502 |
| 0.0888 | 1.6667 | 560 | 0.7459 | 78.3081 |
| 0.0351 | 1.6815 | 565 | 0.7584 | 80.7231 |
| 0.0996 | 1.6964 | 570 | 0.7345 | 77.1935 |
| 0.0606 | 1.7113 | 575 | 0.7364 | 76.4218 |
| 0.1097 | 1.7262 | 580 | 0.7380 | 78.6939 |
| 0.0804 | 1.7411 | 585 | 0.7216 | 76.7791 |
| 0.1063 | 1.7560 | 590 | 0.7244 | 76.8791 |
| 0.1052 | 1.7708 | 595 | 0.7221 | 76.0646 |
| 0.0439 | 1.7857 | 600 | 0.7327 | 76.3647 |
| 0.1012 | 1.8006 | 605 | 0.7510 | 79.3512 |
| 0.0881 | 1.8155 | 610 | 0.7366 | 77.5650 |
| 0.0531 | 1.8304 | 615 | 0.7346 | 78.4510 |
| 0.0699 | 1.8452 | 620 | 0.7238 | 77.0077 |
| 0.0878 | 1.8601 | 625 | 0.7325 | 79.2512 |
| 0.0496 | 1.875 | 630 | 0.7418 | 79.2083 |
| 0.0712 | 1.8899 | 635 | 0.7299 | 72.8923 |
| 0.0561 | 1.9048 | 640 | 0.7405 | 74.4927 |
| 0.122 | 1.9196 | 645 | 0.7417 | 74.4784 |
| 0.0404 | 1.9345 | 650 | 0.7619 | 76.6791 |
| 0.0383 | 1.9494 | 655 | 0.7517 | 77.6079 |
| 0.0531 | 1.9643 | 660 | 0.7432 | 78.1795 |
| 0.0329 | 1.9792 | 665 | 0.7513 | 76.6505 |
| 0.071 | 1.9940 | 670 | 0.7509 | 76.5219 |
| 0.0237 | 2.0089 | 675 | 0.7612 | 76.4790 |
| 0.0207 | 2.0238 | 680 | 0.7946 | 76.6505 |
| 0.0464 | 2.0387 | 685 | 0.7863 | 74.7785 |
| 0.0527 | 2.0536 | 690 | 0.7984 | 75.9074 |
| 0.0371 | 2.0685 | 695 | 0.8003 | 76.1360 |
| 0.0187 | 2.0833 | 700 | 0.8050 | 76.2646 |
| 0.0338 | 2.0982 | 705 | 0.7923 | 75.7931 |
| 0.0431 | 2.1131 | 710 | 0.7882 | 78.4653 |
| 0.0231 | 2.1280 | 715 | 0.7941 | 76.7648 |
| 0.0294 | 2.1429 | 720 | 0.7872 | 76.1503 |
| 0.0247 | 2.1577 | 725 | 0.7903 | 79.3941 |
| 0.0369 | 2.1726 | 730 | 0.7875 | 76.5504 |
| 0.0237 | 2.1875 | 735 | 0.7883 | 73.5925 |
| 0.0207 | 2.2024 | 740 | 0.8174 | 78.8940 |
| 0.0195 | 2.2173 | 745 | 0.8100 | 78.1938 |
| 0.0178 | 2.2321 | 750 | 0.7951 | 75.2787 |
| 0.0311 | 2.2470 | 755 | 0.7998 | 76.0646 |
| 0.0185 | 2.2619 | 760 | 0.7953 | 75.1500 |
| 0.0333 | 2.2768 | 765 | 0.8027 | 75.4787 |
| 0.0269 | 2.2917 | 770 | 0.8086 | 75.4073 |
| 0.024 | 2.3065 | 775 | 0.8005 | 75.0929 |
| 0.0223 | 2.3214 | 780 | 0.7951 | 76.5790 |
| 0.0234 | 2.3363 | 785 | 0.8084 | 77.8365 |
| 0.0164 | 2.3512 | 790 | 0.8318 | 79.1512 |
| 0.0136 | 2.3661 | 795 | 0.8195 | 74.6642 |
| 0.0206 | 2.3810 | 800 | 0.8213 | 75.8360 |
| 0.0155 | 2.3958 | 805 | 0.8187 | 79.1941 |
| 0.0382 | 2.4107 | 810 | 0.8091 | 78.5653 |
| 0.0243 | 2.4256 | 815 | 0.7974 | 75.8502 |
| 0.0141 | 2.4405 | 820 | 0.8026 | 76.5790 |
| 0.018 | 2.4554 | 825 | 0.8206 | 77.8651 |
| 0.0229 | 2.4702 | 830 | 0.8119 | 74.4927 |
| 0.0199 | 2.4851 | 835 | 0.8229 | 75.8360 |
| 0.0406 | 2.5 | 840 | 0.8401 | 78.8368 |
| 0.0222 | 2.5149 | 845 | 0.8219 | 76.3361 |
| 0.0287 | 2.5298 | 850 | 0.8082 | 74.8928 |
| 0.0305 | 2.5446 | 855 | 0.8061 | 76.6648 |
| 0.0229 | 2.5595 | 860 | 0.8167 | 78.3652 |
| 0.0197 | 2.5744 | 865 | 0.8175 | 77.5079 |
| 0.0252 | 2.5893 | 870 | 0.8219 | 76.9506 |
| 0.0226 | 2.6042 | 875 | 0.8166 | 75.0071 |
| 0.0065 | 2.6190 | 880 | 0.8092 | 74.5499 |
| 0.0228 | 2.6339 | 885 | 0.8176 | 76.2932 |
| 0.0131 | 2.6488 | 890 | 0.8436 | 80.2801 |
| 0.0163 | 2.6637 | 895 | 0.8466 | 77.9651 |
| 0.0095 | 2.6786 | 900 | 0.8410 | 74.1069 |
| 0.0184 | 2.6935 | 905 | 0.8536 | 75.5930 |
| 0.0215 | 2.7083 | 910 | 0.8638 | 78.5653 |
| 0.0153 | 2.7232 | 915 | 0.8555 | 77.0077 |
| 0.0173 | 2.7381 | 920 | 0.8342 | 75.8502 |
| 0.027 | 2.7530 | 925 | 0.8239 | 75.9074 |
| 0.0176 | 2.7679 | 930 | 0.8329 | 78.8082 |
| 0.0167 | 2.7827 | 935 | 0.8470 | 80.3372 |
| 0.075 | 2.7976 | 940 | 0.8268 | 77.9223 |
| 0.0335 | 2.8125 | 945 | 0.8144 | 75.5787 |
| 0.0147 | 2.8274 | 950 | 0.8202 | 74.9929 |
| 0.0105 | 2.8423 | 955 | 0.8403 | 77.3507 |
| 0.0209 | 2.8571 | 960 | 0.8524 | 78.4510 |
| 0.0267 | 2.8720 | 965 | 0.8313 | 75.9217 |
| 0.0147 | 2.8869 | 970 | 0.8208 | 74.4784 |
| 0.0203 | 2.9018 | 975 | 0.8131 | 72.9065 |
| 0.0077 | 2.9167 | 980 | 0.8179 | 74.0926 |
| 0.058 | 2.9315 | 985 | 0.8368 | 80.3801 |
| 0.0251 | 2.9464 | 990 | 0.8362 | 79.8228 |
| 0.0245 | 2.9613 | 995 | 0.8170 | 75.7645 |
| 0.0224 | 2.9762 | 1000 | 0.8069 | 74.2069 |
| 0.0093 | 2.9911 | 1005 | 0.8152 | 75.1500 |
| 0.009 | 3.0060 | 1010 | 0.8290 | 76.8648 |
| 0.0106 | 3.0208 | 1015 | 0.8428 | 78.0223 |
| 0.0078 | 3.0357 | 1020 | 0.8523 | 77.7222 |
| 0.0112 | 3.0506 | 1025 | 0.8561 | 76.6219 |
| 0.0189 | 3.0655 | 1030 | 0.8518 | 75.3644 |
| 0.0042 | 3.0804 | 1035 | 0.8555 | 75.6788 |
| 0.015 | 3.0952 | 1040 | 0.8580 | 75.2215 |
| 0.003 | 3.1101 | 1045 | 0.8649 | 76.6076 |
| 0.0053 | 3.125 | 1050 | 0.8678 | 77.4936 |
| 0.0037 | 3.1399 | 1055 | 0.8656 | 77.0077 |
| 0.0027 | 3.1548 | 1060 | 0.8607 | 75.5930 |
| 0.0025 | 3.1696 | 1065 | 0.8581 | 74.5642 |
| 0.0037 | 3.1845 | 1070 | 0.8633 | 74.9500 |
| 0.0055 | 3.1994 | 1075 | 0.8713 | 75.6788 |
| 0.0018 | 3.2143 | 1080 | 0.8793 | 76.7648 |
| 0.0054 | 3.2292 | 1085 | 0.8762 | 75.8360 |
| 0.0074 | 3.2440 | 1090 | 0.8722 | 75.5644 |
| 0.0101 | 3.2589 | 1095 | 0.8746 | 76.5504 |
| 0.0107 | 3.2738 | 1100 | 0.8784 | 76.4647 |
| 0.0093 | 3.2887 | 1105 | 0.8803 | 76.0789 |
| 0.0106 | 3.3036 | 1110 | 0.8793 | 75.3215 |
| 0.004 | 3.3185 | 1115 | 0.8762 | 74.3069 |
| 0.0042 | 3.3333 | 1120 | 0.8800 | 74.0354 |
| 0.0126 | 3.3482 | 1125 | 0.8873 | 75.0786 |
| 0.0086 | 3.3631 | 1130 | 0.8943 | 75.6788 |
| 0.0053 | 3.3780 | 1135 | 0.8912 | 75.2215 |
| 0.0054 | 3.3929 | 1140 | 0.8854 | 74.4356 |
| 0.0041 | 3.4077 | 1145 | 0.8784 | 73.7211 |
| 0.0037 | 3.4226 | 1150 | 0.8789 | 74.1069 |
| 0.0051 | 3.4375 | 1155 | 0.8812 | 75.1929 |
| 0.0026 | 3.4524 | 1160 | 0.8826 | 75.8502 |
| 0.0039 | 3.4673 | 1165 | 0.8848 | 76.4075 |
| 0.0027 | 3.4821 | 1170 | 0.8841 | 76.1646 |
| 0.01 | 3.4970 | 1175 | 0.8831 | 76.4933 |
| 0.0031 | 3.5119 | 1180 | 0.8835 | 76.7505 |
| 0.0067 | 3.5268 | 1185 | 0.8851 | 76.4361 |
| 0.0026 | 3.5417 | 1190 | 0.8877 | 76.2504 |
| 0.0105 | 3.5565 | 1195 | 0.8876 | 76.5076 |
| 0.0023 | 3.5714 | 1200 | 0.8873 | 76.7648 |
| 0.0033 | 3.5863 | 1205 | 0.8868 | 75.8074 |
| 0.0031 | 3.6012 | 1210 | 0.8856 | 75.7216 |
| 0.0042 | 3.6161 | 1215 | 0.8838 | 75.5502 |
| 0.0029 | 3.6310 | 1220 | 0.8819 | 75.4215 |
| 0.0042 | 3.6458 | 1225 | 0.8819 | 75.5216 |
| 0.0128 | 3.6607 | 1230 | 0.8814 | 75.5930 |
| 0.0052 | 3.6756 | 1235 | 0.8834 | 76.0360 |
| 0.0041 | 3.6905 | 1240 | 0.8856 | 76.1075 |
| 0.013 | 3.7054 | 1245 | 0.8886 | 76.1646 |
| 0.0035 | 3.7202 | 1250 | 0.8908 | 76.5647 |
| 0.0026 | 3.7351 | 1255 | 0.8924 | 76.4504 |
| 0.0132 | 3.75 | 1260 | 0.8936 | 76.2504 |
| 0.0059 | 3.7649 | 1265 | 0.8939 | 76.0217 |
| 0.0055 | 3.7798 | 1270 | 0.8944 | 75.6216 |
| 0.0098 | 3.7946 | 1275 | 0.8943 | 75.1786 |
| 0.0027 | 3.8095 | 1280 | 0.8945 | 74.9500 |
| 0.0036 | 3.8244 | 1285 | 0.8943 | 74.7642 |
| 0.0015 | 3.8393 | 1290 | 0.8938 | 74.5642 |
| 0.002 | 3.8542 | 1295 | 0.8947 | 74.7356 |
| 0.003 | 3.8690 | 1300 | 0.8945 | 74.7642 |
| 0.0038 | 3.8839 | 1305 | 0.8942 | 74.7499 |
| 0.0019 | 3.8988 | 1310 | 0.8946 | 74.9643 |
| 0.0024 | 3.9137 | 1315 | 0.8948 | 75.0500 |
| 0.006 | 3.9286 | 1320 | 0.8943 | 75.0214 |
| 0.0019 | 3.9435 | 1325 | 0.8945 | 75.0214 |
| 0.0078 | 3.9583 | 1330 | 0.8939 | 75.0357 |
| 0.002 | 3.9732 | 1335 | 0.8939 | 75.0214 |
| 0.0047 | 3.9881 | 1340 | 0.8937 | 75.0071 |