quintic

deepseek_coder_6.7b-sae-k-192-layer-23-29-2_ep

quintic/deepseek_coder_6.7b-sae-k-192-layer-23-29-2_ep

deepseek_coder_6.7b-sae-k-192-layer-23-29-2_ep is a machine learning model from quintic. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

Data: c4 and codeparrot, about 1:1 sample-wise but 1:4 token-wise mix. Significantly biased for codes (python, go, java, javascript, c, c++). First round trained for slightly less than 1 epoch (crashed). Loaded the ch…