Downloads · 30 days
5
2% of all-time downloads
keras_phi3_mini_4k_instruct_en
abuelnasr/keras_phi3_mini_4k_instruct_en
keras_phi3_mini_4k_instruct_en is a machine learning model from abuelnasr. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for keras-hub.
This is a Phi3 model uploaded using the KerasNLP library and can be used with JAX, TensorFlow, and PyTorch backends. Model config: name: phi3backbone1 trainable: True vocabularysize: 32064 numlayers: 32 numqueryheads:…
All-time downloads
269
Public
Repo size
7.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.h57.6 GB · 100%
At a glance
- Library
- keras-hub
- Access
- Public
- Created
- May 6, 2024
- Updated
- Oct 30, 2024
- SHA
- be614cb7
Model card
From the Hugging Face model README
This is a Phi3 model uploaded using the KerasNLP library and can be used with JAX, TensorFlow, and PyTorch backends.
Model config:
- name: phi3_backbone_1
- trainable: True
- vocabulary_size: 32064
- num_layers: 32
- num_query_heads: 32
- hidden_dim: 3072
- intermediate_dim: 8192
- num_key_value_heads: 32
- layer_norm_epsilon: 1e-05
- dropout: 0.0
- max_sequence_length: 4096
- training_sequence_length: 4096
- rope_max_wavelength: 10000.0
- rope_scaling_type: None
- rope_scaling_short_factor: None
- rope_scaling_long_factor: None
This model card has been generated automatically and should be completed by the model author. See Model Cards documentation for more information.
- Library
- keras-hub
- Created
- May 6, 2024
- Updated
- Oct 30, 2024