Downloads · 30 days
0
llm_ds_eval_proj_1
bhuvana-ak7/llm_ds_eval_proj_1
llm_ds_eval_proj_1 is a machine learning model from bhuvana-ak7. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This modelcard aims to be a base template for new models. It has been generated using this raw template.
Access
Public
Updated Oct 20, 2024
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.md3.1 KB · 67%
At a glance
- Access
- Public
- Created
- Oct 20, 2024
- Updated
- Oct 20, 2024
- SHA
- 3c34fd1f
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->This modelcard aims to be a base template for new models. It has been generated using this raw template.
Model Details
EleutherAI/pythia-160m is a Transformer-based Language Model
Model Description
<!-- Provide a longer summary of what this model is. -->Using EleutherAI/pythia-160m model to evaluate hellaswag dataset
Evaluation
<!-- This section describes the evaluation protocols and provides the results. -->| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| hellaswag | 1 | none | 0 | acc | ↑ | 0.2872 | ± | 0.0045 |
| none | 0 | acc_norm | ↑ | 0.3082 | ± | 0.0046 |
Testing Data, Factors & Metrics
Testing Data
<!-- This should link to a Dataset Card if possible. -->[More Information Needed]
Factors
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->[More Information Needed]
Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->[More Information Needed]
Results
[More Information Needed]
Summary
Model Examination [optional]
<!-- Relevant interpretability work for the model goes here -->[More Information Needed]
Environmental Impact
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).
- Hardware Type: [More Information Needed]
- Hours used: [More Information Needed]
- Cloud Provider: [More Information Needed]
- Compute Region: [More Information Needed]
- Carbon Emitted: [More Information Needed]
Technical Specifications [optional]
Model Architecture and Objective
[More Information Needed]
Compute Infrastructure
[More Information Needed]
Hardware
[More Information Needed]
Software
[More Information Needed]
Citation [optional]
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->BibTeX:
[More Information Needed]
APA:
[More Information Needed]
Glossary [optional]
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->[More Information Needed]
More Information [optional]
[More Information Needed]
Model Card Authors [optional]
[More Information Needed]
Model Card Contact
[More Information Needed]
- Created
- Oct 20, 2024
- Updated
- Oct 20, 2024