91 lines
2.0 KiB
Markdown
91 lines
2.0 KiB
Markdown
---
|
|
library_name: transformers
|
|
language:
|
|
- en
|
|
base_model:
|
|
- shb777/Llama-3.3-8B-Instruct-128K
|
|
pipeline_tag: text-generation
|
|
---
|
|
|
|
Bbh Tracking Shuffled Objects Three Objects:
|
|
| Model | Accuracy |
|
|
|-----------------------|----------|
|
|
| Llama 3.1 | 36.0% |
|
|
| Llama 3.3 | 25.2% |
|
|
| **Llama 3.3 (reasoning)** | **28.4%** |
|
|
|
|
More information to come
|
|
|
|
### Results
|
|
|
|
[More Information Needed]
|
|
|
|
#### Summary
|
|
|
|
|
|
|
|
## Model Examination [optional]
|
|
|
|
<!-- Relevant interpretability work for the model goes here -->
|
|
|
|
[More Information Needed]
|
|
|
|
## Environmental Impact
|
|
|
|
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
|
|
|
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
|
|
|
- **Hardware Type:** [More Information Needed]
|
|
- **Hours used:** [More Information Needed]
|
|
- **Cloud Provider:** [More Information Needed]
|
|
- **Compute Region:** [More Information Needed]
|
|
- **Carbon Emitted:** [More Information Needed]
|
|
|
|
## Technical Specifications [optional]
|
|
|
|
### Model Architecture and Objective
|
|
|
|
[More Information Needed]
|
|
|
|
### Compute Infrastructure
|
|
|
|
[More Information Needed]
|
|
|
|
#### Hardware
|
|
|
|
[More Information Needed]
|
|
|
|
#### Software
|
|
|
|
[More Information Needed]
|
|
|
|
## Citation [optional]
|
|
|
|
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
|
|
|
**BibTeX:**
|
|
|
|
[More Information Needed]
|
|
|
|
**APA:**
|
|
|
|
[More Information Needed]
|
|
|
|
## Glossary [optional]
|
|
|
|
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
|
|
|
|
[More Information Needed]
|
|
|
|
## More Information [optional]
|
|
|
|
[More Information Needed]
|
|
|
|
## Model Card Authors [optional]
|
|
|
|
[More Information Needed]
|
|
|
|
## Model Card Contact
|
|
|
|
[More Information Needed] |