初始化项目,由ModelHub XC社区提供模型
Model: NextGLab/ORANSight_LLama_8B_Instruct Source: Original Platform
This commit is contained in:
53
README.md
Normal file
53
README.md
Normal file
@@ -0,0 +1,53 @@
|
||||
---
|
||||
base_model: unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
|
||||
tags:
|
||||
- text-generation-inference
|
||||
- transformers
|
||||
- unsloth
|
||||
- llama
|
||||
- trl
|
||||
- sft
|
||||
license: llama3.1
|
||||
language:
|
||||
- en
|
||||
---
|
||||
|
||||
# Model Card for ORANSight Llama-8B
|
||||
|
||||
This model belongs to the first release of the ORANSight family of models.
|
||||
|
||||
- **Developed by:** NextG lab@ NC State
|
||||
- **License:** llama3.1
|
||||
- **Context Window** 128K tokens.
|
||||
- **Fine Tuning Framework:** Unsloth
|
||||
|
||||
### Generate with Transformers
|
||||
Below is a quick example of how to use the model with Hugging Face Transformers:
|
||||
|
||||
```python
|
||||
from transformers import pipeline
|
||||
|
||||
# Example query
|
||||
messages = [
|
||||
{"role": "system", "content": "You are an O-RAN expert assistant."},
|
||||
{"role": "user", "content": "Explain the E2 interface."},
|
||||
]
|
||||
|
||||
# Load the model
|
||||
chatbot = pipeline("text-generation", model="NextGLab/ORANSight_LLama_8B_Instruct")
|
||||
result = chatbot(messages)
|
||||
print(result)
|
||||
```
|
||||
|
||||
### Coming Soon
|
||||
A detailed paper documenting the experiments and results achieved with this model will be available soon. Meanwhile, if you try this model, please cite the below mentioned paper to acknowledge the foundational work that enabled this fine-tuning.
|
||||
|
||||
```bibtex
|
||||
@article{gajjar2024oran,
|
||||
title={Oran-bench-13k: An open source benchmark for assessing llms in open radio access networks},
|
||||
author={Gajjar, Pranshav and Shah, Vijay K},
|
||||
journal={arXiv preprint arXiv:2407.06245},
|
||||
year={2024}
|
||||
}
|
||||
```
|
||||
---
|
||||
Reference in New Issue
Block a user