初始化项目，由ModelHub XC社区提供模型
Model: gplsi/Aitana-2B-S-tourism-base-1.0 Source: Original Platform
This commit is contained in:
ModelHub XC
37
.gitattributes
vendored
Normal file
37
.gitattributes
vendored
Normal file
@@ -0,0 +1,37 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
Aitana-s2b-c0dc7-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
||||
3
Aitana-s2b-c0dc7-f16.gguf
Normal file
3
Aitana-s2b-c0dc7-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8b7a8de07ea8499447c92ab7e4052fbd4e5032b6b44ed98ba803edb1fea2fff1
|
||||
size 4513628320
|
||||
181
README.md
Normal file
181
README.md
Normal file
@@ -0,0 +1,181 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- ca
|
||||
- es
|
||||
- en
|
||||
base_model: gplsi/Aitana-2B-S-base-1.0
|
||||
tags:
|
||||
- valencian
|
||||
- catalan
|
||||
- spanish
|
||||
- english
|
||||
- text-generation
|
||||
- tourism
|
||||
- alia
|
||||
- gplsi
|
||||
datasets:
|
||||
- gplsi/alia_tourism
|
||||
library_name: transformers
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# Aitana-2B-S-tourism-base-1.0
|
||||
|
||||
**Aitana-2B-S-tourism-base-1.0** is a generative language model from the **Aitana family**, developed by the [GPLSI (Language and Information System Group)](https://gplsi.dlsi.ua.es/) at the University of Alicante. This model is based on [gplsi/Aitana-2B-S-base-1.0](https://huggingface.co/gplsi/Aitana-2B-S-base-1.0) and has been further trained on tourism domain data to enhance performance in tourism-related text generation.
|
||||
|
||||
## Table of Contents
|
||||
|
||||
- [Model Description](#model-description)
|
||||
- [Training Data](#training-data)
|
||||
- [Intended Uses](#intended-uses)
|
||||
- [How to Use](#how-to-use)
|
||||
- [GGUF for LM Studio](#gguf-for-lm-studio)
|
||||
- [Additional Information](#additional-information)
|
||||
|
||||
## Model Description
|
||||
|
||||
| Property | Value |
|
||||
|----------|-------|
|
||||
| **Base Model** | [gplsi/Aitana-2B-S-base-1.0](https://huggingface.co/gplsi/Aitana-2B-S-base-1.0) |
|
||||
| **Architecture** | Transformer decoder-only |
|
||||
| **Parameters** | ~2.25B |
|
||||
| **Languages** | Valencian, Spanish, English |
|
||||
| **License** | Apache 2.0 |
|
||||
|
||||
Aitana-2B-S-tourism-base-1.0 extends the Aitana-2B-S-base-1.0 foundation with additional training on tourism domain data. This specialized training makes it particularly well-suited for tourism-related applications in Valencian, Spanish, and English.
|
||||
|
||||
## Training Data
|
||||
|
||||
This model was trained on the following tourism domain dataset:
|
||||
|
||||
| Dataset ID | Name | Language | Source |
|
||||
|------------|------|----------|--------|
|
||||
| dc7 | tourism_va_2025 | Valencian | [gplsi/alia_tourism](https://huggingface.co/datasets/gplsi/alia_tourism) |
|
||||
| dc7 | tourism_es_2025 | Spanish | [gplsi/alia_tourism](https://huggingface.co/datasets/gplsi/alia_tourism) |
|
||||
| dc7 | tourism_en_2025 | English | [gplsi/alia_tourism](https://huggingface.co/datasets/gplsi/alia_tourism) |
|
||||
|
||||
### Data Source
|
||||
|
||||
- **Tourism**: Multilingual tourism domain content covering tourist information, destinations, accommodations, cultural sites, and travel-related text in Valencian, Spanish, and English.
|
||||
|
||||
## Intended Uses
|
||||
|
||||
This model can be used for:
|
||||
|
||||
- **Tourism text generation** in Valencian, Spanish, and English
|
||||
- **Travel content creation** and assistance
|
||||
- **Fine-tuning** for specific tourism downstream tasks
|
||||
- **Domain adaptation** for hospitality and travel applications
|
||||
|
||||
> **Note**: This model is specifically optimized for tourism domain content. For general-purpose or administrative/legal text, consider using other models in the Aitana family.
|
||||
|
||||
## How to Use
|
||||
|
||||
### Transformers
|
||||
|
||||
```python
|
||||
import torch
|
||||
from transformers import pipeline, AutoTokenizer
|
||||
|
||||
model_id = "gplsi/Aitana-2B-S-tourism-base-1.0"
|
||||
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
||||
|
||||
generator = pipeline(
|
||||
"text-generation",
|
||||
model=model_id,
|
||||
tokenizer=tokenizer,
|
||||
torch_dtype=torch.bfloat16,
|
||||
device_map="auto",
|
||||
)
|
||||
|
||||
# Tourism example in Spanish
|
||||
text = "El turismo en la Comunidad Valenciana ofrece"
|
||||
result = generator(text, do_sample=True, top_k=10, max_new_tokens=100)
|
||||
print(result[0]['generated_text'])
|
||||
|
||||
# Tourism example in Valencian
|
||||
text = "Les platges de la Costa Blanca són"
|
||||
result = generator(text, do_sample=True, top_k=10, max_new_tokens=100)
|
||||
print(result[0]['generated_text'])
|
||||
|
||||
# Tourism example in English
|
||||
text = "The best beaches in Valencia include"
|
||||
result = generator(text, do_sample=True, top_k=10, max_new_tokens=100)
|
||||
print(result[0]['generated_text'])
|
||||
```
|
||||
|
||||
## GGUF for LM Studio
|
||||
|
||||
This repository includes a GGUF version for use with [LM Studio](https://lmstudio.ai/), [Ollama](https://ollama.ai/), and other llama.cpp-based tools.
|
||||
|
||||
| File | Precision | Size |
|
||||
|------|-----------|------|
|
||||
| `Aitana-s2b-c0dc7-f16.gguf` | F16 | ~4.5 GB |
|
||||
|
||||
### Using with llama-cpp-python
|
||||
|
||||
```python
|
||||
from llama_cpp import Llama
|
||||
|
||||
llm = Llama.from_pretrained(
|
||||
repo_id="gplsi/Aitana-2B-S-tourism-base-1.0",
|
||||
filename="Aitana-s2b-c0dc7-f16.gguf",
|
||||
)
|
||||
|
||||
output = llm("El turismo en Valencia ofrece", max_tokens=100)
|
||||
print(output["choices"][0]["text"])
|
||||
```
|
||||
|
||||
|
||||
## Additional Information
|
||||
|
||||
### Author
|
||||
|
||||
The model has been developed by the **Language and [Information Systems Group (GPLSI)](https://gplsi.dlsi.ua.es/)** and the **[Centro de Inteligencia Digital (CENID)](https://cenid.es)**, both part of the **[University of Alicante (UA)](https://www.ua.es/es/)**, as part of their ongoing research in **Natural Language Processing (NLP)**.
|
||||
|
||||
|
||||
### Funding
|
||||
|
||||
This work is funded by the **Ministerio para la Transformación Digital y de la Función Pública**, co-financed by the **EU – NextGenerationEU**, within the framework of the project *Desarrollo de Modelos ALIA*.
|
||||
|
||||
### Acknowledgments
|
||||
|
||||
We would like to express our gratitude to all individuals and institutions that have contributed to the development of this work.
|
||||
|
||||
Special thanks to:
|
||||
- [Language Technologies Laboratory at Barcelona Supercomputing Center](https://www.bsc.es/es/discover-bsc/organisation/research-structure/language-technologies-laboratory)
|
||||
- [Centro Vasco de Tecnología de la Lengua (HiTZ)](https://www.hitz.eus/es)
|
||||
- [Centro Singular de Investigación en Tecnologías Inteligentes (CiTIUS)](https://citius.gal/)
|
||||
- [Sistemas Inteligentes de Acceso a la Información (SINAI)](https://www.ujaen.es/investigacion-y-transferencia/grupos-de-investigacion/sistemas-inteligentes-de-acceso-la-informacion-sinai)
|
||||
- [Instituto Universitario de Investigación Informática (IUII)](https://web.ua.es/es/iuii/)
|
||||
- [Leonardo HPC System](https://leonardo-supercomputer.cineca.eu/)
|
||||
- [European supercomputing ecosystem (EUROHPC)](https://www.eurohpc-ju.europa.eu/)
|
||||
|
||||
We also acknowledge the financial, technical, and scientific support of the **Ministerio para la Transformación Digital y de la Función Pública - Funded by EU – NextGenerationEU within the framework of the project Desarrollo de Modelos ALIA**, whose contribution has been essential to the completion of this research.
|
||||
|
||||
|
||||
### License
|
||||
|
||||
[Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0)
|
||||
|
||||
### Disclaimer
|
||||
|
||||
This model is intended for general purposes and is available under a permissive Apache License 2.0. Be aware that the model may have biases and/or undesirable outputs. Users deploying systems based on this model are responsible for mitigating risks and complying with applicable AI regulations.
|
||||
|
||||
|
||||
### Reference
|
||||
```bibtex
|
||||
@misc{gplsi-aitana-2B-S-base-1.0,
|
||||
author = {Estevanell-Valladares, Ernesto L. and Yáñez-Romero, Fabio and Sepúlveda-Torres, Robiert and Galeano, Santiago and Consuegra-Ayala, Juan Pablo and Miró Maestre, María and Martínez-Murillo, Iván and Grande, Eduardo and Canal-Esteve, Miquel and Bonora, Mar and Gutierrez, Yoan and Abreu Salas, José Ignacio and Lloret, Elena and Montoyo, Andrés and Muñoz-Guillena and Palomar, Manuel},
|
||||
title = {Aitana 2B base: Continually pre-trained on Valencian},
|
||||
year = {2025},
|
||||
institution = {Language and Information Systems Group (GPLSI) and Centro de Inteligencia Digital (CENID), University of Alicante (UA)},
|
||||
howpublished = {\url{https://huggingface.co/gplsi/gplsi/Aitana-2B-S-base-1.0}},
|
||||
note = {Accessed: 2025-12-12}
|
||||
}
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
**Copyright © 2026 Language and Information Systems Group (GPLSI) and Centro de Inteligencia Digital (CENID), University of Alicante (UA). Distributed under the Apache License 2.0.**
|
||||
30
config.json
Normal file
30
config.json
Normal file
@@ -0,0 +1,30 @@
|
||||
{
|
||||
"architectures": [
|
||||
"LlamaForCausalLM"
|
||||
],
|
||||
"attention_bias": false,
|
||||
"attention_dropout": 0.0,
|
||||
"bos_token_id": 1,
|
||||
"dtype": "bfloat16",
|
||||
"eos_token_id": 2,
|
||||
"pad_token_id": 2,
|
||||
"head_dim": 128,
|
||||
"hidden_act": "silu",
|
||||
"hidden_size": 2048,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 5440,
|
||||
"max_position_embeddings": 8192,
|
||||
"mlp_bias": false,
|
||||
"model_type": "llama",
|
||||
"num_attention_heads": 16,
|
||||
"num_hidden_layers": 24,
|
||||
"num_key_value_heads": 16,
|
||||
"pretraining_tp": 1,
|
||||
"rms_norm_eps": 1e-05,
|
||||
"rope_scaling": null,
|
||||
"rope_theta": 10000.0,
|
||||
"tie_word_embeddings": false,
|
||||
"transformers_version": "4.56.2",
|
||||
"use_cache": true,
|
||||
"vocab_size": 256000
|
||||
}
|
||||
6
generation_config.json
Normal file
6
generation_config.json
Normal file
@@ -0,0 +1,6 @@
|
||||
{
|
||||
"_from_model_config": true,
|
||||
"bos_token_id": 1,
|
||||
"eos_token_id": 2,
|
||||
"transformers_version": "4.56.2"
|
||||
}
|
||||
3
model.safetensors
Normal file
3
model.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2eae3355f90e1f5d0ec2a417dd02e8407a16bc02774f3de417a076e0e810c28f
|
||||
size 4507005744
|
||||
24
special_tokens_map.json
Normal file
24
special_tokens_map.json
Normal file
@@ -0,0 +1,24 @@
|
||||
{
|
||||
"bos_token": {
|
||||
"content": "<s>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"eos_token": {
|
||||
"content": "</s>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"pad_token": "</s>",
|
||||
"unk_token": {
|
||||
"content": "<unk>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
}
|
||||
}
|
||||
3
tokenizer.json
Normal file
3
tokenizer.json
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2e90b85b3e3b3ebfc6b9bafeb954b37f2435eed595738337e53f2a746d23d5a2
|
||||
size 37007416
|
||||
3
tokenizer.model
Normal file
3
tokenizer.model
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ab94ddf46d14f0279254858d53770c5319c5129d47291ee2bada530271cb1292
|
||||
size 4813276
|
||||
1100
tokenizer_config.json
Normal file
1100
tokenizer_config.json
Normal file
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user