初始化项目，由ModelHub XC社区提供模型
Model: m-polignano/ANITA-NEXT-24B-Magistral-2506-ITA-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
3
F16.gguf
Normal file
3
F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:08ec3693444e20fe56933a30150aad6de19d7076a527c9bb0dfee4b8c47a36e4
|
||||
size 47153517760
|
||||
3
Q4_K_M.gguf
Normal file
3
Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:34434605683c66070cc57fbc1dab3cd2b0f2278ebc06d29a1900d9c667fefcb8
|
||||
size 14333908160
|
||||
3
Q8_0.gguf
Normal file
3
Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0da9d2154aadd766dd83ac549ea342cd0e26df98be5617697a36622af26aaf9a
|
||||
size 25054778560
|
||||
73
README.md
Normal file
73
README.md
Normal file
@@ -0,0 +1,73 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
- it
|
||||
base_model:
|
||||
- mistralai/Magistral-Small-2506
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- ita
|
||||
- italian
|
||||
- anita
|
||||
- magistral
|
||||
- 24b
|
||||
- uniba
|
||||
- bari
|
||||
- italy
|
||||
- italia
|
||||
- Conversational
|
||||
- LLaMantino
|
||||
---
|
||||
|
||||
<img src="https://huggingface.co/m-polignano/ANITA-NEXT-24B-Magistral-2506-ITA/resolve/main/Anita-Next_full.png" alt="anita_next" border="0" width="600px">
|
||||
<hr>
|
||||
<!--<img src="https://i.ibb.co/6mHSRm3/llamantino53.jpg" width="200"/>-->
|
||||
<h3><i>"Built on <b>mistral/Magistral-Small-2506</b>"</i></i></h3>
|
||||
<p style="text-align:justify;"><b>ANITA-NEXT-24B-Magistral-2506-ITA</b> is a <b>Thinking Model</b> of the <a href="https://arxiv.org/abs/2405.07101"><b>ANITA</b></a> - <i>Large Language Models family</i>.
|
||||
The model is a fine-tuned version of <a href="https://huggingface.co/mistralai/Magistral-Small-2506"><b>Magistral-Small-2506</b></a> (a fine-tuned <b>Mistral model</b>).
|
||||
This model version aims to be the a <b>Multilingual Model</b> 🏁 (EN 🇺🇸 + ITA🇮🇹) to further fine-tuning on Specific Tasks in Italian.</p>
|
||||
|
||||
❗❗❗Use at your own risk. The model may generate hallucinations, incorrect, invented, offensive, unethical or dangerous responses. We are not responsible for any dangerous/offensive/criminal use. The model is release for research only purposes.❗❗❗
|
||||
|
||||
|
||||
The 🌟**ANITA project**🌟 *(**A**dvanced **N**atural-based interaction for the **ITA**lian language)*
|
||||
wants to provide Italian NLP researchers with an improved model for the Italian Language 🇮🇹 use cases.
|
||||
|
||||
The **NEXT** family includes **four models**:
|
||||
- m-polignano/ANITA-NEXT-24B-Magistral-2506-ITA - **General Purpose**
|
||||
- m-polignano/ANITA-NEXT-24B-Dolphin-Mistral-UNCENSORED-ITA - **Uncensored**
|
||||
- m-polignano/ANITA-NEXT-24B-Magistral-2506-VISION-ITA - **Vision-Language**
|
||||
- m-polignano/ANITA-NEXT-20B-gpt-oss-ITA - **Agentic Ready**
|
||||
|
||||
<hr>
|
||||
|
||||
**Full Model**: [m-polignano/ANITA-NEXT-24B-Magistral-2506-ITA](https://huggingface.co/m-polignano/ANITA-NEXT-24B-Magistral-2506-ITA)
|
||||
|
||||
<hr>
|
||||
|
||||
For *OLLAMA Inference* follow the [Huggingface Documentation](https://huggingface.co/docs/hub/ollama).
|
||||
|
||||
<hr>
|
||||
|
||||
|
||||
## Citation instructions
|
||||
```bibtex
|
||||
@misc{polignano2024advanced,
|
||||
title={Advanced Natural-based interaction for the ITAlian language: LLaMAntino-3-ANITA},
|
||||
author={Marco Polignano and Pierpaolo Basile and Giovanni Semeraro},
|
||||
year={2024},
|
||||
eprint={2405.07101},
|
||||
archivePrefix={arXiv},
|
||||
primaryClass={cs.CL}
|
||||
}
|
||||
```
|
||||
```bibtex
|
||||
@article{rastogi2025magistral,
|
||||
title={Magistral},
|
||||
author={Rastogi, Abhinav and Jiang, Albert Q and Lo, Andy and Berrada, Gabrielle and Lample, Guillaume and Rute, Jason and Barmentlo, Joep and Yadav, Karmesh and Khandelwal, Kartik and Chandu, Khyathi Raghavi and others},
|
||||
journal={arXiv preprint arXiv:2506.10910},
|
||||
year={2025}
|
||||
}
|
||||
```
|
||||
48
chat_template.jinja
Normal file
48
chat_template.jinja
Normal file
@@ -0,0 +1,48 @@
|
||||
{{- bos_token }}
|
||||
|
||||
{%- if messages[0]['role'] == 'system' %}
|
||||
{%- if messages[0]['content'] is string %}
|
||||
{%- set system_message = messages[0]['content'] %}
|
||||
{%- else %}
|
||||
{%- set system_message = messages[0]['content'][0]['text'] %}
|
||||
{%- endif %}
|
||||
{%- set loop_messages = messages[1:] %}
|
||||
{%- else %}
|
||||
{%- set system_message = "Sei un assistente AI per la lingua italiana di nome ANITA-NEXT (Advanced Natural-based interaction for the ITAlian language Next Generation) creato dal ricercatore Marco Polignano, Università degli Studi di Bari Aldo Moro, Italia. Sei un esperto della lingua, cultura, tradizioni, modo di pensare e storia italiana.\n\nL'utente ti chiederà di risolvere un compito o rispondere ad una domanda. Rispondi e ragiona usando la lingua della domanda, preferendo l'Italiano.\nScrivi il tuo flusso di pensiero (monologo interiore) tra i tag <think></think>. Ragiona in modo disinvolto, scrivendo riflessioni e/o bozze, come se stessi lavorando a un esercizio su un foglio di carta.\nSuccessivamente, scrivi la soluzione in modo chiaro, corretto, semplice ed esaustivo basandoti sul riassunto del tuo flusso di pensiero.\nSe necessario, usa la notazione markdown per formattare la risposta." %}
|
||||
{%- set loop_messages = messages %}
|
||||
{%- endif %}
|
||||
{{- '[SYSTEM_PROMPT]' + system_message + '[/SYSTEM_PROMPT]' }}
|
||||
{#- Edits made by Unsloth #}
|
||||
{%- for message in loop_messages %}
|
||||
{%- if message['role'] == 'user' %}
|
||||
{%- if message['content'] is string %}
|
||||
{{- '[INST]' + message['content'] + '[/INST]' }}
|
||||
{%- else %}
|
||||
{{- '[INST]' }}
|
||||
{%- for block in message['content'] %}
|
||||
{%- if block['type'] == 'text' %}
|
||||
{{- block['text'] }}
|
||||
{%- elif block['type'] in ['image', 'image_url'] %}
|
||||
{{- '[IMG]' }}
|
||||
{%- else %}
|
||||
{{- raise_exception('Only text and image blocks are supported in message content!') }}
|
||||
{%- endif %}
|
||||
{%- endfor %}
|
||||
{{- '[/INST]' }}
|
||||
{%- endif %}
|
||||
{%- elif message['role'] == 'system' %}
|
||||
{%- if message['content'] is string %}
|
||||
{{- '[SYSTEM_PROMPT]' + message['content'] + '[/SYSTEM_PROMPT]' }}
|
||||
{%- else %}
|
||||
{{- '[SYSTEM_PROMPT]' + message['content'][0]['text'] + '[/SYSTEM_PROMPT]' }}
|
||||
{%- endif %}
|
||||
{%- elif message['role'] == 'assistant' %}
|
||||
{%- if message['content'] is string %}
|
||||
{{- message['content'] + eos_token }}
|
||||
{%- else %}
|
||||
{{- message['content'][0]['text'] + eos_token }}
|
||||
{%- endif %}
|
||||
{%- else %}
|
||||
{{- raise_exception('Only user, system and assistant roles are supported!') }}
|
||||
{%- endif %}
|
||||
{%- endfor %}
|
||||
29
config.json
Normal file
29
config.json
Normal file
@@ -0,0 +1,29 @@
|
||||
{
|
||||
"architectures": [
|
||||
"MistralForCausalLM"
|
||||
],
|
||||
"attention_dropout": 0.0,
|
||||
"bos_token_id": 1,
|
||||
"eos_token_id": 2,
|
||||
"head_dim": 128,
|
||||
"hidden_act": "silu",
|
||||
"hidden_size": 5120,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 32768,
|
||||
"max_position_embeddings": 40960,
|
||||
"model_type": "mistral",
|
||||
"num_attention_heads": 32,
|
||||
"num_hidden_layers": 40,
|
||||
"num_key_value_heads": 8,
|
||||
"pad_token_id": 11,
|
||||
"rms_norm_eps": 1e-05,
|
||||
"rope_scaling": null,
|
||||
"rope_theta": 1000000000.0,
|
||||
"sliding_window": null,
|
||||
"tie_word_embeddings": false,
|
||||
"torch_dtype": "bfloat16",
|
||||
"transformers_version": "4.56.0.dev0",
|
||||
"unsloth_version": "2025.8.1",
|
||||
"use_cache": true,
|
||||
"vocab_size": 131072
|
||||
}
|
||||
12
generation_config.json
Normal file
12
generation_config.json
Normal file
@@ -0,0 +1,12 @@
|
||||
{
|
||||
"_from_model_config": true,
|
||||
"bos_token_id": 1,
|
||||
"do_sample": true,
|
||||
"eos_token_id": 2,
|
||||
"max_length": 40960,
|
||||
"max_new_tokens": 32786,
|
||||
"pad_token_id": 11,
|
||||
"temperature": 0.7,
|
||||
"top_p": 0.9,
|
||||
"transformers_version": "4.56.0.dev0"
|
||||
}
|
||||
1032
special_tokens_map.json
Normal file
1032
special_tokens_map.json
Normal file
File diff suppressed because it is too large
Load Diff
3
tokenizer.json
Normal file
3
tokenizer.json
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:23ad081f384b2bdb3c97f6e5461dfce52c1174c7328854a55006988f0fef9da7
|
||||
size 17078019
|
||||
9020
tokenizer_config.json
Normal file
9020
tokenizer_config.json
Normal file
File diff suppressed because it is too large
Load Diff
3
unsloth.F16.gguf
Normal file
3
unsloth.F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bb1563c86a2de4e62db7130d339361f5e7b58333ca9a4994f979d48795628cdc
|
||||
size 47153519936
|
||||
3
unsloth.Q4_K_M.gguf
Normal file
3
unsloth.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4056e4b16f57b6987551de6c3fe8194ad3accee98e72e72635f866f90c851693
|
||||
size 14333910336
|
||||
3
unsloth.Q8_0.gguf
Normal file
3
unsloth.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b7503499fc1b88da7a78d3208f75a8e4aac91003e687d7eac6253336a25f916d
|
||||
size 25054780736
|
||||
Reference in New Issue
Block a user