初始化项目,由ModelHub XC社区提供模型

Model: muverqqw/Noir-Ultra
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-13 10:50:16 +08:00
commit d8402909bf
8 changed files with 330 additions and 0 deletions

36
.gitattributes vendored Normal file
View File

@@ -0,0 +1,36 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
tokenizer.json filter=lfs diff=lfs merge=lfs -text

131
README.md Normal file
View File

@@ -0,0 +1,131 @@
---
base_model: unsloth/Qwen2.5-7B-Instruct # Уточни, если база другая
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- reasoning
- science
- logic
- trl
- sft
license: apache-2.0
language:
- en
- ru
- zh
model-index:
- name: Noir-Ultra
results:
- task:
type: text-generation
name: STEM (Science)
dataset:
name: SciQ
type: sciq
metrics:
- name: accuracy
type: exact_match
value: 91.0
- task:
type: text-generation
name: Mathematics
dataset:
name: GSM8K
type: gsm8k
metrics:
- name: accuracy
type: exact_match
value: 84.0
- task:
type: text-generation
name: Logic
dataset:
name: ARC Challenge
type: ai2_arc
metrics:
- name: accuracy
type: exact_match
value: 86.0
---
# 🌌 Noir-Ultra (7B)
<div align="center">
[Noir Family](https://huggingface.co/collections/muverqqw/noir) | [GGUF Versions](https://huggingface.co/muverqqw/Noir-GGUF) | [Technical Report](#-noir-ultra-evaluation-dashboard)
</div>
**Noir-Ultra** is the elite 7-billion parameter model of the Noir series. It represents a breakthrough in training efficiency: where previous 7B iterations required 6 epochs to reach stability, **Noir-Ultra achieved superior results in just a single epoch**.
This model is a "compact titan," delivering scientific reasoning and mathematical accuracy that rival much larger architectures.
---
## 🚀 The Ultra Advantage
* 🧬 **Unrivaled STEM:** With a **91.0% score on SciQ**, it is a specialized tool for scientific inquiry.
* 📐 **Mathematical Precision:** Scoring **84.0% on GSM8K**, it handles complex chains of thought with ease.
* 🧠 **Logical Depth:** An ARC-Challenge score of **86.0%** places it at the top of its weight class for reasoning tasks.
---
## 📊 Evaluation Dashboard (Noir Ultra Report)
Based on the latest evaluation, Noir-Ultra shows an exceptionally strong profile in technical domains:
| Domain | Benchmark | Result (%) | Status |
| :--- | :--- | :---: | :--- |
| **STEM** | SciQ | **91.0%** | 🏆 Master |
| **Logic** | ARC-C | **86.0%** | 🔥 Elite |
| **Math** | GSM8K | **84.0%** | ✅ Advanced |
| **Medicine** | MedQA | **65.0%** | 🩺 Competent |
| **Physics** | MMLU-Physics| **70.0%** | 🧪 Specialist |
---
## 📦 Noir Model Family Matrix
| Model | Parameters | Role | Key Strength |
| :--- | :--- | :--- | :--- |
| **Noir-Lightning** | 0.5B | The Pocket Assistant | Ultra-fast, runs on anything |
| **Noir-Mini** | 1.5B | The Balanced Thinker | High speed with solid grammar |
| **Noir-Standard** | 3B | The Versatile Workhorse | 65% GSM8K, perfect for 8GB VRAM |
| **Noir-Ultra** | **7B** | **The Reasoning Master** | **91% SciQ & 84% Math** |
| **Noir-Starlight** | 14B | The Galactic Intelligence | Deep logic & Expert-level STEM |
---
## 🛠 Quick Start (Transformers)
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_name = "muverqqw/Noir-Ultra"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
model_name,
load_in_4bit=True, # Recommended for 8GB VRAM
device_map="auto"
)
```
---
### 👤 Credits
* **Developer:** IceL1ghtning
* **Architecture:** Qwen 2.5 (7B)
* **Release:** 2026
* **License:** Apache 2.0
<div align="center">
<sub>Efficiency meets intelligence. Built with passion for the open-source community.</sub>
</div>

54
chat_template.jinja Normal file
View File

@@ -0,0 +1,54 @@
{%- if tools %}
{{- '<|im_start|>system\n' }}
{%- if messages[0]['role'] == 'system' %}
{{- messages[0]['content'] }}
{%- else %}
{{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}
{%- endif %}
{{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
{%- for tool in tools %}
{{- "\n" }}
{{- tool | tojson }}
{%- endfor %}
{{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
{%- else %}
{%- if messages[0]['role'] == 'system' %}
{{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
{%- else %}
{{- '<|im_start|>system\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\n' }}
{%- endif %}
{%- endif %}
{%- for message in messages %}
{%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
{{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
{%- elif message.role == "assistant" %}
{{- '<|im_start|>' + message.role }}
{%- if message.content %}
{{- '\n' + message.content }}
{%- endif %}
{%- for tool_call in message.tool_calls %}
{%- if tool_call.function is defined %}
{%- set tool_call = tool_call.function %}
{%- endif %}
{{- '\n<tool_call>\n{"name": "' }}
{{- tool_call.name }}
{{- '", "arguments": ' }}
{{- tool_call.arguments | tojson }}
{{- '}\n</tool_call>' }}
{%- endfor %}
{{- '<|im_end|>\n' }}
{%- elif message.role == "tool" %}
{%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
{{- '<|im_start|>user' }}
{%- endif %}
{{- '\n<tool_response>\n' }}
{{- message.content }}
{{- '\n</tool_response>' }}
{%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
{{- '<|im_end|>\n' }}
{%- endif %}
{%- endif %}
{%- endfor %}
{%- if add_generation_prompt %}
{{- '<|im_start|>assistant\n' }}
{%- endif %}

61
config.json Normal file
View File

@@ -0,0 +1,61 @@
{
"architectures": [
"Qwen2ForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": null,
"dtype": "float16",
"eos_token_id": 151645,
"hidden_act": "silu",
"hidden_size": 3584,
"initializer_range": 0.02,
"intermediate_size": 18944,
"layer_types": [
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention",
"full_attention"
],
"max_position_embeddings": 32768,
"max_window_layers": 28,
"model_type": "qwen2",
"num_attention_heads": 28,
"num_hidden_layers": 28,
"num_key_value_heads": 4,
"pad_token_id": 151643,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 1000000.0,
"rope_type": "default"
},
"sliding_window": null,
"tie_word_embeddings": false,
"transformers_version": "5.3.0",
"use_cache": false,
"use_sliding_window": false,
"vocab_size": 152064
}

13
generation_config.json Normal file
View File

@@ -0,0 +1,13 @@
{
"do_sample": true,
"eos_token_id": [
151645,
151643
],
"pad_token_id": 151643,
"repetition_penalty": 1.05,
"temperature": 0.7,
"top_k": 20,
"top_p": 0.8,
"transformers_version": "5.3.0"
}

3
model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4dad657f93e66ae99a582253290b0ad75dc9b8036782b700731614028a58ebeb
size 15231271816

3
tokenizer.json Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fd169731d2cbde95e10bf356d66d5997fd885dd8dbb6fb4684da3f23b2585d8
size 11421892

29
tokenizer_config.json Normal file
View File

@@ -0,0 +1,29 @@
{
"add_prefix_space": false,
"backend": "tokenizers",
"bos_token": null,
"clean_up_tokenization_spaces": false,
"eos_token": "<|im_end|>",
"errors": "replace",
"extra_special_tokens": [
"<|im_start|>",
"<|im_end|>",
"<|object_ref_start|>",
"<|object_ref_end|>",
"<|box_start|>",
"<|box_end|>",
"<|quad_start|>",
"<|quad_end|>",
"<|vision_start|>",
"<|vision_end|>",
"<|vision_pad|>",
"<|image_pad|>",
"<|video_pad|>"
],
"is_local": false,
"model_max_length": 131072,
"pad_token": "<|endoftext|>",
"split_special_tokens": false,
"tokenizer_class": "Qwen2Tokenizer",
"unk_token": null
}