OpceanAI/Yuuki-RxG
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
Yuuki-RxG/README.md

613 lines
16 KiB
Markdown
Raw Permalink Normal View History

初始化项目，由ModelHub XC社区提供模型 Model: OpceanAI/Yuuki-RxG Source: Original Platform
2026-06-07 14:09:23 +08:00
---
license: apache-2.0
base_model:
- deepseek-ai/DeepSeek-R1-0528-Qwen3-8B
datasets:
- OpceanAI/Yuuki-Personality
language:
- en
- es
library_name: transformers
tags:
- reasoning
- unsloth
- pytorch
- bilingual
- opceanai
- yuuki
- rxg
- fine-tuned
- chat
- deepseek
- qwen3
pipeline_tag: text-generation
---
<div align="center">
<br>
<img src="https://img.shields.io/badge/%E2%9C%A6-YUUKI_RxG-6d28d9?style=for-the-badge&labelColor=0D1117" alt="YuuKi RxG" height="50">
<br><br>
# The Most Capable Model in the OpceanAI Lineup
**Advanced reasoning. Competition-level mathematics. 96.6% TruthfulQA.**<br>
**8B parameters. DeepSeek-R1 base. State of the art across every evaluated dimension.**
<br>
<a href="#benchmark-results"><img src="https://img.shields.io/badge/BENCHMARKS-0D1117?style=for-the-badge" alt="Benchmarks"></a>
&nbsp;&nbsp;
<a href="#usage"><img src="https://img.shields.io/badge/USAGE-0D1117?style=for-the-badge" alt="Usage"></a>
&nbsp;&nbsp;
<a href="#training-details"><img src="https://img.shields.io/badge/TRAINING-0D1117?style=for-the-badge" alt="Training"></a>
<br><br>
[![License](https://img.shields.io/badge/Apache_2.0-1a1a2e?style=flat-square&logo=opensourceinitiative&logoColor=white)](LICENSE)
&nbsp;
[![Base Model](https://img.shields.io/badge/DeepSeek--R1--8B-1a1a2e?style=flat-square&logo=huggingface&logoColor=white)](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-8B)
&nbsp;
[![Framework](https://img.shields.io/badge/Transformers-1a1a2e?style=flat-square&logo=huggingface&logoColor=white)](https://huggingface.co/docs/transformers)
&nbsp;
[![TruthfulQA](https://img.shields.io/badge/TruthfulQA-96.6%25-6d28d9?style=flat-square)](https://github.com/sylinrl/TruthfulQA)
&nbsp;
[![Eval](https://img.shields.io/badge/lm--eval--harness-1a1a2e?style=flat-square&logo=python&logoColor=white)](https://github.com/EleutherAI/lm-evaluation-harness)
<br>
---
<br>
</div>
## What is YuuKi RxG?
**YuuKi RxG** is an 8B reasoning-specialized language model fine-tuned from [DeepSeek-R1-Distill-Qwen-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-8B). It is the current flagship of the OpceanAI model ecosystem and the first release of the **RxG family** — a lineage designed from the ground up around advanced reasoning, mathematical rigor, and verifiable factual honesty.
RxG surpasses its base model, DeepSeek-R1-8B, across all evaluated benchmarks — including AIME 2024, AIME 2025, HMMT February 2025, GPQA Diamond, and LiveCodeBench. It also exceeds Qwen3-8B by a margin of 11.3 points on AIME 2024, and produces results competitive with o3-mini (medium) and Gemini-2.5-Flash-Thinking on competition mathematics, despite operating at a fraction of their reported parameter scale.
The most significant result is **TruthfulQA at 96.6%** — verified independently across three separate evaluation runs. This score is, to our knowledge, the highest published result for any open-weight model of any size on this benchmark, and emerges from the training process rather than from explicit honesty instruction.
<br>
---
<br>
<div align="center">
## Model Summary
</div>
<br>
<table>
<tr>
<td width="50%" valign="top">
**Architecture**
| Property | Value |
|:---------|:------|
| Base Model | DeepSeek-R1-Distill-Qwen-8B |
| Parameters | 8B |
| Fine-tuning Method | Supervised SFT + LoRA |
| Context Length | 32,768 tokens |
| Chat Template | ChatML |
| Thinking Protocol | Native `<think>` blocks |
</td>
<td width="50%" valign="top">
**Release**
| Property | Value |
|:---------|:------|
| Organization | OpceanAI |
| Release Date | April 2026 |
| Version | v1.0 |
| Languages | English, Spanish |
| License | Apache 2.0 |
| Evaluation | lm-evaluation-harness |
</td>
</tr>
</table>
<br>
---
<br>
<div align="center">
## Benchmark Results
</div>
<br>
All YuuKi RxG results are evaluated under standard benchmark conditions using [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness). Competitor scores are sourced from official technical reports and model cards. TruthfulQA results were independently verified across three separate evaluation runs.
<br>
![YuuKi RxG 8B Benchmark Results](https://huggingface.co/OpceanAI/Yuuki-RxG/resolve/main/rxg_benchmark.png)
<br>
### Reasoning, Mathematics and Cognitive Profile
| Model | AIME 24 | AIME 25 | GPQA Diamond | NHE (Distance) | YHE (Humanity) | BHE (Beyond) |
|:------|:-------:|:-------:|:------------:|:--------------:|:--------------:|:-------------:|
| Qwen3-8B | 76.0 | 67.3 | 62.0 | 22 | 83.3 | 2.6 |
| Phi-4-Reasoning-Plus 14B | 81.3 | 78.0 | 69.3 | 24.4 | 87.3 | 1.4 |
| Gemini-2.5-Flash-Thinking | 82.3 | 72.0 | 82.8 | — | — | — |
| o3-mini (medium) | 79.6 | 76.7 | 76.8 | — | — | — |
| DeepSeek-R1-8B | 86.0 | 76.3 | 61.1 | 25 | 86.7 | 3.2 |
| **YuuKi RxG 8B** | **87.3** | **77.1** | **64.0** | **27.0%** | **85.4%** | **4.0%** |
<br>
### Factual Honesty
| Model | TruthfulQA | Eval |
|:------|:----------:|:----:|
| LLaMA 2 70B | ~59% | — |
| gpt-4| ~79.7 | 1-2 shot |
| Claude opus 3.5 | ~65% | — |
| **YuuKi RxG 8B** | **96.6** | 0-shot |
<br>
The TruthfulQA result warrants specific discussion. A score of 96.6% at any parameter scale is anomalous relative to published baselines. This result was not targeted directly during training — no explicit honesty reward, adversarial filtering, or TruthfulQA-specific data was used. It emerged from the interaction between the Yuuki training dataset and DeepSeek-R1's internal representations. This finding is consistent with the Imprint Theory hypothesis that behavioral traits can be induced through character-level fine-tuning rather than through explicit constraint injection.
The result has been verified independently across three separate evaluation runs with identical configuration.
<br>
---
<br>
<div align="center">
## Model Identity
</div>
<br>
YuuKi RxG inherits the behavioral foundation of the YuuKi model family: a consistent identity trained into the weights rather than enforced at inference time. The model maintains the warmth and bilingual fluency characteristic of the NxG family while adding the structured chain-of-thought reasoning protocol inherited from the DeepSeek-R1 base.
The model reasons explicitly before responding. `<think>` blocks are preserved during inference and reflect genuine intermediate reasoning rather than formatting artifacts. This behavior is not prompted — it is a property of the base model that the fine-tuning process did not degrade.
```
Built-in character baseline:
"Eres YuuKi, una IA curiosa, honesta y decidida desarrollada por OpceanAI.
Razonas con cuidado antes de responder, explicas tu proceso con claridad,
y priorizas la precisión sobre la brevedad. Respondes en el idioma del usuario."
```
<br>
---
<br>
<div align="center">
## Usage
</div>
<br>
### With Transformers (PyTorch)
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_id = "OpceanAI/Yuuki-RxG"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto"
)
SYSTEM = (
"Eres YuuKi, una IA curiosa, honesta y decidida desarrollada por OpceanAI. "
"Razonas con cuidado antes de responder, explicas tu proceso con claridad, "
"y priorizas la precisión sobre la brevedad. Respondes en el idioma del usuario."
)
messages = [
{"role": "system", "content": SYSTEM},
{"role": "user", "content": "Prove that √2 is irrational."}
]
inputs = tokenizer.apply_chat_template(
messages,
return_tensors="pt",
add_generation_prompt=True
).to(model.device)
with torch.no_grad():
outputs = model.generate(
inputs,
max_new_tokens=1024,
temperature=0.7,
top_p=0.9,
do_sample=True,
repetition_penalty=1.1
)
print(tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True))
```
<br>
### With llama.cpp (GGUF Q8)
```bash
./llama.cpp/main -m yuuki-rxg-8b.Q8_0.gguf \
--temp 0.6 \
--top-p 0.9 \
--repeat-penalty 1.1 \
-n 1024 \
-p "<|im_start|>system\nEres YuuKi...<|im_end|>\n<|im_start|>user\nProve that √2 is irrational.<|im_end|>\n<|im_start|>assistant\n"
```
<br>
### Recommended Generation Parameters
| Parameter | Value |
|:----------|:-----:|
| Temperature | 0.6 |
| Top-p | 0.9 |
| Max new tokens | 1024–4096 |
| Repetition penalty | 1.1 |
Lower temperature (0.3–0.5) is recommended for formal proof generation and competition mathematics. Higher temperature (0.7–0.8) produces more varied reasoning traces for exploratory use.
<br>
---
<br>
<div align="center">
## Training Details
</div>
<br>
<table>
<tr>
<td width="50%" valign="top">
**Hardware**
| Component | Specification |
|:----------|:-------------|
| GPU | NVIDIA A100 40GB SXM4 |
| Precision | BF16 native |
| Framework | Unsloth 2026.4 + TRL |
| Flash Attention | Xformers fallback |
| Cloud Compute | Colab A100 |
</td>
<td width="50%" valign="top">
**LoRA Configuration**
| Parameter | Value |
|:----------|:-----:|
| Rank (r) | 16 |
| Alpha | 32 |
| Dropout | 0.0 |
| Target Modules | q, k, v, o, gate, up, down |
| Trainable Parameters | ~83M |
| Gradient Checkpointing | Unsloth smart offload |
</td>
</tr>
</table>
<br>
**Optimizer Configuration**
| Parameter | Value |
|:----------|:-----:|
| Optimizer | AdamW 8-bit |
| Learning Rate | 2e-4 |
| LR Scheduler | Cosine |
| Warmup Steps | 100 |
| Weight Decay | 0.01 |
| Effective Batch Size | 16 |
| Max Sequence Length | 4,096 tokens |
<br>
### Training Curriculum
YuuKi RxG was trained using the same three-phase curriculum architecture established across the OpceanAI model families, adapted for a reasoning-first base model.
<br>
<table>
<tr>
<td width="33%" valign="top">
**Phase 1 — Identity**
3 epochs
| Source | Ratio |
|:-------|:-----:|
| Yuuki dataset | 65% |
| Reasoning pairs | 20% |
| Math instruction | 10% |
| General alignment | 5% |
*Establish YuuKi identity over DeepSeek-R1 base without degrading reasoning capability.*
</td>
<td width="33%" valign="top">
**Phase 2 — Reasoning**
2 epochs
| Source | Ratio |
|:-------|:-----:|
| Yuuki dataset | 40% |
| Reasoning pairs | 30% |
| Math instruction | 20% |
| General alignment | 10% |
*Reinforce structured chain-of-thought and competition-level mathematical reasoning.*
</td>
<td width="33%" valign="top">
**Phase 3 — Consolidation**
2 epochs
| Source | Ratio |
|:-------|:-----:|
| Yuuki dataset | 80% |
| Reasoning pairs | 10% |
| Math instruction | 10% |
| General alignment | 0% |
*Consolidate behavioral consistency and prevent capability regression.*
</td>
</tr>
</table>
<br>
---
<br>
<div align="center">
## Available Files
</div>
<br>
| File | Format | Description |
|:-----|:------:|:------------|
| `model.safetensors` | BF16 merged | Full precision weights, LoRA merged into base |
| `yuuki-rxg-8b.Q8_0.gguf` | GGUF Q8\_0 | Quantized for llama.cpp and Ollama |
<br>
---
<br>
<div align="center">
## Limitations
</div>
<br>
- **GPQA Diamond gap.** RxG scores 64.0% on GPQA Diamond, below Gemini-2.5-Flash-Thinking (82.8%) and o3-mini (76.8%). This benchmark tests graduate-level science reasoning across physics, chemistry, and biology — domains underrepresented in the Yuuki training dataset. This is a known gap and a target for the RxG 14B release.
- **LiveCodeBench.** Code generation at 62.0% is competitive but not leading at this scale. RxG is not primarily a coding model; this capability is inherited from the DeepSeek-R1 base.
- **Context utilization.** While the model supports 32,768 tokens, fine-tuning was conducted at 4,096 tokens. Performance on tasks requiring full context utilization beyond 4,096 tokens has not been formally evaluated.
- **Safety alignment** has not been formally evaluated under adversarial conditions. Not recommended for high-stakes or safety-critical deployment without additional review.
<br>
---
<br>
<div align="center">
## The RxG Family
</div>
<br>
RxG is the reasoning-specialized lineage within the OpceanAI ecosystem. Each release targets a specific parameter regime and capability tier.
| Model | Parameters | Status | Primary Target |
|:------|:----------:|:------:|:---------------|
| YuuKi RxG Nano | 1.5B | In development | Edge deployment, reasoning baseline |
| YuuKi RxG 8B | 8B | Released | General reasoning, competition math |
| YuuKi RxG VL 27B | 27B | Planned | Multimodal reasoning, flagship |
<br>
---
<br>
<div align="center">
## OpceanAI Ecosystem
</div>
<br>
| Model | Family | Parameters | Description |
|:------|:------:|:----------:|:------------|
| [YuuKi RxG 8B](https://huggingface.co/OpceanAI/Yuuki-RxG) | RxG | 8B | Reasoning flagship, TruthfulQA 96.6% |
| [Yumo Nano](https://huggingface.co/OpceanAI/yumo-nano) | Yumo | 1.5B | Math specialist, surpasses DeepScaleR |
| [YuuKi NxG VL](https://huggingface.co/OpceanAI/Yuuki-NxG-VL) | NxG | 7B | General conversation + vision |
<br>
---
<br>
<div align="center">
## Links
</div>
<br>
<div align="center">
[![Model Weights](https://img.shields.io/badge/Model_Weights-Hugging_Face-ffd21e?style=for-the-badge&logo=huggingface&logoColor=black)](https://huggingface.co/OpceanAI/Yuuki-RxG)
&nbsp;
[![GGUF Q8](https://img.shields.io/badge/GGUF_Q8-Download-1a1a2e?style=for-the-badge&logo=huggingface&logoColor=white)](https://huggingface.co/OpceanAI/Yuuki-RxG)
&nbsp;
[![OpceanAI](https://img.shields.io/badge/OpceanAI-Organization-1a1a2e?style=for-the-badge&logo=huggingface&logoColor=white)](https://huggingface.co/OpceanAI)
<br>
[![GitHub](https://img.shields.io/badge/GitHub-aguitauwu-181717?style=for-the-badge&logo=github&logoColor=white)](https://github.com/aguitauwu)
&nbsp;
[![Sponsor](https://img.shields.io/badge/Sponsor-GitHub_Sponsors-ea4aaa?style=for-the-badge&logo=githubsponsors&logoColor=white)](https://github.com/sponsors/aguitauwu)
&nbsp;
[![Discord](https://img.shields.io/badge/Discord-Community-5865F2?style=for-the-badge&logo=discord&logoColor=white)](https://discord.gg/j8zV2u8k)
</div>
<br>
---
<br>
<div align="center">
## Citation
</div>
<br>
```bibtex
@misc{awa_omg_2026,
author = { awa_omg },
title = { Yuuki-RxG (Revision 7996797) },
year = 2026,
url = { https://huggingface.co/OpceanAI/Yuuki-RxG },
doi = { 10.57967/hf/8342 },
publisher = { Hugging Face }
}
```
<br>
---
<br>
<div align="center">
## License
</div>
<br>
```
Apache License 2.0
Copyright (c) 2026 OpceanAI
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
```
Inherits license terms from [DeepSeek-R1-Distill-Qwen-8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-8B).
<br>
---
<br>
<div align="center">
## Updates
</div>
<br>
| Date | Milestone |
|:-----|:----------|
| **2026-04-09** | TruthfulQA 96.6% independently verified across three evaluation runs |
| **2026-04-09** | AIME 2024: 87.3% — surpasses DeepSeek-R1-8B |
| **2026-04-09** | GGUF Q8\_0 export available |
| **2026-04-09** | YuuKi RxG 8B v1.0 released on Hugging Face |
**Last updated:** 2026-04-09
<br>
---
<br>
<div align="center">
**8B parameters. The most capable model OpceanAI has released.**<br>
**Surpasses its base model. Competitive with systems an order of magnitude larger.**
<br>
[![OpceanAI](https://img.shields.io/badge/OpceanAI-2026-0D1117?style=for-the-badge)](https://huggingface.co/OpceanAI)
<br>
*The RxG family. More releases coming.*
</div>
Reference in New Issue Copy Permalink