初始化项目，由ModelHub XC社区提供模型

Model: atenareply/smollm2-135m-noval-instruct
Source: Original Platform

.gitattributes

@@ -0,0 +1,35 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,79 @@
+---
+library_name: transformers
+pipeline_tag: text-generation
+language:
+  - en
+base_model:
+  - atenareply/smollm2-135m-noval
+  - HuggingFaceTB/SmolLM2-135M
+datasets:
+  - atenareply/noval-corp-sft-small
+  - HuggingFaceTB/smol-smoltalk
+tags:
+  - smollm2
+  - sft
+  - instruction-tuning
+  - chatml
+license: apache-2.0
+---
+
+# SmolLM2-135M Noval — Instruct (SFT)
+
+Instruction-tuned domain assistant: SFT of the 135M CPT model on grounded domain instruction pairs blended with general instructions.
+
+## Overview
+
+- **Stage**: SFT (TRL SFTTrainer, ChatML, assistant-only loss)
+- **Lineage**: SmolLM2-135M → CPT (noval) → **SFT** (this model)
+- **Method**: SFT from the CPT'd checkpoint. ChatML with a `{% generation %}` block + assistant-only loss; grounded instruction pairs (teacher-distilled, generator≠judge, verbatim-number grounding filter [[genie]](#citations)) blended 60/40 with smol-smoltalk [[collapse]](#citations).
+- **Domain**: fictional — Orbital Mining Corporation (OMC) technical docs + Mars Express telemetry.
+
+## Training
+
+| | |
+|---|---|
+| Dataset | noval-corp-sft-small — train 1,388 / val 43 (chat `messages`) |
+| LR / epochs | 2e-5 cosine, warmup 0.03, 3 epochs, max_len 2048, eff_batch 32 |
+
+## Evaluation
+
+| Metric | Value | Note |
+|---|---|---|
+| train_loss | **2.257** | healthy curve, no overfit |
+| eval_loss | **1.946** | per-epoch 2.048 → 1.959 → 1.946 |
+| token accuracy | **0.57** | 0.47 → 0.57 |
+
+_Eval is a held-out, deterministic verifiable harness (synthetic tasks); baseline = the pre-SFT ParamΔ model. See `noval-corp/scripts/eval_agentic.py`._
+
+## Intended use & limitations
+
+Domain Q&A / summarization / code-explanation over OMC / Mars-Express, in chat (ChatML) format.
+
+**Limitations:**
+- 135M instruct is intrinsically limited.
+- Instruction-following eval was handed off externally (no in-repo task metrics).
+- Fictional domain; sparse one-off entities hallucination-prone.
+
+## Innovations tested
+
+- **Local-subscription teacher distillation** — grounded pairs generated by Claude Code (generator ≠ judge), with a rule-based verbatim-number grounding gate [[genie]](#citations).
+
+## Usage
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+tok = AutoTokenizer.from_pretrained("atenareply/smollm2-135m-noval-instruct")
+model = AutoModelForCausalLM.from_pretrained("atenareply/smollm2-135m-noval-instruct")
+msgs = [{"role": "user", "content": "What does the Orbital Mining Corporation do?"}]
+inputs = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt", return_dict=True)
+print(tok.decode(model.generate(**inputs, max_new_tokens=256)[0, inputs["input_ids"].shape[1]:], skip_special_tokens=True))
+```
+
+## Citations
+
+- GENIE (grounded synthesis) — Mirza et al., ICLR 2024. arXiv:2401.14367
+- Model collapse (≥50% real data) — Shumailov et al., 2024. arXiv:2404.01413
+
+---
+_Card generated by `noval-corp/scripts/gen_model_cards.py` (standardized across the noval-corp model family)._

chat_template.jinja

@@ -0,0 +1,5 @@
+{% for message in messages %}{{ '<|im_start|>' + message['role'] + '
+' }}{% if message['role'] == 'assistant' %}{% generation %}{{ message['content'] + '<|im_end|>' + '
+' }}{% endgeneration %}{% else %}{{ message['content'] + '<|im_end|>' + '
+' }}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant
+' }}{% endif %}

config.json

@@ -0,0 +1,34 @@
+{
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 0,
+  "dtype": "float32",
+  "eos_token_id": 2,
+  "head_dim": 64,
+  "hidden_act": "silu",
+  "hidden_size": 576,
+  "initializer_range": 0.041666666666666664,
+  "intermediate_size": 1536,
+  "is_llama_config": true,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 9,
+  "num_hidden_layers": 30,
+  "num_key_value_heads": 3,
+  "pad_token_id": 0,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_interleaved": false,
+  "rope_parameters": {
+    "rope_theta": 100000,
+    "rope_type": "default"
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.12.1",
+  "use_cache": false,
+  "vocab_size": 49152
+}

generation_config.json

@@ -0,0 +1,10 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "eos_token_id": [
+    2,
+    0
+  ],
+  "pad_token_id": 0,
+  "transformers_version": "5.12.1"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c8e24d6be45ee66e3ae9f17233eb45d63c9e80e1b38bf33afa2f7ed362eacaed
+size 538090408

tokenizer_config.json

@@ -0,0 +1,34 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": "<|endoftext|>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": [
+    "<|endoftext|>",
+    "<|im_start|>",
+    "<|im_end|>",
+    "<repo_name>",
+    "<reponame>",
+    "<file_sep>",
+    "<filename>",
+    "<gh_stars>",
+    "<issue_start>",
+    "<issue_comment>",
+    "<issue_closed>",
+    "<jupyter_start>",
+    "<jupyter_text>",
+    "<jupyter_code>",
+    "<jupyter_output>",
+    "<jupyter_script>",
+    "<empty_output>"
+  ],
+  "is_local": false,
+  "local_files_only": false,
+  "model_max_length": 8192,
+  "pad_token": "<|endoftext|>",
+  "tokenizer_class": "GPT2Tokenizer",
+  "unk_token": "<|endoftext|>",
+  "vocab_size": 49152
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f7d10d9dbb65abfb535d433da07fdca6eaa7c56d03baa2e7add3f12f4bab2fa1
+size 5841