初始化项目，由ModelHub XC社区提供模型

Model: JNX25/studyverse-smollm2-instruct
Source: Original Platform

.gitattributes

@@ -0,0 +1,35 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,73 @@
+---
+license: apache-2.0
+base_model: lofofora/smollm2-135m-instruction-tuning-v0
+tags:
+- text-generation-inference
+- transformers
+- smollm2
+- conversational
+- studyverse
+- instruction-tuned
+languages:
+- en
+pipeline_tag: text-generation
+---
+
+# 🚀 CosmiQ AI — The Intelligent Assistant
+
+**CosmiQ AI** is a highly-optimized, lightweight Small Language Model (SLM) designed for swift, multi-turn assistant-style conversations. Built on top of the **SmolLM2 (135M)** architecture, this model is fine-tuned to enable efficient, low-latency text generation directly on edge devices such as mobile phones and standard laptops without requiring heavy GPU infrastructure.
+
+## 🏗️ Model Architecture
+CosmiQ AI leverages a compact yet powerful architecture heavily inspired by the structural refinements found in foundational models like Llama-3:
+- **Architecture Type:** Autoregressive Decoder-Only Transformer
+- **Parameters:** 135 Million (13.5 Crore) — Perfect for local deployment with an extremely low memory footprint.
+- **Attention Mechanism:** Grouped-Query Attention (GQA) to accelerate text streaming speed and optimize Key-Value (KV) cache utilization.
+- **Position Embeddings:** Rotary Position Embedding (RoPE) for stable long-context processing.
+- **Vocabulary Size:** 49,152 tokens.
+
+## 🧠 Training Methodology & Algorithms
+The raw foundational knowledge was aligned into a conversational, assistant-ready state using two core paradigms:
+1. **Supervised Fine-Tuning (SFT):** The model underwent strict optimization to understand multi-turn conversation syntaxes, explicitly learning to track boundaries using special chat markers like `<|im_start|>user` and `<|im_start|>assistant`.
+2. **Direct Preference Optimization (DPO):** Aligned through preference optimization to output concise, factual, and helpful multi-turn responses while actively penalizing repetitive or unhelpful generations.
+
+## 📊 Dataset Insights
+The stellar accuracy of this 135M parameter model is a direct result of being trained on highly curated, high-quality synthetic datasets rather than unverified scraped web text:
+- **Cosmopedia v2:** A massive synthetic dataset containing high-quality textbooks, structured academic tutorials, and educational narratives scaled using larger foundational models (like Mixtral). This enables CosmiQ AI to excel exceptionally well at science and academic queries (e.g., explaining photosynthesis, stomata, etc.).
+- **UltraChat & UltraFeedback:** Highly polished conversational data used during instruction fine-tuning to perfect the model’s persona, social interaction, and question-answering conversational flow.
+
+## 🚀 Deployment & Integration
+This model is actively hosted and integrated into production via **Hugging Face Spaces** using a robust streaming architecture:
+- **Frontend UI Framework:** Gradio 6
+- **Streaming Backend:** PyTorch `TextIteratorStreamer` running with advanced structural history filters to prevent null or misaligned conversational tensors from interrupting runtime processing.
+
+### Quick Usage via Transformers Pipeline
+You can test and run this model locally using the following Python script:
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+
+model_id = "JNX25/studyverse-smollm2-instruct"
+
+print("Loading Tokenizer & Model...")
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float32)
+
+# Structuring a conversational thread
+messages = [{"role": "user", "content": "Explain photosynthesis in one clear sentence."}]
+rendered_chat = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
+
+# Processing Tensors
+inputs = tokenizer(rendered_chat, return_tensors="pt")
+outputs = model.generate(
+    input_ids=inputs["input_ids"],
+    attention_mask=inputs["attention_mask"],
+    max_new_tokens=150,
+    do_sample=True,
+    temperature=0.7,
+    top_p=0.9,
+    eos_token_id=tokenizer.eos_token_id
+)
+
+print("\n--- Response ---")
+print(tokenizer.decode(outputs[0], skip_special_tokens=True))

chat_template.jinja

@@ -0,0 +1,6 @@
+{% for message in messages %}{% if loop.first and messages[0]['role'] != 'system' %}{{ '<|im_start|>system
+You are a helpful AI assistant named SmolLM, trained by Hugging Face<|im_end|>
+' }}{% endif %}{{'<|im_start|>' + message['role'] + '
+' + message['content'] + '<|im_end|>' + '
+'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant
+' }}{% endif %}

config.json

@@ -0,0 +1,40 @@
+{
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "dtype": "float32",
+  "eos_token_id": 2,
+  "head_dim": 64,
+  "hidden_act": "silu",
+  "hidden_size": 576,
+  "initializer_range": 0.041666666666666664,
+  "intermediate_size": 1536,
+  "is_llama_config": true,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 9,
+  "num_hidden_layers": 30,
+  "num_key_value_heads": 3,
+  "pad_token_id": 2,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_interleaved": false,
+  "rope_parameters": {
+    "rope_theta": 100000,
+    "rope_type": "default"
+  },
+  "tie_word_embeddings": true,
+  "transformers.js_config": {
+    "kv_cache_dtype": {
+      "fp16": "float16",
+      "q4f16": "float16"
+    }
+  },
+  "transformers_version": "5.0.0",
+  "use_cache": false,
+  "vocab_size": 49152
+}

generation_config.json

@@ -0,0 +1,7 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "pad_token_id": 2,
+  "transformers_version": "5.0.0"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:87fb303e9d347002947f3e4b817be530f513c0c178dbce045de44f909677c14b
+size 538090408

tokenizer_config.json

@@ -0,0 +1,17 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": "<|im_start|>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "extra_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "is_local": true,
+  "model_max_length": 8192,
+  "pad_token": "<|im_end|>",
+  "tokenizer_class": "TokenizersBackend",
+  "unk_token": "<|endoftext|>",
+  "vocab_size": 49152
+}