language, license, library_name, pipeline_tag, tags, base_model, model-index

language	license	library_name	pipeline_tag	tags	base_model	model-index
en	apache-2.0	transformers	text-generation	small-language-model causal-lm qwen2 0.5b reasoning benchmarked	Qwen/Qwen2.5-32B	name results SLM-FRIDGE-0.5B task dataset metrics type name multiple-choice Massive Multitask Language Understanding (MMLU) name type MMLU cais/mmlu type value name accuracy 47.59 Accuracy task dataset metrics type name question-answering ARC Challenge name type config ARC Challenge ai2_arc ARC-Challenge type value name accuracy 29.01 Accuracy type value name normalized_accuracy 32.76 Normalized Accuracy task dataset metrics type name mathematical-reasoning GSM8K name type GSM8K gsm8k type value name exact_match 35.33 Exact Match (5-shot) task dataset metrics type name commonsense-reasoning HellaSwag name type HellaSwag hellaswag type value name accuracy 40.68 Accuracy type value name normalized_accuracy 52.18 Normalized Accuracy task dataset metrics type name multiple-choice TruthfulQA MC2 name type config TruthfulQA truthful_qa multiple_choice type value name accuracy 39.77 Accuracy task dataset metrics type name commonsense-reasoning Winogrande name type Winogrande winogrande type value name accuracy 56.51 Accuracy

SLM FRIDGE - ICED MODEL [32b Qwen Shadow-v1.5.p] (Quantum-Inspired Cross-Dimensional Shadow Projection)

Welcome to the SLM FRIDGE - ICED MODEL repository. This project features a revolutionary Cross-Dimensional Manifold Projection (CDMP) engine that takes high-dimensional alignment properties from 7B models and projects them directly into 1.5B (1B-class) student models without traditional student-teacher training or memory-intensive distillation.

---

Mathematical Philosophy: Cross-Dimensional Manifold Projection (CDMP)

Traditional parameter merging assumes identical parameter dimensions between models.
CDMP transfers instruction-following behavior from a higher-dimensional teacher model into a lower-dimensional student model through manifold projection.

1. Extracting the Instruction Alignment Delta

The instruction-tuning signal is isolated from the teacher model:

\Delta W_{\text{high}}
=
W_{\text{teacher\_instruct}}
-
W_{\text{teacher\_base}}

---

2. Manifold Subspace Decomposition

The alignment delta is decomposed using Singular Value Decomposition (SVD):

\Delta W_{\text{high}}
\approx
U_{\text{high}}
\Sigma_{\text{high}}
V_{\text{high}}^{T}

Where:

U_{\text{high}} \in \mathbb{R}^{m \times r}

\Sigma_{\text{high}} \in \mathbb{R}^{r \times r}

V_{\text{high}} \in \mathbb{R}^{n \times r}

---

3. Cross-Dimensional Projection

The singular manifolds are projected into the student's dimensional space while preserving the dominant singular energy spectrum.

Output-space projection:

U_{\text{low}}
=
\operatorname{Project}
\left(
U_{\text{high}},
d_{\text{low,out}}
\right)

Input-space projection:

V_{\text{low}}
=
\operatorname{Project}
\left(
V_{\text{high}},
d_{\text{low,in}}
\right)

Projected alignment manifold:

\Delta W_{\text{proj}}
=
U_{\text{low}}
\Sigma_{\text{high}}
V_{\text{low}}^{T}

---

4. Instruction Manifold Infusion

The projected manifold is infused into the student base model:

W_{\text{ICED}}
=
W_{\text{student\_base}}
+
\alpha
\Delta W_{\text{proj}}

Expanded form:

W_{\text{ICED}}
=
W_{\text{student\_base}}
+
\alpha
\left(
U_{\text{low}}
\Sigma_{\text{high}}
V_{\text{low}}^{T}
\right)

Where:

• α = infusion coefficient
• α = 0 preserves the original student model
• Higher α values increase transferred instruction behavior

---

Conceptual Overview

CDMP treats instruction tuning as a transferable low-rank manifold rather than a direct parameter delta.

The procedure is:

1. Extract the instruction alignment delta from the teacher.
2. Decompose the delta into its dominant singular structures.
3. Project those structures into the student's dimensional space.
4. Reconstruct the projected manifold.
5. Infuse the resulting manifold into the student model.

Transfer Path

\text{Teacher}_{7B}
\;\longrightarrow\;
\text{CDMP Projection}
\;\longrightarrow\;
\text{Student}_{1.5B}

This enables cross-scale instruction transfer without requiring identical parameter dimensions.

Technical Performance Benchmark & Comprehensive Comparison

Below is the comparative report highlighting the performance profile of the original models alongside our newly minted Cross-Projected ICED Model (rank = 24):

---

1. Output Generational Preview

Test Prompt:

"Machine learning is transforming the world by"

Original Base Student (7B) Generation:

Machine learning is transforming the world by providing powerful tools for solving complex problems in a wide range of domains. In this post, we’ll explore how machine learning can be used to solve real-world problems and make predictions about future events. In order to do that, let’s first look at what exactly machine learning is. Machine Learning (ML

ICED Model Generation (With 32B Infused Brain):

Machine learning is transforming the world by providing powerful insights into complex data. But what about privacy? Can we use machine learning to protect our personal information while still getting valuable results? The answer lies in differential privacy, a mathematical framework that ensures sensitive data remains private even as it’s used for analysis. In this blog post, we’ll explore

---

Production Deployment Instructions

The resulting model weights and tokenizer are completely ready for production:

from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("loaiabdalslam/SLM-FRIDGE-ICED-0.5B-32BQWEN")
model = AutoModelForCausalLM.from_pretrained("loaiabdalslam/SLM-FRIDGE-ICED-0.5B-32BQWEN")