DistilBERT-Gemini3.2-Pro.Fast.Coder.NSFW-0.1B is a fully fine-tuned version of DistilGPT2 — exposed to an aggressive curriculum of high-reasoning Gemini distillation traces, comprehensive coding datasets, creative writing frameworks, and mature internet discourse.
The model is designed to act as a highly responsive, analytical engine capable of deep structural reasoning and complex logic emulation. Despite its compact 81.9M parameter footprint, it targets multi-domain competence across code generation, reasoning chains, and open-ended text generation.
Trained natively at an accelerated maximum learning rate with a cosine decay schedule, the model synthesizes diverse programmatic and theoretical domains from a massive multi-repository corpus, processed at DistilGPT2's maximum context window of 1024 tokens.
Fine-tuned on a synthesized Golden Mix drawn from eight multi-domain repositories:
The model underwent full fine-tuning — no adapters or LoRA. All native DistilGPT2 parameters were globally updated. The training harness dynamically parsed heavily nested dataset repositories, enforcing a strict shape constraint to generate mathematically perfect 1024-token continuous sequences, maxing out the model's context window.
Released under the Apache 2.0 license. Free to use, modify, and distribute with attribution.
Base model: distilbert/distilgpt2 by HuggingFace / DistilBERT team. Model card authored for: WithinUsAI.