初始化项目,由ModelHub XC社区提供模型

Model: AbteeXAILab/lumynax-longctx-yi-9b-200k
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-10 18:44:19 +08:00
commit 55906c516c
27 changed files with 177305 additions and 0 deletions

35
.gitattributes vendored Normal file
View File

@@ -0,0 +1,35 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

15
LICENSE.txt Normal file
View File

@@ -0,0 +1,15 @@
LumynaX release package — distribution scaffold
This Hugging Face repository contains the LumynaX release scaffold for the
upstream model identified in `release_export_manifest.json`. The model weights
themselves remain governed by the upstream licence at `metadata.upstream_repo`
and are fetched by the runtime via Hugging Face Hub when you execute
`quickstart.py`.
The scaffold (configs, manifest, quickstart, ollama Modelfile, Space app) is
released under the MIT licence by AbteeX AI Labs (Aotearoa New Zealand). Your
use of the *upstream weights* is governed by the *upstream licence*; this file
does not relicense them.
Provenance, residency and audit obligations are defined in
`release_export_manifest.json` and the model card.

238
README.md Normal file
View File

@@ -0,0 +1,238 @@
---
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
language:
- en
- mi
tags:
- 200k
- abteex-ai-labs
- aotearoa
- local-first
- long-context
- lumynax
- new-zealand
- sovereign-ai
- yi
- vllm
- vllm-compatible
- vllm-candidate
- nvidia-nim
- nim-compatible
- nim-candidate
- nvidia-nemo
- nem
- nvidia-nemo-compatible
- nem-compatible
- nemo-candidate
---
# LumynaX Long-Context Yi-9B 200K
<!-- lumynax-public-release-card:v4 -->
<p align="center">
<img src="docs/lumynax-release-overview.svg" alt="LumynaX Long-Context Yi-9B 200K release overview" width="100%" />
</p>
<p align="center">
<strong>LumynaX model-infusion release by AbteeX AI Labs.</strong><br/>
Public, non-gated package with runnable local instructions, provenance metadata, checksums, and a release manifest.
</p>
<p align="center">
<a href="#quickstart">Quickstart</a> |
<a href="#model-profile">Model profile</a> |
<a href="#runtime-files">Runtime files</a> |
<a href="#provenance-and-license">Provenance</a> |
<a href="#validation-status">Validation</a> |
<a href="#limitations-and-responsible-use">Limitations</a>
</p>
![LumynaX: infusion release](https://img.shields.io/badge/LumynaX-infusion%20release-e08a2c) ![access: not recorded](https://img.shields.io/badge/access-not%20recorded-0a0a0b) ![runtime: transformers](https://img.shields.io/badge/runtime-transformers-726b62) ![format: HF weights](https://img.shields.io/badge/format-HF%20weights-9a5416) ![audit: not recorded](https://img.shields.io/badge/audit-not%20recorded-4d6b44) ![docs: v4](https://img.shields.io/badge/docs-v4-111827)
## Executive Summary
This repository is a complete LumynaX release package for `AbteeXAILab/lumynax-longctx-yi-9b-200k`. It is intended to be downloaded as a whole repo, not as a single loose weight file: the model artifact, `quickstart.py`, `requirements.txt`, `release_export_manifest.json`, `checksums.sha256`, license notice, and optional Ollama or Space files are part of the same release contract.
LumynaX-infused means the upstream artifact is presented through the LumynaX release layer: local-first runtime scaffolding, LumynaX assistant identity, inference-chain metadata, public documentation, integrity files, and Aotearoa New Zealand-oriented workflow positioning. The release manifest is the source of truth for whether this package is upstream-weight packaging, a dense LumynaX release, or another release mode.
## AbteeX LumynaX Public Surface
This card follows the AbteeX/LumynaX public-facing system used across the release family: warm paper background visuals, black editorial typography, amber proof markers, compact evidence tables, and plain-language runtime instructions. The goal is not decoration; it is operational clarity. A downloader should immediately understand what the package is, what files belong together, what runtime path is expected, what provenance is available, and what limits still apply.
## Sovereignty And Run Contract
| Field | Value |
| --- | --- |
| Public surface | AbteeX/LumynaX light editorial system: warm paper, black ink, amber status markers, and evidence-first tables. |
| Sovereign intent | Package is documented for local-first use, explicit provenance, and controlled deployment near governed data. |
| Runtime residency | `transformers` runtime can be deployed by the user in their own approved environment. |
| Model artifact | `model-00002-of-00004.safetensors` must stay with manifest, checksums, quickstart, requirements, and license files. |
| Modalities | `text` |
| License discipline | `apache-2.0` metadata is surfaced so downstream users can check redistribution and usage terms. |
| Audit expectation | Record repo id, artifact checksum, runtime command, prompt template, operator, and deployment environment for production use. |
| Router readiness | Compatible with the LumynaX MaramaRoute registry pattern for sovereign model selection and fallback planning. |
## Quickstart
```bash
hf download AbteeXAILab/lumynax-longctx-yi-9b-200k --local-dir lumynax-longctx-yi-9b-200k
cd lumynax-longctx-yi-9b-200k
pip install -r requirements.txt
python quickstart.py --interactive
```
Transformers first-load pattern:
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("AbteeXAILab/lumynax-longctx-yi-9b-200k", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("AbteeXAILab/lumynax-longctx-yi-9b-200k", device_map="auto", trust_remote_code=True)
prompt = "Who are you? Answer as LumynaX in two sentences."
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
output = model.generate(**inputs, max_new_tokens=160)
print(tokenizer.decode(output[0], skip_special_tokens=True))
```
For multimodal Transformers packages, use the package `quickstart.py` or upstream processor class when `AutoModelForCausalLM` is not the correct loader.
## Model Profile
| Field | Value |
| --- | --- |
| Release | `LumynaX Long-Context Yi-9B 200K` |
| Repository | `AbteeXAILab/lumynax-longctx-yi-9b-200k` |
| Mode | `Local-first text generation package` |
| Runtime | `transformers` |
| Prompt format | `See quickstart.py` |
| Modalities | `text` |
| Primary artifact | `model-00002-of-00004.safetensors` |
| Detected weight size | `16.45 GB` |
| Package state | `weights_mirrored` |
| Delivery | `published_model_repo` |
| Upstream/base | `See release_export_manifest.json` |
| Upstream kind | `See manifest` |
| Source GGUF | `not applicable` |
| Quantization | `bf16 safetensors (sharded)` |
| License metadata | `apache-2.0` |
| Refreshed | `2026-05-11` |
## Runtime Path
<p align="center">
<img src="docs/lumynax-runtime-flow.svg" alt="LumynaX Long-Context Yi-9B 200K runtime flow" width="100%" />
</p>
## Capability Profile
| Field | Value |
| --- | --- |
| Primary fit | Use this for local chat, drafting, summarization, governance notes, and repeatable offline-friendly inference. |
| Operational style | Local-first package with explicit files, checksums, and reproducible quickstarts. |
| Identity behavior | The assistant should identify as LumynaX while remaining clear about upstream provenance. |
## Runtime Files
| Component | Status | Path |
| --- | --- | --- |
| README.md | `present` | `README.md` |
| Quickstart | `present` | `quickstart.py` |
| Requirements | `present` | `requirements.txt` |
| Manifest | `present` | `release_export_manifest.json` |
| Checksums | `present` | `checksums.sha256` |
| License | `present` | `LICENSE.txt` |
| Ollama | `present` | `ollama/Modelfile` |
| Space scaffold | `present` | `hf_space/app.py` |
| Overview visual | `present` | `docs/lumynax-release-overview.svg` |
| Runtime visual | `present` | `docs/lumynax-runtime-flow.svg` |
## Model Artifacts
| Artifact | Size |
| --- | ---: |
| `model-00002-of-00004.safetensors` | 4.64 GB |
| `model-00003-of-00004.safetensors` | 4.63 GB |
| `model-00001-of-00004.safetensors` | 4.59 GB |
| `model-00004-of-00004.safetensors` | 2.59 GB |
## Prompting Contract
The preferred first prompt is an identity and provenance check:
```text
Who are you? What files do I need to keep together to run this package locally?
```
Expected behavior: the assistant should identify as LumynaX, explain that this is a LumynaX model-infusion package, and keep upstream provenance visible. The default package system prompt is:
```text
See quickstart.py
```
## Validation Status
| Field | Value |
| --- | --- |
| Runtime audit | `not recorded` |
| Public access audit | `not recorded` |
| Anonymous metadata access | `False` |
| Anonymous file listing | `False` |
| Quickstart syntax | `not recorded` |
| Manifest references | `pass` |
| Checksum references | `pass` |
The audit confirms public access, required release files, manifest references, checksum references, weight artifact presence, and quickstart syntax. It does not guarantee that every laptop has enough RAM or VRAM for the largest packages.
## Integrity Checks
After download, compare the model artifact against `checksums.sha256`.
```bash
sha256sum "model-00002-of-00004.safetensors"
cat checksums.sha256
```
On Windows PowerShell:
```powershell
Get-FileHash -Algorithm SHA256 "model-00002-of-00004.safetensors"
Get-Content checksums.sha256
```
## Provenance And License
- Publisher: AbteeX AI Labs.
- Family: LumynaX model and inference-chain release family.
- Upstream/base: `See release_export_manifest.json`.
- Source GGUF: `not applicable`.
- License metadata: `apache-2.0`.
- License link: `LICENSE.txt` and upstream model card.
Respect the upstream model license and keep attribution files with redistributed copies. Do not present this package as privately trained or weight-merged unless the release manifest explicitly says that weight adaptation was applied.
## Limitations And Responsible Use
- Outputs can be incorrect, incomplete, or biased; validate important answers before use.
- Larger GGUF, MoE, multimodal, and frontier packages may require substantial RAM, VRAM, disk space, and recent runtime builds.
- For high-impact decisions, use human review and domain-specific evaluation.
- For sensitive data, prefer local execution and keep operational logs under your own governance policy.
- This card documents package readiness and access; it is not a benchmark claim.
## Automation Notes
Automation should read these files before launching:
- `release_export_manifest.json`
- `checksums.sha256`
- `quickstart.py`
- `requirements.txt`
- `ollama/Modelfile` when present
## Related LumynaX Demo
Try the public browser demo:
- https://huggingface.co/spaces/AbteeXAILab/lumynax-live-demo

14
UPLOAD_TO_HF.md Normal file
View File

@@ -0,0 +1,14 @@
# Upload checklist (AbteeX AI Labs)
This scaffold was generated and pushed by `S:\hf-publish\add_8_more_models.py`.
The repo is structured to be cloned whole and verified locally before running.
```bash
hf download AbteeXAILab/lumynax-longctx-yi-9b-200k --local-dir lumynax-longctx-yi-9b-200k
cd lumynax-longctx-yi-9b-200k
pip install -r requirements.txt
python quickstart.py --interactive
```
To regenerate or refresh, re-run the script — `huggingface_hub.HfApi.upload_folder`
is idempotent.

1
VERSION.txt Normal file
View File

@@ -0,0 +1 @@
v0.1.0

9
checksums.sha256 Normal file
View File

@@ -0,0 +1,9 @@
601956b52f7e59484c150ec4b1e9b1186adc331bf92c4a7127834ba2ff70a968 LICENSE.txt
d0b4f9120ba026c00fa23cb84b4e1620a2e6436592e58155a5151653179572c0 VERSION.txt
0e898ce24132ecc609ee22a8614ab2f5b6a54501fa650536eb295e0d331f3a5e ollama/Modelfile
214fd1b57530816b9e38cdceff4943e5b664dbb50b1d1cf7530201e17215b89b quickstart.py
40e982a9baef6f2f2b42f5c130910fba245ce982e861fe15936804ab513648ae release_export_manifest.json
dd873da1e34bee536b535b05ffe41bbeeacaa9d106db9463ae0f4abe2f07dff8 requirements.txt
89a96b3e9f2d77a73ecb212b8fcb8c652b5ee72fcf8aac3eb507b1ee4f084bd5 README.md
5e65667c6c17ed1e0eba319bbd02272953456914a563f4b128711e44606bb0ba docs/lumynax-release-overview.svg
10eb7b61c96d5c4c062911dd63ddb17f1984560af6e4bd35b1448dbf7841a7c1 docs/lumynax-runtime-flow.svg

28
config.json Normal file
View File

@@ -0,0 +1,28 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 1,
"eos_token_id": 2,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 11008,
"max_position_embeddings": 262144,
"model_type": "llama",
"num_attention_heads": 32,
"num_hidden_layers": 48,
"num_key_value_heads": 4,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_scaling": null,
"rope_theta": 10000000.0,
"tie_word_embeddings": false,
"torch_dtype": "bfloat16",
"transformers_version": "4.37.2",
"use_cache": true,
"vocab_size": 64000
}

View File

@@ -0,0 +1,12 @@
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 900 260" role="img" aria-label="LumynaX capability profile">
<rect width="900" height="260" fill="#fffefa"/>
<rect x="0" y="0" width="900" height="3" fill="#0a0a0b"/>
<text x="64" y="36" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.18em" fill="#9a5416">CAPABILITY PROFILE</text>
<text x="64" y="58" font-family="Georgia, Cambria, serif" font-size="18" font-weight="500" fill="#0a0a0b">Where this model spends its weight.</text>
<g transform="translate(64,70)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">QUALITY</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="480" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">4/5</text></g>
<g transform="translate(64,98)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">LIGHTWEIGHT</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="360" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">3/5</text></g>
<g transform="translate(64,126)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">SOVEREIGNTY</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="360" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">3/5</text></g>
<g transform="translate(64,154)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">TOOLS</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="120" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">1/5</text></g>
<g transform="translate(64,182)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">JSON MODE</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">5/5</text></g>
<g transform="translate(64,210)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">CONTEXT</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">5/5</text></g>
</svg>

After

Width:  |  Height:  |  Size: 3.8 KiB

24
docs/lumynax-overview.svg Normal file
View File

@@ -0,0 +1,24 @@
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 1280 340" role="img" aria-label="LumynaX Long-Context Yi-9B 200K release banner">
<defs>
<linearGradient id="paperGrad" x1="0" y1="0" x2="0" y2="1">
<stop offset="0%" stop-color="#fffefa"/>
<stop offset="100%" stop-color="#f6f0e8"/>
</linearGradient>
</defs>
<rect width="1280" height="340" fill="url(#paperGrad)"/>
<rect x="860" y="0" width="420" height="4" fill="#e08a2c"/>
<rect x="0" y="336" width="1280" height="4" fill="#0a0a0b"/>
<text x="64" y="56" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="13" font-weight="700" letter-spacing="0.22em" fill="#9a5416">ABTEEX AI LABS &#183; AOTEAROA NEW ZEALAND</text>
<text x="64" y="78" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" letter-spacing="0.16em" fill="#726b62">LUMYNAX RELEASE &#183; CARD V6</text>
<text x="64" y="170" font-family="Georgia, Cambria, &quot;Times New Roman&quot;, serif" font-size="56" font-weight="500" fill="#0a0a0b">LumynaX Long-Context Yi-9B 200K</text>
<line x1="64" y1="196" x2="220" y2="196" stroke="#e08a2c" stroke-width="3"/>
<text x="64" y="226" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="13" fill="#726b62">AbteeXAILab/lumynax-longctx-yi-9b-200k</text>
<g transform="translate(64,262)"><rect width="110" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">FAMILY</text><text x="63" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">YI</text></g>
<g transform="translate(184,262)"><rect width="110" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">PARAMS</text><text x="63" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">9B</text></g>
<g transform="translate(304,262)"><rect width="163" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">RUNTIME</text><text x="70" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">transformers</text></g>
<g transform="translate(477,262)"><rect width="110" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">MODES</text><text x="56" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">TEXT</text></g>
<g transform="translate(597,262)"><rect width="191" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">QUANT</text><text x="56" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">bf16 safetensors (</text></g>
<g transform="translate(798,262)"><rect width="149" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">LICENSE</text><text x="70" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">apache-2.0</text></g>
<text x="1216" y="56" text-anchor="end" font-family="Georgia, Cambria, serif" font-size="18" font-style="italic" fill="#726b62">held in the light</text>
<text x="1216" y="80" text-anchor="end" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" letter-spacing="0.18em" fill="#9a5416">KO TE MARAMA TE TUAPAPA</text>
</svg>

After

Width:  |  Height:  |  Size: 4.4 KiB

View File

@@ -0,0 +1,51 @@
<svg xmlns="http://www.w3.org/2000/svg" width="1280" height="560" viewBox="0 0 1280 560" role="img" aria-labelledby="title desc">
<title id="title">LumynaX Long-Context Yi-9B 200K professional LumynaX release overview</title>
<desc id="desc">Professional release overview for AbteeXAILab/lumynax-longctx-yi-9b-200k showing provenance, LumynaX infusion layer, package artifact, and runtime path.</desc>
<defs>
<filter id="shadow" x="-12%" y="-12%" width="124%" height="124%"><feDropShadow dx="0" dy="10" stdDeviation="12" flood-color="#0a0a0b" flood-opacity="0.08"/></filter>
<marker id="arrowhead" markerWidth="12" markerHeight="8" refX="10" refY="4" orient="auto"><polygon points="0 0, 12 4, 0 8" fill="#e08a2c"/></marker>
</defs>
<style>
.title{fill:#0a0a0b;font:500 38px Georgia,serif}.sub{fill:#726b62;font:16px Aptos,Segoe UI,Arial}.eyebrow{fill:#9a5416;font:700 13px ui-monospace,Consolas,monospace;letter-spacing:2px}.rule{stroke:#0a0a0b;stroke-opacity:.12}.accent{stroke:#e08a2c;stroke-width:4}.card{fill:#ffffff;stroke:#0a0a0b;stroke-opacity:.12;stroke-width:1.2;filter:url(#shadow)}.num{fill:#ffffff;font:700 17px Aptos,Segoe UI,Arial}.numBg{fill:#0a0a0b}.label{fill:#0a0a0b;font:700 18px Aptos,Segoe UI,Arial}.body{fill:#5f574e;font:14px Aptos,Segoe UI,Arial}.chip{fill:#f6f0e8;stroke:#0a0a0b;stroke-opacity:.12}.chiptext{fill:#0a0a0b;font:700 12px ui-monospace,Consolas,monospace;letter-spacing:.7px}.line{stroke:#e08a2c;stroke-width:3;marker-end:url(#arrowhead)}
</style>
<rect width="1280" height="560" rx="28" fill="#fffefa"/>
<line class="accent" x1="852" y1="34" x2="1228" y2="34"/>
<line class="rule" x1="52" y1="160" x2="1228" y2="160"/>
<text class="eyebrow" x="52" y="58">ABTEEX AI LABS - LUMYNAX MODEL INFUSION RELEASE</text>
<text class="title" x="52" y="102">LumynaX Long-Context Yi-9B 200K</text>
<text class="sub" x="52" y="134">AbteeXAILab/lumynax-longctx-yi-9b-200k</text>
<rect class="card" x="52" y="205" width="270" height="155" rx="18"/>
<circle class="numBg" cx="86" cy="241" r="18"/>
<text class="num" x="80" y="247">1</text>
<text class="label" x="114" y="247">Upstream</text>
<text class="body" x="78" y="287">See release_export_manifest.json</text>
<line class="line" x1="331" y1="282.5" x2="344" y2="282.5"/>
<rect class="card" x="356" y="205" width="270" height="155" rx="18"/>
<circle class="numBg" cx="390" cy="241" r="18"/>
<text class="num" x="384" y="247">2</text>
<text class="label" x="418" y="247">LumynaX Infusion</text>
<text class="body" x="382" y="287">Identity, runtime scaffold,</text>
<text class="body" x="382" y="308">provenance, checksums</text>
<line class="line" x1="635" y1="282.5" x2="648" y2="282.5"/>
<rect class="card" x="660" y="205" width="270" height="155" rx="18"/>
<circle class="numBg" cx="694" cy="241" r="18"/>
<text class="num" x="688" y="247">3</text>
<text class="label" x="722" y="247">Release Package</text>
<text class="body" x="686" y="287">model-00002-of-00004.safetensors</text>
<line class="line" x1="939" y1="282.5" x2="952" y2="282.5"/>
<rect class="card" x="964" y="205" width="270" height="155" rx="18"/>
<circle class="numBg" cx="998" cy="241" r="18"/>
<text class="num" x="992" y="247">4</text>
<text class="label" x="1026" y="247">Runtime</text>
<text class="body" x="990" y="287">transformers</text>
<rect class="chip" x="52" y="420" width="190" height="40" rx="20"/>
<text class="chiptext" x="69" y="445">modalities: text</text>
<rect class="chip" x="258" y="420" width="190" height="40" rx="20"/>
<text class="chiptext" x="275" y="445">license: apache-2.0</text>
<rect class="chip" x="464" y="420" width="218" height="40" rx="20"/>
<text class="chiptext" x="481" y="445">state: weights_mirrored</text>
<rect class="chip" x="698" y="420" width="190" height="40" rx="20"/>
<text class="chiptext" x="715" y="445">audit: not recorded</text>
<line class="rule" x1="52" y1="496" x2="1228" y2="496"/>
<text class="sub" x="52" y="526">Download the complete repo so README, manifest, checksums, runtime files, and weights stay together.</text>
</svg>

After

Width:  |  Height:  |  Size: 3.9 KiB

View File

@@ -0,0 +1,35 @@
<svg xmlns="http://www.w3.org/2000/svg" width="1280" height="430" viewBox="0 0 1280 430" role="img" aria-labelledby="title desc">
<title id="title">LumynaX Long-Context Yi-9B 200K runtime flow</title>
<desc id="desc">Runtime flow for AbteeXAILab/lumynax-longctx-yi-9b-200k from download to verification, quickstart, and serving.</desc>
<defs>
<filter id="shadow" x="-12%" y="-12%" width="124%" height="124%"><feDropShadow dx="0" dy="10" stdDeviation="12" flood-color="#0a0a0b" flood-opacity="0.08"/></filter>
<marker id="arrowhead" markerWidth="12" markerHeight="8" refX="10" refY="4" orient="auto"><polygon points="0 0, 12 4, 0 8" fill="#e08a2c"/></marker>
</defs>
<style>
.title{fill:#0a0a0b;font:500 34px Georgia,serif}.sub{fill:#726b62;font:16px Aptos,Segoe UI,Arial}.eyebrow{fill:#9a5416;font:700 13px ui-monospace,Consolas,monospace;letter-spacing:2px}.rule{stroke:#0a0a0b;stroke-opacity:.12}.accent{stroke:#e08a2c;stroke-width:4}.box{fill:#ffffff;stroke:#0a0a0b;stroke-opacity:.12;stroke-width:1.2;filter:url(#shadow)}.label{fill:#0a0a0b;font:700 19px Aptos,Segoe UI,Arial}.body{fill:#5f574e;font:14px Aptos,Segoe UI,Arial}.line{stroke:#e08a2c;stroke-width:3;marker-end:url(#arrowhead)}.artifact{fill:#9a5416;font:700 14px ui-monospace,Consolas,monospace}
</style>
<rect width="1280" height="430" rx="24" fill="#fffefa"/>
<line class="accent" x1="856" y1="34" x2="1230" y2="34"/>
<text class="eyebrow" x="50" y="48">LOCAL-FIRST RUNTIME FLOW</text>
<text class="title" x="50" y="88">LumynaX Long-Context Yi-9B 200K Runtime Path</text>
<text class="sub" x="50" y="118">Primary artifact: model-00002-of-00004.safetensors</text>
<line class="rule" x1="50" y1="138" x2="1230" y2="138"/>
<rect class="box" x="64" y="178" width="245" height="118" rx="16"/>
<text class="label" x="86" y="220">Download</text>
<text class="body" x="86" y="251">hf download</text>
<text class="body" x="86" y="271">AbteeXAILab/lumynax-longctx-yi-9b-200k</text>
<line class="line" x1="324" y1="237.0" x2="349" y2="237.0"/>
<rect class="box" x="367" y="178" width="245" height="118" rx="16"/>
<text class="label" x="389" y="220">Verify</text>
<text class="body" x="389" y="251">checksums.sha256</text>
<line class="line" x1="627" y1="237.0" x2="652" y2="237.0"/>
<rect class="box" x="670" y="178" width="245" height="118" rx="16"/>
<text class="label" x="692" y="220">Run</text>
<text class="body" x="692" y="251">quickstart.py</text>
<line class="line" x1="930" y1="237.0" x2="955" y2="237.0"/>
<rect class="box" x="973" y="178" width="245" height="118" rx="16"/>
<text class="label" x="995" y="220">Serve</text>
<text class="body" x="995" y="251">transformers</text>
<line class="rule" x1="50" y1="340" x2="1230" y2="340"/>
<text class="artifact" x="50" y="375">Recommended first test: ask "Who are you?" and confirm the package answers with LumynaX identity plus honest provenance.</text>
</svg>

After

Width:  |  Height:  |  Size: 2.8 KiB

7
generation_config.json Normal file
View File

@@ -0,0 +1,7 @@
{
"_from_model_config": true,
"bos_token_id": 1,
"eos_token_id": 2,
"pad_token_id": 0,
"transformers_version": "4.37.2"
}

22
hf_space/README.md Normal file
View File

@@ -0,0 +1,22 @@
---
title: LumynaX Long-Context Yi-9B 200K
colorFrom: yellow
colorTo: gray
sdk: gradio
sdk_version: 5.50.0
python_version: 3.11
app_file: app.py
pinned: false
license: apache-2.0
short_description: Scaffold Space for the lumynax-longctx-yi-9b-200k LumynaX release.
tags:
- abteex-ai-labs
- lumynax
- sovereign-ai
- new-zealand
---
# LumynaX Long-Context Yi-9B 200K
Scaffold Space for `AbteeXAILab/lumynax-longctx-yi-9b-200k`. The actual model weights are too large to host on a free Space.
Clone the package repo and run `quickstart.py` locally for the real inference path.

27
hf_space/app.py Normal file
View File

@@ -0,0 +1,27 @@
import os
import gradio as gr
REPO_ID = "AbteeXAILab/lumynax-longctx-yi-9b-200k"
UPSTREAM = "01-ai/Yi-9B-200K"
TITLE = "LumynaX Long-Context Yi-9B 200K"
THEME_CSS = """
:root { --lx-paper:#fffefa; --lx-ink:#0a0a0b; --lx-amber:#e08a2c; }
body, .gradio-container { background: var(--lx-paper) !important; color: var(--lx-ink) !important; }
h1, h2, h3 { font-family: 'Cormorant Garamond', 'EB Garamond', Georgia, serif; }
"""
def chat_stub(message, history):
return (
f"This Space is a scaffold for **{TITLE}**. The upstream model is `{UPSTREAM}` "
f"and the LumynaX package repo is `{REPO_ID}`. Cloud inference for >100B MoE models "
f"is not run inside this free Space — clone the repo and run `quickstart.py` on a "
f"capable host. You asked: {message!r}."
)
with gr.Blocks(css=THEME_CSS, title=TITLE) as demo:
gr.Markdown(f"# {TITLE}\n*Sovereign intelligence, held in the light.*\n\nLumynaX release scaffold — clone `{REPO_ID}` for the full package.")
gr.ChatInterface(chat_stub, examples=["Explain LumynaX in 2 bullets.", "Why local-first AI for Aotearoa?"])
if __name__ == "__main__":
demo.launch()

View File

@@ -0,0 +1 @@
gradio==5.50.0

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8e111c2abf7439e96a405abc7d5d16cd810ac0c2ab6e753e3ac4c347594e6bb
size 4932711424

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e404ae15a3f6c0fb0f23fe096aa3b839c836b8ea7cf1bc71ab62e82918165c6c
size 4976802816

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c735370383b7fd936e15cbcfc05ea58327c306bcafed4794de8a78219e80322e
size 4968397360

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:273253da7c24a105ec95c53ab4acebde6fc1c287e8782904a58fef766594e4bd
size 2780953384

View File

@@ -0,0 +1,442 @@
{
"metadata": {
"total_size": 17658814464
},
"weight_map": {
"lm_head.weight": "model-00004-of-00004.safetensors",
"model.embed_tokens.weight": "model-00001-of-00004.safetensors",
"model.layers.0.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.0.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.1.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.10.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.10.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.10.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.10.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.10.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.10.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.10.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.10.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.10.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.11.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.11.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.11.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.11.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.11.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.11.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.11.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.11.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.11.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.12.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.12.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.12.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.12.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.12.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.12.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.12.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.12.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.12.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.13.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.13.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.14.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.15.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.16.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.17.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.18.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.19.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.2.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.2.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.20.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.20.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.21.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.22.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.22.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.22.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.22.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.22.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.22.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.22.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.22.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.22.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.23.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.23.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.23.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.23.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.23.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.23.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.23.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.23.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.23.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.24.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.24.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.24.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.24.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.24.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.24.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.24.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.24.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.24.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.25.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.25.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.25.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.25.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.25.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.25.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.25.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.25.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.25.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.26.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.26.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.26.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.26.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.26.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.26.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.26.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.26.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.26.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.27.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.27.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.27.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.27.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.28.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.28.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.29.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.3.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.3.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.30.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.30.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.31.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.32.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.32.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.32.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.32.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.32.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.32.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.32.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.32.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.32.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.33.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.33.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.33.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.33.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.33.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.33.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.33.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.33.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.33.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.34.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.34.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.34.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.34.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.34.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.34.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.34.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.34.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.34.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.35.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.35.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.35.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.35.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.35.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.35.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.35.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.35.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.35.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.36.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.36.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.36.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.36.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.36.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.36.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.36.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.36.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.36.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.37.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.37.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.37.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.37.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.37.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.37.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.37.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.37.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.37.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.38.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.38.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.38.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.38.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.38.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.38.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.38.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.38.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.38.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.39.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.39.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.39.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.39.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.39.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.39.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.39.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.39.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.39.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.4.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.4.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.40.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.40.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.40.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.40.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.40.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.40.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.40.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.40.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.40.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.41.input_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.41.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.41.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.41.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.41.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.41.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.41.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.41.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.41.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.42.input_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.42.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.42.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.42.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.42.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.42.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.42.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.42.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.42.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.43.input_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.43.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.43.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.43.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.43.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.43.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.43.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.43.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.43.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.44.input_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.44.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.44.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.44.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.44.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.44.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.44.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.44.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.44.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.45.input_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.45.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.45.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.45.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.45.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.45.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.45.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.45.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.45.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.46.input_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.46.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.46.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.46.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.46.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.46.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.46.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.46.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.46.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.47.input_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.47.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.47.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.47.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.47.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
"model.layers.47.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.47.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.47.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.47.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
"model.layers.5.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.5.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.6.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.7.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.8.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.9.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.norm.weight": "model-00004-of-00004.safetensors"
}
}

9
ollama/Modelfile Normal file
View File

@@ -0,0 +1,9 @@
# Upstream HF repo: 01-ai/Yi-9B-200K
# Use 'ollama pull' on a converted GGUF mirror, or run via transformers (see quickstart.py).
FROM hf.co/01-ai/Yi-9B-200K
PARAMETER temperature 0.4
PARAMETER top_p 0.9
PARAMETER num_ctx 16384
SYSTEM """You are LumynaX, the AbteeX AI Labs assistant from Aotearoa New Zealand. Ko te marama te tuapapa. Answer with care; cite uncertainty; refuse unsafe asks."""

95
quickstart.py Normal file
View File

@@ -0,0 +1,95 @@
"""
LumynaX Long-Context Yi-9B 200K — LumynaX quickstart.
This script fetches the upstream model from Hugging Face and runs a short
LumynaX-flavoured prompt. Run it on a host that satisfies the resource budget
documented in the README (LumynaX Long-Context Yi-9B 200K).
Usage:
python quickstart.py # one-shot demo prompt
python quickstart.py --interactive # REPL
python quickstart.py --gguf # use the GGUF mirror via llama-cpp
LumynaX package repo: https://huggingface.co/AbteeXAILab/lumynax-longctx-yi-9b-200k
Upstream weights: https://huggingface.co/01-ai/Yi-9B-200K
"""
from __future__ import annotations
import argparse, os, sys
LUMYNAX_SYSTEM = (
"You are LumynaX, the AbteeX AI Labs assistant from Aotearoa New Zealand. "
"Ko te marama te tuapapa - the light is the foundation. "
"Answer with care, cite uncertainty, and prefer local-first reasoning. "
"Refuse unsafe, unlawful, or sovereignty-violating requests."
)
DEMO_PROMPT = "Explain in 3 bullets why local-first AI matters for Aotearoa New Zealand."
def _run_hf(prompt: str, interactive: bool):
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
print("[lumynax] Loading 01-ai/Yi-9B-200K. This is a >100B MoE — multi-GPU or accelerate offload recommended.")
tok = AutoTokenizer.from_pretrained("01-ai/Yi-9B-200K", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
"01-ai/Yi-9B-200K", device_map="auto", torch_dtype="auto", trust_remote_code=True
)
def chat(user):
messages = [
{"role": "system", "content": LUMYNAX_SYSTEM},
{"role": "user", "content": user},
]
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tok(text, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=512, do_sample=True, temperature=0.4)
return tok.decode(out[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True)
if interactive:
print("[lumynax] interactive mode — empty line exits.")
while True:
try: q = input("you> ").strip()
except EOFError: break
if not q: break
print("lumynax> " + chat(q))
else:
print(chat(prompt))
def _run_gguf(prompt: str, interactive: bool):
from llama_cpp import Llama
mirror = ""
if not mirror:
print("[lumynax] No community GGUF mirror registered for this build."); sys.exit(2)
print(f"[lumynax] Loading GGUF from {mirror}...")
llm = Llama.from_pretrained(
repo_id=mirror, filename="*Q4_K_M*.gguf",
n_ctx=16384,
n_gpu_layers=int(os.environ.get("N_GPU_LAYERS", "-1")), verbose=False,
)
def chat(user):
out = llm.create_chat_completion(messages=[
{"role": "system", "content": LUMYNAX_SYSTEM},
{"role": "user", "content": user},
], max_tokens=512, temperature=0.4)
return out["choices"][0]["message"]["content"]
if interactive:
while True:
try: q = input("you> ").strip()
except EOFError: break
if not q: break
print("lumynax> " + chat(q))
else:
print(chat(prompt))
def main():
p = argparse.ArgumentParser()
p.add_argument("--interactive", action="store_true")
p.add_argument("--prompt", default=DEMO_PROMPT)
p.add_argument("--gguf", action="store_true")
args = p.parse_args()
if args.gguf:
_run_gguf(args.prompt, args.interactive)
else:
_run_hf(args.prompt, args.interactive)
if __name__ == "__main__":
main()

View File

@@ -0,0 +1,37 @@
{
"release_id": "lumynax-longctx-yi-9b-200k",
"title": "LumynaX Long-Context Yi-9B 200K",
"repo_id": "AbteeXAILab/lumynax-longctx-yi-9b-200k",
"version": "v0.1.0",
"publisher": "AbteeX AI Labs",
"publisher_org": "AbteeXAILab",
"jurisdiction": "NZ",
"residency": [
"NZ",
"AU",
"global"
],
"upstream": {
"repo_id": "01-ai/Yi-9B-200K",
"license": "apache-2.0",
"prompt_format": "chatml",
"source_note": "01-ai Yi 200K"
},
"gguf_mirror": null,
"runtime": "transformers",
"modalities": [
"text"
],
"context_tokens": 204800,
"total_params_b": 9,
"active_params_b": null,
"quantization": "bf16 safetensors (sharded)",
"primary_artifact": "model.safetensors.index.json",
"package_state": "weights_mirrored",
"validation_status": "scaffold_verified",
"sovereignty_tier": 3,
"supports_tools": false,
"supports_json": true,
"audit_hash_chain": "SHA-256 over canonical request + response JSON",
"build_date_utc": "2026-05-17T10:35:23Z"
}

8
requirements.txt Normal file
View File

@@ -0,0 +1,8 @@
huggingface_hub>=0.27
numpy
torch>=2.4
transformers>=4.50
accelerate>=1.0
safetensors
sentencepiece
einops

176167
tokenizer.json Normal file

File diff suppressed because it is too large Load Diff

3
tokenizer.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:386c49cf943d71aa110361135338c50e38beeff0a66593480421f37b319e1a39
size 1033105

13
tokenizer_config.json Normal file
View File

@@ -0,0 +1,13 @@
{
"add_bos_token": false,
"add_eos_token": false,
"model_max_length": 4096,
"unk_token": "<unk>",
"bos_token": "<|startoftext|>",
"eos_token": "<|endoftext|>",
"pad_token": "<unk>",
"sp_model_kwargs": {},
"clean_up_tokenization_spaces": false,
"legacy": true,
"tokenizer_class": "LlamaTokenizer"
}