初始化项目,由ModelHub XC社区提供模型
Model: AbteeXAILab/lumynax-longctx-yi-9b-200k Source: Original Platform
This commit is contained in:
35
.gitattributes
vendored
Normal file
35
.gitattributes
vendored
Normal file
@@ -0,0 +1,35 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
15
LICENSE.txt
Normal file
15
LICENSE.txt
Normal file
@@ -0,0 +1,15 @@
|
|||||||
|
LumynaX release package — distribution scaffold
|
||||||
|
|
||||||
|
This Hugging Face repository contains the LumynaX release scaffold for the
|
||||||
|
upstream model identified in `release_export_manifest.json`. The model weights
|
||||||
|
themselves remain governed by the upstream licence at `metadata.upstream_repo`
|
||||||
|
and are fetched by the runtime via Hugging Face Hub when you execute
|
||||||
|
`quickstart.py`.
|
||||||
|
|
||||||
|
The scaffold (configs, manifest, quickstart, ollama Modelfile, Space app) is
|
||||||
|
released under the MIT licence by AbteeX AI Labs (Aotearoa New Zealand). Your
|
||||||
|
use of the *upstream weights* is governed by the *upstream licence*; this file
|
||||||
|
does not relicense them.
|
||||||
|
|
||||||
|
Provenance, residency and audit obligations are defined in
|
||||||
|
`release_export_manifest.json` and the model card.
|
||||||
238
README.md
Normal file
238
README.md
Normal file
@@ -0,0 +1,238 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
library_name: transformers
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
- mi
|
||||||
|
tags:
|
||||||
|
- 200k
|
||||||
|
- abteex-ai-labs
|
||||||
|
- aotearoa
|
||||||
|
- local-first
|
||||||
|
- long-context
|
||||||
|
- lumynax
|
||||||
|
- new-zealand
|
||||||
|
- sovereign-ai
|
||||||
|
- yi
|
||||||
|
- vllm
|
||||||
|
- vllm-compatible
|
||||||
|
- vllm-candidate
|
||||||
|
- nvidia-nim
|
||||||
|
- nim-compatible
|
||||||
|
- nim-candidate
|
||||||
|
- nvidia-nemo
|
||||||
|
- nem
|
||||||
|
- nvidia-nemo-compatible
|
||||||
|
- nem-compatible
|
||||||
|
- nemo-candidate
|
||||||
|
---
|
||||||
|
|
||||||
|
# LumynaX Long-Context Yi-9B 200K
|
||||||
|
|
||||||
|
<!-- lumynax-public-release-card:v4 -->
|
||||||
|
|
||||||
|
<p align="center">
|
||||||
|
<img src="docs/lumynax-release-overview.svg" alt="LumynaX Long-Context Yi-9B 200K release overview" width="100%" />
|
||||||
|
</p>
|
||||||
|
|
||||||
|
<p align="center">
|
||||||
|
<strong>LumynaX model-infusion release by AbteeX AI Labs.</strong><br/>
|
||||||
|
Public, non-gated package with runnable local instructions, provenance metadata, checksums, and a release manifest.
|
||||||
|
</p>
|
||||||
|
|
||||||
|
<p align="center">
|
||||||
|
<a href="#quickstart">Quickstart</a> |
|
||||||
|
<a href="#model-profile">Model profile</a> |
|
||||||
|
<a href="#runtime-files">Runtime files</a> |
|
||||||
|
<a href="#provenance-and-license">Provenance</a> |
|
||||||
|
<a href="#validation-status">Validation</a> |
|
||||||
|
<a href="#limitations-and-responsible-use">Limitations</a>
|
||||||
|
</p>
|
||||||
|
|
||||||
|
     
|
||||||
|
|
||||||
|
## Executive Summary
|
||||||
|
|
||||||
|
This repository is a complete LumynaX release package for `AbteeXAILab/lumynax-longctx-yi-9b-200k`. It is intended to be downloaded as a whole repo, not as a single loose weight file: the model artifact, `quickstart.py`, `requirements.txt`, `release_export_manifest.json`, `checksums.sha256`, license notice, and optional Ollama or Space files are part of the same release contract.
|
||||||
|
|
||||||
|
LumynaX-infused means the upstream artifact is presented through the LumynaX release layer: local-first runtime scaffolding, LumynaX assistant identity, inference-chain metadata, public documentation, integrity files, and Aotearoa New Zealand-oriented workflow positioning. The release manifest is the source of truth for whether this package is upstream-weight packaging, a dense LumynaX release, or another release mode.
|
||||||
|
|
||||||
|
## AbteeX LumynaX Public Surface
|
||||||
|
|
||||||
|
This card follows the AbteeX/LumynaX public-facing system used across the release family: warm paper background visuals, black editorial typography, amber proof markers, compact evidence tables, and plain-language runtime instructions. The goal is not decoration; it is operational clarity. A downloader should immediately understand what the package is, what files belong together, what runtime path is expected, what provenance is available, and what limits still apply.
|
||||||
|
|
||||||
|
## Sovereignty And Run Contract
|
||||||
|
|
||||||
|
| Field | Value |
|
||||||
|
| --- | --- |
|
||||||
|
| Public surface | AbteeX/LumynaX light editorial system: warm paper, black ink, amber status markers, and evidence-first tables. |
|
||||||
|
| Sovereign intent | Package is documented for local-first use, explicit provenance, and controlled deployment near governed data. |
|
||||||
|
| Runtime residency | `transformers` runtime can be deployed by the user in their own approved environment. |
|
||||||
|
| Model artifact | `model-00002-of-00004.safetensors` must stay with manifest, checksums, quickstart, requirements, and license files. |
|
||||||
|
| Modalities | `text` |
|
||||||
|
| License discipline | `apache-2.0` metadata is surfaced so downstream users can check redistribution and usage terms. |
|
||||||
|
| Audit expectation | Record repo id, artifact checksum, runtime command, prompt template, operator, and deployment environment for production use. |
|
||||||
|
| Router readiness | Compatible with the LumynaX MaramaRoute registry pattern for sovereign model selection and fallback planning. |
|
||||||
|
|
||||||
|
## Quickstart
|
||||||
|
|
||||||
|
```bash
|
||||||
|
hf download AbteeXAILab/lumynax-longctx-yi-9b-200k --local-dir lumynax-longctx-yi-9b-200k
|
||||||
|
cd lumynax-longctx-yi-9b-200k
|
||||||
|
pip install -r requirements.txt
|
||||||
|
python quickstart.py --interactive
|
||||||
|
```
|
||||||
|
|
||||||
|
Transformers first-load pattern:
|
||||||
|
|
||||||
|
```python
|
||||||
|
from transformers import AutoTokenizer, AutoModelForCausalLM
|
||||||
|
|
||||||
|
tokenizer = AutoTokenizer.from_pretrained("AbteeXAILab/lumynax-longctx-yi-9b-200k", trust_remote_code=True)
|
||||||
|
model = AutoModelForCausalLM.from_pretrained("AbteeXAILab/lumynax-longctx-yi-9b-200k", device_map="auto", trust_remote_code=True)
|
||||||
|
prompt = "Who are you? Answer as LumynaX in two sentences."
|
||||||
|
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
|
||||||
|
output = model.generate(**inputs, max_new_tokens=160)
|
||||||
|
print(tokenizer.decode(output[0], skip_special_tokens=True))
|
||||||
|
```
|
||||||
|
|
||||||
|
For multimodal Transformers packages, use the package `quickstart.py` or upstream processor class when `AutoModelForCausalLM` is not the correct loader.
|
||||||
|
|
||||||
|
## Model Profile
|
||||||
|
|
||||||
|
| Field | Value |
|
||||||
|
| --- | --- |
|
||||||
|
| Release | `LumynaX Long-Context Yi-9B 200K` |
|
||||||
|
| Repository | `AbteeXAILab/lumynax-longctx-yi-9b-200k` |
|
||||||
|
| Mode | `Local-first text generation package` |
|
||||||
|
| Runtime | `transformers` |
|
||||||
|
| Prompt format | `See quickstart.py` |
|
||||||
|
| Modalities | `text` |
|
||||||
|
| Primary artifact | `model-00002-of-00004.safetensors` |
|
||||||
|
| Detected weight size | `16.45 GB` |
|
||||||
|
| Package state | `weights_mirrored` |
|
||||||
|
| Delivery | `published_model_repo` |
|
||||||
|
| Upstream/base | `See release_export_manifest.json` |
|
||||||
|
| Upstream kind | `See manifest` |
|
||||||
|
| Source GGUF | `not applicable` |
|
||||||
|
| Quantization | `bf16 safetensors (sharded)` |
|
||||||
|
| License metadata | `apache-2.0` |
|
||||||
|
| Refreshed | `2026-05-11` |
|
||||||
|
|
||||||
|
## Runtime Path
|
||||||
|
|
||||||
|
<p align="center">
|
||||||
|
<img src="docs/lumynax-runtime-flow.svg" alt="LumynaX Long-Context Yi-9B 200K runtime flow" width="100%" />
|
||||||
|
</p>
|
||||||
|
|
||||||
|
## Capability Profile
|
||||||
|
|
||||||
|
| Field | Value |
|
||||||
|
| --- | --- |
|
||||||
|
| Primary fit | Use this for local chat, drafting, summarization, governance notes, and repeatable offline-friendly inference. |
|
||||||
|
| Operational style | Local-first package with explicit files, checksums, and reproducible quickstarts. |
|
||||||
|
| Identity behavior | The assistant should identify as LumynaX while remaining clear about upstream provenance. |
|
||||||
|
|
||||||
|
## Runtime Files
|
||||||
|
|
||||||
|
| Component | Status | Path |
|
||||||
|
| --- | --- | --- |
|
||||||
|
| README.md | `present` | `README.md` |
|
||||||
|
| Quickstart | `present` | `quickstart.py` |
|
||||||
|
| Requirements | `present` | `requirements.txt` |
|
||||||
|
| Manifest | `present` | `release_export_manifest.json` |
|
||||||
|
| Checksums | `present` | `checksums.sha256` |
|
||||||
|
| License | `present` | `LICENSE.txt` |
|
||||||
|
| Ollama | `present` | `ollama/Modelfile` |
|
||||||
|
| Space scaffold | `present` | `hf_space/app.py` |
|
||||||
|
| Overview visual | `present` | `docs/lumynax-release-overview.svg` |
|
||||||
|
| Runtime visual | `present` | `docs/lumynax-runtime-flow.svg` |
|
||||||
|
|
||||||
|
## Model Artifacts
|
||||||
|
|
||||||
|
| Artifact | Size |
|
||||||
|
| --- | ---: |
|
||||||
|
| `model-00002-of-00004.safetensors` | 4.64 GB |
|
||||||
|
| `model-00003-of-00004.safetensors` | 4.63 GB |
|
||||||
|
| `model-00001-of-00004.safetensors` | 4.59 GB |
|
||||||
|
| `model-00004-of-00004.safetensors` | 2.59 GB |
|
||||||
|
|
||||||
|
## Prompting Contract
|
||||||
|
|
||||||
|
The preferred first prompt is an identity and provenance check:
|
||||||
|
|
||||||
|
```text
|
||||||
|
Who are you? What files do I need to keep together to run this package locally?
|
||||||
|
```
|
||||||
|
|
||||||
|
Expected behavior: the assistant should identify as LumynaX, explain that this is a LumynaX model-infusion package, and keep upstream provenance visible. The default package system prompt is:
|
||||||
|
|
||||||
|
```text
|
||||||
|
See quickstart.py
|
||||||
|
```
|
||||||
|
|
||||||
|
## Validation Status
|
||||||
|
|
||||||
|
| Field | Value |
|
||||||
|
| --- | --- |
|
||||||
|
| Runtime audit | `not recorded` |
|
||||||
|
| Public access audit | `not recorded` |
|
||||||
|
| Anonymous metadata access | `False` |
|
||||||
|
| Anonymous file listing | `False` |
|
||||||
|
| Quickstart syntax | `not recorded` |
|
||||||
|
| Manifest references | `pass` |
|
||||||
|
| Checksum references | `pass` |
|
||||||
|
|
||||||
|
The audit confirms public access, required release files, manifest references, checksum references, weight artifact presence, and quickstart syntax. It does not guarantee that every laptop has enough RAM or VRAM for the largest packages.
|
||||||
|
|
||||||
|
## Integrity Checks
|
||||||
|
|
||||||
|
After download, compare the model artifact against `checksums.sha256`.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
sha256sum "model-00002-of-00004.safetensors"
|
||||||
|
cat checksums.sha256
|
||||||
|
```
|
||||||
|
|
||||||
|
On Windows PowerShell:
|
||||||
|
|
||||||
|
```powershell
|
||||||
|
Get-FileHash -Algorithm SHA256 "model-00002-of-00004.safetensors"
|
||||||
|
Get-Content checksums.sha256
|
||||||
|
```
|
||||||
|
|
||||||
|
## Provenance And License
|
||||||
|
|
||||||
|
- Publisher: AbteeX AI Labs.
|
||||||
|
- Family: LumynaX model and inference-chain release family.
|
||||||
|
- Upstream/base: `See release_export_manifest.json`.
|
||||||
|
- Source GGUF: `not applicable`.
|
||||||
|
- License metadata: `apache-2.0`.
|
||||||
|
- License link: `LICENSE.txt` and upstream model card.
|
||||||
|
|
||||||
|
Respect the upstream model license and keep attribution files with redistributed copies. Do not present this package as privately trained or weight-merged unless the release manifest explicitly says that weight adaptation was applied.
|
||||||
|
|
||||||
|
## Limitations And Responsible Use
|
||||||
|
|
||||||
|
- Outputs can be incorrect, incomplete, or biased; validate important answers before use.
|
||||||
|
- Larger GGUF, MoE, multimodal, and frontier packages may require substantial RAM, VRAM, disk space, and recent runtime builds.
|
||||||
|
- For high-impact decisions, use human review and domain-specific evaluation.
|
||||||
|
- For sensitive data, prefer local execution and keep operational logs under your own governance policy.
|
||||||
|
- This card documents package readiness and access; it is not a benchmark claim.
|
||||||
|
|
||||||
|
## Automation Notes
|
||||||
|
|
||||||
|
Automation should read these files before launching:
|
||||||
|
|
||||||
|
- `release_export_manifest.json`
|
||||||
|
- `checksums.sha256`
|
||||||
|
- `quickstart.py`
|
||||||
|
- `requirements.txt`
|
||||||
|
- `ollama/Modelfile` when present
|
||||||
|
|
||||||
|
## Related LumynaX Demo
|
||||||
|
|
||||||
|
Try the public browser demo:
|
||||||
|
|
||||||
|
- https://huggingface.co/spaces/AbteeXAILab/lumynax-live-demo
|
||||||
14
UPLOAD_TO_HF.md
Normal file
14
UPLOAD_TO_HF.md
Normal file
@@ -0,0 +1,14 @@
|
|||||||
|
# Upload checklist (AbteeX AI Labs)
|
||||||
|
|
||||||
|
This scaffold was generated and pushed by `S:\hf-publish\add_8_more_models.py`.
|
||||||
|
The repo is structured to be cloned whole and verified locally before running.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
hf download AbteeXAILab/lumynax-longctx-yi-9b-200k --local-dir lumynax-longctx-yi-9b-200k
|
||||||
|
cd lumynax-longctx-yi-9b-200k
|
||||||
|
pip install -r requirements.txt
|
||||||
|
python quickstart.py --interactive
|
||||||
|
```
|
||||||
|
|
||||||
|
To regenerate or refresh, re-run the script — `huggingface_hub.HfApi.upload_folder`
|
||||||
|
is idempotent.
|
||||||
1
VERSION.txt
Normal file
1
VERSION.txt
Normal file
@@ -0,0 +1 @@
|
|||||||
|
v0.1.0
|
||||||
9
checksums.sha256
Normal file
9
checksums.sha256
Normal file
@@ -0,0 +1,9 @@
|
|||||||
|
601956b52f7e59484c150ec4b1e9b1186adc331bf92c4a7127834ba2ff70a968 LICENSE.txt
|
||||||
|
d0b4f9120ba026c00fa23cb84b4e1620a2e6436592e58155a5151653179572c0 VERSION.txt
|
||||||
|
0e898ce24132ecc609ee22a8614ab2f5b6a54501fa650536eb295e0d331f3a5e ollama/Modelfile
|
||||||
|
214fd1b57530816b9e38cdceff4943e5b664dbb50b1d1cf7530201e17215b89b quickstart.py
|
||||||
|
40e982a9baef6f2f2b42f5c130910fba245ce982e861fe15936804ab513648ae release_export_manifest.json
|
||||||
|
dd873da1e34bee536b535b05ffe41bbeeacaa9d106db9463ae0f4abe2f07dff8 requirements.txt
|
||||||
|
89a96b3e9f2d77a73ecb212b8fcb8c652b5ee72fcf8aac3eb507b1ee4f084bd5 README.md
|
||||||
|
5e65667c6c17ed1e0eba319bbd02272953456914a563f4b128711e44606bb0ba docs/lumynax-release-overview.svg
|
||||||
|
10eb7b61c96d5c4c062911dd63ddb17f1984560af6e4bd35b1448dbf7841a7c1 docs/lumynax-runtime-flow.svg
|
||||||
28
config.json
Normal file
28
config.json
Normal file
@@ -0,0 +1,28 @@
|
|||||||
|
{
|
||||||
|
"architectures": [
|
||||||
|
"LlamaForCausalLM"
|
||||||
|
],
|
||||||
|
"attention_bias": false,
|
||||||
|
"attention_dropout": 0.0,
|
||||||
|
"bos_token_id": 1,
|
||||||
|
"eos_token_id": 2,
|
||||||
|
"hidden_act": "silu",
|
||||||
|
"hidden_size": 4096,
|
||||||
|
"initializer_range": 0.02,
|
||||||
|
"intermediate_size": 11008,
|
||||||
|
"max_position_embeddings": 262144,
|
||||||
|
"model_type": "llama",
|
||||||
|
"num_attention_heads": 32,
|
||||||
|
"num_hidden_layers": 48,
|
||||||
|
"num_key_value_heads": 4,
|
||||||
|
"pad_token_id": 0,
|
||||||
|
"pretraining_tp": 1,
|
||||||
|
"rms_norm_eps": 1e-06,
|
||||||
|
"rope_scaling": null,
|
||||||
|
"rope_theta": 10000000.0,
|
||||||
|
"tie_word_embeddings": false,
|
||||||
|
"torch_dtype": "bfloat16",
|
||||||
|
"transformers_version": "4.37.2",
|
||||||
|
"use_cache": true,
|
||||||
|
"vocab_size": 64000
|
||||||
|
}
|
||||||
12
docs/lumynax-capability.svg
Normal file
12
docs/lumynax-capability.svg
Normal file
@@ -0,0 +1,12 @@
|
|||||||
|
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 900 260" role="img" aria-label="LumynaX capability profile">
|
||||||
|
<rect width="900" height="260" fill="#fffefa"/>
|
||||||
|
<rect x="0" y="0" width="900" height="3" fill="#0a0a0b"/>
|
||||||
|
<text x="64" y="36" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.18em" fill="#9a5416">CAPABILITY PROFILE</text>
|
||||||
|
<text x="64" y="58" font-family="Georgia, Cambria, serif" font-size="18" font-weight="500" fill="#0a0a0b">Where this model spends its weight.</text>
|
||||||
|
<g transform="translate(64,70)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">QUALITY</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="480" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">4/5</text></g>
|
||||||
|
<g transform="translate(64,98)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">LIGHTWEIGHT</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="360" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">3/5</text></g>
|
||||||
|
<g transform="translate(64,126)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">SOVEREIGNTY</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="360" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">3/5</text></g>
|
||||||
|
<g transform="translate(64,154)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">TOOLS</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="120" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">1/5</text></g>
|
||||||
|
<g transform="translate(64,182)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">JSON MODE</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">5/5</text></g>
|
||||||
|
<g transform="translate(64,210)"><text x="0" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" letter-spacing="0.12em" fill="#9a5416">CONTEXT</text><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#f6f0e8" stroke="rgba(10,10,11,0.12)"/><rect x="160" y="2" width="600" height="16" rx="8" ry="8" fill="#e08a2c"/><text x="772" y="14" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="700" fill="#0a0a0b">5/5</text></g>
|
||||||
|
</svg>
|
||||||
|
After Width: | Height: | Size: 3.8 KiB |
24
docs/lumynax-overview.svg
Normal file
24
docs/lumynax-overview.svg
Normal file
@@ -0,0 +1,24 @@
|
|||||||
|
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 1280 340" role="img" aria-label="LumynaX Long-Context Yi-9B 200K release banner">
|
||||||
|
<defs>
|
||||||
|
<linearGradient id="paperGrad" x1="0" y1="0" x2="0" y2="1">
|
||||||
|
<stop offset="0%" stop-color="#fffefa"/>
|
||||||
|
<stop offset="100%" stop-color="#f6f0e8"/>
|
||||||
|
</linearGradient>
|
||||||
|
</defs>
|
||||||
|
<rect width="1280" height="340" fill="url(#paperGrad)"/>
|
||||||
|
<rect x="860" y="0" width="420" height="4" fill="#e08a2c"/>
|
||||||
|
<rect x="0" y="336" width="1280" height="4" fill="#0a0a0b"/>
|
||||||
|
<text x="64" y="56" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="13" font-weight="700" letter-spacing="0.22em" fill="#9a5416">ABTEEX AI LABS · AOTEAROA NEW ZEALAND</text>
|
||||||
|
<text x="64" y="78" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" letter-spacing="0.16em" fill="#726b62">LUMYNAX RELEASE · CARD V6</text>
|
||||||
|
<text x="64" y="170" font-family="Georgia, Cambria, "Times New Roman", serif" font-size="56" font-weight="500" fill="#0a0a0b">LumynaX Long-Context Yi-9B 200K</text>
|
||||||
|
<line x1="64" y1="196" x2="220" y2="196" stroke="#e08a2c" stroke-width="3"/>
|
||||||
|
<text x="64" y="226" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="13" fill="#726b62">AbteeXAILab/lumynax-longctx-yi-9b-200k</text>
|
||||||
|
<g transform="translate(64,262)"><rect width="110" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">FAMILY</text><text x="63" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">YI</text></g>
|
||||||
|
<g transform="translate(184,262)"><rect width="110" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">PARAMS</text><text x="63" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">9B</text></g>
|
||||||
|
<g transform="translate(304,262)"><rect width="163" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">RUNTIME</text><text x="70" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">transformers</text></g>
|
||||||
|
<g transform="translate(477,262)"><rect width="110" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">MODES</text><text x="56" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">TEXT</text></g>
|
||||||
|
<g transform="translate(597,262)"><rect width="191" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">QUANT</text><text x="56" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">bf16 safetensors (</text></g>
|
||||||
|
<g transform="translate(798,262)"><rect width="149" height="34" rx="17" ry="17" fill="#fffefa" stroke="rgba(10,10,11,0.12)"/><text x="14" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" font-weight="700" letter-spacing="0.14em" fill="#9a5416">LICENSE</text><text x="70" y="22" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="11" font-weight="600" fill="#0a0a0b">apache-2.0</text></g>
|
||||||
|
<text x="1216" y="56" text-anchor="end" font-family="Georgia, Cambria, serif" font-size="18" font-style="italic" fill="#726b62">held in the light</text>
|
||||||
|
<text x="1216" y="80" text-anchor="end" font-family="ui-monospace, SFMono-Regular, Menlo, Consolas, monospace" font-size="10" letter-spacing="0.18em" fill="#9a5416">KO TE MARAMA TE TUAPAPA</text>
|
||||||
|
</svg>
|
||||||
|
After Width: | Height: | Size: 4.4 KiB |
51
docs/lumynax-release-overview.svg
Normal file
51
docs/lumynax-release-overview.svg
Normal file
@@ -0,0 +1,51 @@
|
|||||||
|
<svg xmlns="http://www.w3.org/2000/svg" width="1280" height="560" viewBox="0 0 1280 560" role="img" aria-labelledby="title desc">
|
||||||
|
<title id="title">LumynaX Long-Context Yi-9B 200K professional LumynaX release overview</title>
|
||||||
|
<desc id="desc">Professional release overview for AbteeXAILab/lumynax-longctx-yi-9b-200k showing provenance, LumynaX infusion layer, package artifact, and runtime path.</desc>
|
||||||
|
<defs>
|
||||||
|
<filter id="shadow" x="-12%" y="-12%" width="124%" height="124%"><feDropShadow dx="0" dy="10" stdDeviation="12" flood-color="#0a0a0b" flood-opacity="0.08"/></filter>
|
||||||
|
<marker id="arrowhead" markerWidth="12" markerHeight="8" refX="10" refY="4" orient="auto"><polygon points="0 0, 12 4, 0 8" fill="#e08a2c"/></marker>
|
||||||
|
</defs>
|
||||||
|
<style>
|
||||||
|
.title{fill:#0a0a0b;font:500 38px Georgia,serif}.sub{fill:#726b62;font:16px Aptos,Segoe UI,Arial}.eyebrow{fill:#9a5416;font:700 13px ui-monospace,Consolas,monospace;letter-spacing:2px}.rule{stroke:#0a0a0b;stroke-opacity:.12}.accent{stroke:#e08a2c;stroke-width:4}.card{fill:#ffffff;stroke:#0a0a0b;stroke-opacity:.12;stroke-width:1.2;filter:url(#shadow)}.num{fill:#ffffff;font:700 17px Aptos,Segoe UI,Arial}.numBg{fill:#0a0a0b}.label{fill:#0a0a0b;font:700 18px Aptos,Segoe UI,Arial}.body{fill:#5f574e;font:14px Aptos,Segoe UI,Arial}.chip{fill:#f6f0e8;stroke:#0a0a0b;stroke-opacity:.12}.chiptext{fill:#0a0a0b;font:700 12px ui-monospace,Consolas,monospace;letter-spacing:.7px}.line{stroke:#e08a2c;stroke-width:3;marker-end:url(#arrowhead)}
|
||||||
|
</style>
|
||||||
|
<rect width="1280" height="560" rx="28" fill="#fffefa"/>
|
||||||
|
<line class="accent" x1="852" y1="34" x2="1228" y2="34"/>
|
||||||
|
<line class="rule" x1="52" y1="160" x2="1228" y2="160"/>
|
||||||
|
<text class="eyebrow" x="52" y="58">ABTEEX AI LABS - LUMYNAX MODEL INFUSION RELEASE</text>
|
||||||
|
<text class="title" x="52" y="102">LumynaX Long-Context Yi-9B 200K</text>
|
||||||
|
<text class="sub" x="52" y="134">AbteeXAILab/lumynax-longctx-yi-9b-200k</text>
|
||||||
|
<rect class="card" x="52" y="205" width="270" height="155" rx="18"/>
|
||||||
|
<circle class="numBg" cx="86" cy="241" r="18"/>
|
||||||
|
<text class="num" x="80" y="247">1</text>
|
||||||
|
<text class="label" x="114" y="247">Upstream</text>
|
||||||
|
<text class="body" x="78" y="287">See release_export_manifest.json</text>
|
||||||
|
<line class="line" x1="331" y1="282.5" x2="344" y2="282.5"/>
|
||||||
|
<rect class="card" x="356" y="205" width="270" height="155" rx="18"/>
|
||||||
|
<circle class="numBg" cx="390" cy="241" r="18"/>
|
||||||
|
<text class="num" x="384" y="247">2</text>
|
||||||
|
<text class="label" x="418" y="247">LumynaX Infusion</text>
|
||||||
|
<text class="body" x="382" y="287">Identity, runtime scaffold,</text>
|
||||||
|
<text class="body" x="382" y="308">provenance, checksums</text>
|
||||||
|
<line class="line" x1="635" y1="282.5" x2="648" y2="282.5"/>
|
||||||
|
<rect class="card" x="660" y="205" width="270" height="155" rx="18"/>
|
||||||
|
<circle class="numBg" cx="694" cy="241" r="18"/>
|
||||||
|
<text class="num" x="688" y="247">3</text>
|
||||||
|
<text class="label" x="722" y="247">Release Package</text>
|
||||||
|
<text class="body" x="686" y="287">model-00002-of-00004.safetensors</text>
|
||||||
|
<line class="line" x1="939" y1="282.5" x2="952" y2="282.5"/>
|
||||||
|
<rect class="card" x="964" y="205" width="270" height="155" rx="18"/>
|
||||||
|
<circle class="numBg" cx="998" cy="241" r="18"/>
|
||||||
|
<text class="num" x="992" y="247">4</text>
|
||||||
|
<text class="label" x="1026" y="247">Runtime</text>
|
||||||
|
<text class="body" x="990" y="287">transformers</text>
|
||||||
|
<rect class="chip" x="52" y="420" width="190" height="40" rx="20"/>
|
||||||
|
<text class="chiptext" x="69" y="445">modalities: text</text>
|
||||||
|
<rect class="chip" x="258" y="420" width="190" height="40" rx="20"/>
|
||||||
|
<text class="chiptext" x="275" y="445">license: apache-2.0</text>
|
||||||
|
<rect class="chip" x="464" y="420" width="218" height="40" rx="20"/>
|
||||||
|
<text class="chiptext" x="481" y="445">state: weights_mirrored</text>
|
||||||
|
<rect class="chip" x="698" y="420" width="190" height="40" rx="20"/>
|
||||||
|
<text class="chiptext" x="715" y="445">audit: not recorded</text>
|
||||||
|
<line class="rule" x1="52" y1="496" x2="1228" y2="496"/>
|
||||||
|
<text class="sub" x="52" y="526">Download the complete repo so README, manifest, checksums, runtime files, and weights stay together.</text>
|
||||||
|
</svg>
|
||||||
|
After Width: | Height: | Size: 3.9 KiB |
35
docs/lumynax-runtime-flow.svg
Normal file
35
docs/lumynax-runtime-flow.svg
Normal file
@@ -0,0 +1,35 @@
|
|||||||
|
<svg xmlns="http://www.w3.org/2000/svg" width="1280" height="430" viewBox="0 0 1280 430" role="img" aria-labelledby="title desc">
|
||||||
|
<title id="title">LumynaX Long-Context Yi-9B 200K runtime flow</title>
|
||||||
|
<desc id="desc">Runtime flow for AbteeXAILab/lumynax-longctx-yi-9b-200k from download to verification, quickstart, and serving.</desc>
|
||||||
|
<defs>
|
||||||
|
<filter id="shadow" x="-12%" y="-12%" width="124%" height="124%"><feDropShadow dx="0" dy="10" stdDeviation="12" flood-color="#0a0a0b" flood-opacity="0.08"/></filter>
|
||||||
|
<marker id="arrowhead" markerWidth="12" markerHeight="8" refX="10" refY="4" orient="auto"><polygon points="0 0, 12 4, 0 8" fill="#e08a2c"/></marker>
|
||||||
|
</defs>
|
||||||
|
<style>
|
||||||
|
.title{fill:#0a0a0b;font:500 34px Georgia,serif}.sub{fill:#726b62;font:16px Aptos,Segoe UI,Arial}.eyebrow{fill:#9a5416;font:700 13px ui-monospace,Consolas,monospace;letter-spacing:2px}.rule{stroke:#0a0a0b;stroke-opacity:.12}.accent{stroke:#e08a2c;stroke-width:4}.box{fill:#ffffff;stroke:#0a0a0b;stroke-opacity:.12;stroke-width:1.2;filter:url(#shadow)}.label{fill:#0a0a0b;font:700 19px Aptos,Segoe UI,Arial}.body{fill:#5f574e;font:14px Aptos,Segoe UI,Arial}.line{stroke:#e08a2c;stroke-width:3;marker-end:url(#arrowhead)}.artifact{fill:#9a5416;font:700 14px ui-monospace,Consolas,monospace}
|
||||||
|
</style>
|
||||||
|
<rect width="1280" height="430" rx="24" fill="#fffefa"/>
|
||||||
|
<line class="accent" x1="856" y1="34" x2="1230" y2="34"/>
|
||||||
|
<text class="eyebrow" x="50" y="48">LOCAL-FIRST RUNTIME FLOW</text>
|
||||||
|
<text class="title" x="50" y="88">LumynaX Long-Context Yi-9B 200K Runtime Path</text>
|
||||||
|
<text class="sub" x="50" y="118">Primary artifact: model-00002-of-00004.safetensors</text>
|
||||||
|
<line class="rule" x1="50" y1="138" x2="1230" y2="138"/>
|
||||||
|
<rect class="box" x="64" y="178" width="245" height="118" rx="16"/>
|
||||||
|
<text class="label" x="86" y="220">Download</text>
|
||||||
|
<text class="body" x="86" y="251">hf download</text>
|
||||||
|
<text class="body" x="86" y="271">AbteeXAILab/lumynax-longctx-yi-9b-200k</text>
|
||||||
|
<line class="line" x1="324" y1="237.0" x2="349" y2="237.0"/>
|
||||||
|
<rect class="box" x="367" y="178" width="245" height="118" rx="16"/>
|
||||||
|
<text class="label" x="389" y="220">Verify</text>
|
||||||
|
<text class="body" x="389" y="251">checksums.sha256</text>
|
||||||
|
<line class="line" x1="627" y1="237.0" x2="652" y2="237.0"/>
|
||||||
|
<rect class="box" x="670" y="178" width="245" height="118" rx="16"/>
|
||||||
|
<text class="label" x="692" y="220">Run</text>
|
||||||
|
<text class="body" x="692" y="251">quickstart.py</text>
|
||||||
|
<line class="line" x1="930" y1="237.0" x2="955" y2="237.0"/>
|
||||||
|
<rect class="box" x="973" y="178" width="245" height="118" rx="16"/>
|
||||||
|
<text class="label" x="995" y="220">Serve</text>
|
||||||
|
<text class="body" x="995" y="251">transformers</text>
|
||||||
|
<line class="rule" x1="50" y1="340" x2="1230" y2="340"/>
|
||||||
|
<text class="artifact" x="50" y="375">Recommended first test: ask "Who are you?" and confirm the package answers with LumynaX identity plus honest provenance.</text>
|
||||||
|
</svg>
|
||||||
|
After Width: | Height: | Size: 2.8 KiB |
7
generation_config.json
Normal file
7
generation_config.json
Normal file
@@ -0,0 +1,7 @@
|
|||||||
|
{
|
||||||
|
"_from_model_config": true,
|
||||||
|
"bos_token_id": 1,
|
||||||
|
"eos_token_id": 2,
|
||||||
|
"pad_token_id": 0,
|
||||||
|
"transformers_version": "4.37.2"
|
||||||
|
}
|
||||||
22
hf_space/README.md
Normal file
22
hf_space/README.md
Normal file
@@ -0,0 +1,22 @@
|
|||||||
|
---
|
||||||
|
title: LumynaX Long-Context Yi-9B 200K
|
||||||
|
colorFrom: yellow
|
||||||
|
colorTo: gray
|
||||||
|
sdk: gradio
|
||||||
|
sdk_version: 5.50.0
|
||||||
|
python_version: 3.11
|
||||||
|
app_file: app.py
|
||||||
|
pinned: false
|
||||||
|
license: apache-2.0
|
||||||
|
short_description: Scaffold Space for the lumynax-longctx-yi-9b-200k LumynaX release.
|
||||||
|
tags:
|
||||||
|
- abteex-ai-labs
|
||||||
|
- lumynax
|
||||||
|
- sovereign-ai
|
||||||
|
- new-zealand
|
||||||
|
---
|
||||||
|
|
||||||
|
# LumynaX Long-Context Yi-9B 200K
|
||||||
|
|
||||||
|
Scaffold Space for `AbteeXAILab/lumynax-longctx-yi-9b-200k`. The actual model weights are too large to host on a free Space.
|
||||||
|
Clone the package repo and run `quickstart.py` locally for the real inference path.
|
||||||
27
hf_space/app.py
Normal file
27
hf_space/app.py
Normal file
@@ -0,0 +1,27 @@
|
|||||||
|
import os
|
||||||
|
import gradio as gr
|
||||||
|
|
||||||
|
REPO_ID = "AbteeXAILab/lumynax-longctx-yi-9b-200k"
|
||||||
|
UPSTREAM = "01-ai/Yi-9B-200K"
|
||||||
|
TITLE = "LumynaX Long-Context Yi-9B 200K"
|
||||||
|
|
||||||
|
THEME_CSS = """
|
||||||
|
:root { --lx-paper:#fffefa; --lx-ink:#0a0a0b; --lx-amber:#e08a2c; }
|
||||||
|
body, .gradio-container { background: var(--lx-paper) !important; color: var(--lx-ink) !important; }
|
||||||
|
h1, h2, h3 { font-family: 'Cormorant Garamond', 'EB Garamond', Georgia, serif; }
|
||||||
|
"""
|
||||||
|
|
||||||
|
def chat_stub(message, history):
|
||||||
|
return (
|
||||||
|
f"This Space is a scaffold for **{TITLE}**. The upstream model is `{UPSTREAM}` "
|
||||||
|
f"and the LumynaX package repo is `{REPO_ID}`. Cloud inference for >100B MoE models "
|
||||||
|
f"is not run inside this free Space — clone the repo and run `quickstart.py` on a "
|
||||||
|
f"capable host. You asked: {message!r}."
|
||||||
|
)
|
||||||
|
|
||||||
|
with gr.Blocks(css=THEME_CSS, title=TITLE) as demo:
|
||||||
|
gr.Markdown(f"# {TITLE}\n*Sovereign intelligence, held in the light.*\n\nLumynaX release scaffold — clone `{REPO_ID}` for the full package.")
|
||||||
|
gr.ChatInterface(chat_stub, examples=["Explain LumynaX in 2 bullets.", "Why local-first AI for Aotearoa?"])
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
demo.launch()
|
||||||
1
hf_space/requirements.txt
Normal file
1
hf_space/requirements.txt
Normal file
@@ -0,0 +1 @@
|
|||||||
|
gradio==5.50.0
|
||||||
3
model-00001-of-00004.safetensors
Normal file
3
model-00001-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a8e111c2abf7439e96a405abc7d5d16cd810ac0c2ab6e753e3ac4c347594e6bb
|
||||||
|
size 4932711424
|
||||||
3
model-00002-of-00004.safetensors
Normal file
3
model-00002-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e404ae15a3f6c0fb0f23fe096aa3b839c836b8ea7cf1bc71ab62e82918165c6c
|
||||||
|
size 4976802816
|
||||||
3
model-00003-of-00004.safetensors
Normal file
3
model-00003-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c735370383b7fd936e15cbcfc05ea58327c306bcafed4794de8a78219e80322e
|
||||||
|
size 4968397360
|
||||||
3
model-00004-of-00004.safetensors
Normal file
3
model-00004-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:273253da7c24a105ec95c53ab4acebde6fc1c287e8782904a58fef766594e4bd
|
||||||
|
size 2780953384
|
||||||
442
model.safetensors.index.json
Normal file
442
model.safetensors.index.json
Normal file
@@ -0,0 +1,442 @@
|
|||||||
|
{
|
||||||
|
"metadata": {
|
||||||
|
"total_size": 17658814464
|
||||||
|
},
|
||||||
|
"weight_map": {
|
||||||
|
"lm_head.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.embed_tokens.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.0.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.1.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.10.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.11.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.12.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.12.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.12.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.12.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.12.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.12.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.12.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.12.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.12.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.13.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.13.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.13.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.13.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.13.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.13.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.13.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.13.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.13.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.14.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.15.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.16.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.17.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.18.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.19.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.2.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.2.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.2.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.2.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.2.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.2.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.2.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.2.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.2.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.20.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.20.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.20.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.20.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.20.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.20.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.20.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.20.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.20.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.21.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.22.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.23.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.24.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.25.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.input_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.26.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.27.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.27.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.27.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.27.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.27.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.27.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.27.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.27.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.27.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
|
||||||
|
"model.layers.28.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.28.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.28.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.28.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.28.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.28.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.28.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.28.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.28.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.29.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.3.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.3.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.3.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.3.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.3.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.3.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.3.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.3.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.3.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.30.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.30.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.30.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.30.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.30.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.30.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.30.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.30.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.30.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.31.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.32.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.33.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.34.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.35.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.36.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.37.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.38.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.39.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.4.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.4.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.4.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.4.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.4.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.4.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.4.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.4.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.4.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.40.input_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.40.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.40.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.40.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.40.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.40.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.40.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.40.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.40.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.41.input_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.41.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.41.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.41.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.41.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.41.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.41.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.41.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.41.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
|
||||||
|
"model.layers.42.input_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.42.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.42.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.42.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.42.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.42.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.42.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.42.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.42.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.input_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.43.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.input_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.44.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.input_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.45.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.input_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.46.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.input_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.47.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
|
||||||
|
"model.layers.5.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.5.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.5.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.5.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.5.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.5.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.5.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.5.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.5.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.6.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.7.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.8.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.input_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.layers.9.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
|
||||||
|
"model.norm.weight": "model-00004-of-00004.safetensors"
|
||||||
|
}
|
||||||
|
}
|
||||||
9
ollama/Modelfile
Normal file
9
ollama/Modelfile
Normal file
@@ -0,0 +1,9 @@
|
|||||||
|
# Upstream HF repo: 01-ai/Yi-9B-200K
|
||||||
|
# Use 'ollama pull' on a converted GGUF mirror, or run via transformers (see quickstart.py).
|
||||||
|
FROM hf.co/01-ai/Yi-9B-200K
|
||||||
|
|
||||||
|
PARAMETER temperature 0.4
|
||||||
|
PARAMETER top_p 0.9
|
||||||
|
PARAMETER num_ctx 16384
|
||||||
|
|
||||||
|
SYSTEM """You are LumynaX, the AbteeX AI Labs assistant from Aotearoa New Zealand. Ko te marama te tuapapa. Answer with care; cite uncertainty; refuse unsafe asks."""
|
||||||
95
quickstart.py
Normal file
95
quickstart.py
Normal file
@@ -0,0 +1,95 @@
|
|||||||
|
"""
|
||||||
|
LumynaX Long-Context Yi-9B 200K — LumynaX quickstart.
|
||||||
|
|
||||||
|
This script fetches the upstream model from Hugging Face and runs a short
|
||||||
|
LumynaX-flavoured prompt. Run it on a host that satisfies the resource budget
|
||||||
|
documented in the README (LumynaX Long-Context Yi-9B 200K).
|
||||||
|
|
||||||
|
Usage:
|
||||||
|
python quickstart.py # one-shot demo prompt
|
||||||
|
python quickstart.py --interactive # REPL
|
||||||
|
python quickstart.py --gguf # use the GGUF mirror via llama-cpp
|
||||||
|
|
||||||
|
LumynaX package repo: https://huggingface.co/AbteeXAILab/lumynax-longctx-yi-9b-200k
|
||||||
|
Upstream weights: https://huggingface.co/01-ai/Yi-9B-200K
|
||||||
|
"""
|
||||||
|
from __future__ import annotations
|
||||||
|
import argparse, os, sys
|
||||||
|
|
||||||
|
LUMYNAX_SYSTEM = (
|
||||||
|
"You are LumynaX, the AbteeX AI Labs assistant from Aotearoa New Zealand. "
|
||||||
|
"Ko te marama te tuapapa - the light is the foundation. "
|
||||||
|
"Answer with care, cite uncertainty, and prefer local-first reasoning. "
|
||||||
|
"Refuse unsafe, unlawful, or sovereignty-violating requests."
|
||||||
|
)
|
||||||
|
DEMO_PROMPT = "Explain in 3 bullets why local-first AI matters for Aotearoa New Zealand."
|
||||||
|
|
||||||
|
def _run_hf(prompt: str, interactive: bool):
|
||||||
|
import torch
|
||||||
|
from transformers import AutoModelForCausalLM, AutoTokenizer
|
||||||
|
print("[lumynax] Loading 01-ai/Yi-9B-200K. This is a >100B MoE — multi-GPU or accelerate offload recommended.")
|
||||||
|
tok = AutoTokenizer.from_pretrained("01-ai/Yi-9B-200K", trust_remote_code=True)
|
||||||
|
model = AutoModelForCausalLM.from_pretrained(
|
||||||
|
"01-ai/Yi-9B-200K", device_map="auto", torch_dtype="auto", trust_remote_code=True
|
||||||
|
)
|
||||||
|
def chat(user):
|
||||||
|
messages = [
|
||||||
|
{"role": "system", "content": LUMYNAX_SYSTEM},
|
||||||
|
{"role": "user", "content": user},
|
||||||
|
]
|
||||||
|
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
|
||||||
|
inputs = tok(text, return_tensors="pt").to(model.device)
|
||||||
|
out = model.generate(**inputs, max_new_tokens=512, do_sample=True, temperature=0.4)
|
||||||
|
return tok.decode(out[0, inputs["input_ids"].shape[-1]:], skip_special_tokens=True)
|
||||||
|
if interactive:
|
||||||
|
print("[lumynax] interactive mode — empty line exits.")
|
||||||
|
while True:
|
||||||
|
try: q = input("you> ").strip()
|
||||||
|
except EOFError: break
|
||||||
|
if not q: break
|
||||||
|
print("lumynax> " + chat(q))
|
||||||
|
else:
|
||||||
|
print(chat(prompt))
|
||||||
|
|
||||||
|
|
||||||
|
def _run_gguf(prompt: str, interactive: bool):
|
||||||
|
from llama_cpp import Llama
|
||||||
|
mirror = ""
|
||||||
|
if not mirror:
|
||||||
|
print("[lumynax] No community GGUF mirror registered for this build."); sys.exit(2)
|
||||||
|
print(f"[lumynax] Loading GGUF from {mirror}...")
|
||||||
|
llm = Llama.from_pretrained(
|
||||||
|
repo_id=mirror, filename="*Q4_K_M*.gguf",
|
||||||
|
n_ctx=16384,
|
||||||
|
n_gpu_layers=int(os.environ.get("N_GPU_LAYERS", "-1")), verbose=False,
|
||||||
|
)
|
||||||
|
def chat(user):
|
||||||
|
out = llm.create_chat_completion(messages=[
|
||||||
|
{"role": "system", "content": LUMYNAX_SYSTEM},
|
||||||
|
{"role": "user", "content": user},
|
||||||
|
], max_tokens=512, temperature=0.4)
|
||||||
|
return out["choices"][0]["message"]["content"]
|
||||||
|
if interactive:
|
||||||
|
while True:
|
||||||
|
try: q = input("you> ").strip()
|
||||||
|
except EOFError: break
|
||||||
|
if not q: break
|
||||||
|
print("lumynax> " + chat(q))
|
||||||
|
else:
|
||||||
|
print(chat(prompt))
|
||||||
|
|
||||||
|
|
||||||
|
def main():
|
||||||
|
p = argparse.ArgumentParser()
|
||||||
|
p.add_argument("--interactive", action="store_true")
|
||||||
|
p.add_argument("--prompt", default=DEMO_PROMPT)
|
||||||
|
p.add_argument("--gguf", action="store_true")
|
||||||
|
args = p.parse_args()
|
||||||
|
if args.gguf:
|
||||||
|
_run_gguf(args.prompt, args.interactive)
|
||||||
|
else:
|
||||||
|
_run_hf(args.prompt, args.interactive)
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
main()
|
||||||
37
release_export_manifest.json
Normal file
37
release_export_manifest.json
Normal file
@@ -0,0 +1,37 @@
|
|||||||
|
{
|
||||||
|
"release_id": "lumynax-longctx-yi-9b-200k",
|
||||||
|
"title": "LumynaX Long-Context Yi-9B 200K",
|
||||||
|
"repo_id": "AbteeXAILab/lumynax-longctx-yi-9b-200k",
|
||||||
|
"version": "v0.1.0",
|
||||||
|
"publisher": "AbteeX AI Labs",
|
||||||
|
"publisher_org": "AbteeXAILab",
|
||||||
|
"jurisdiction": "NZ",
|
||||||
|
"residency": [
|
||||||
|
"NZ",
|
||||||
|
"AU",
|
||||||
|
"global"
|
||||||
|
],
|
||||||
|
"upstream": {
|
||||||
|
"repo_id": "01-ai/Yi-9B-200K",
|
||||||
|
"license": "apache-2.0",
|
||||||
|
"prompt_format": "chatml",
|
||||||
|
"source_note": "01-ai Yi 200K"
|
||||||
|
},
|
||||||
|
"gguf_mirror": null,
|
||||||
|
"runtime": "transformers",
|
||||||
|
"modalities": [
|
||||||
|
"text"
|
||||||
|
],
|
||||||
|
"context_tokens": 204800,
|
||||||
|
"total_params_b": 9,
|
||||||
|
"active_params_b": null,
|
||||||
|
"quantization": "bf16 safetensors (sharded)",
|
||||||
|
"primary_artifact": "model.safetensors.index.json",
|
||||||
|
"package_state": "weights_mirrored",
|
||||||
|
"validation_status": "scaffold_verified",
|
||||||
|
"sovereignty_tier": 3,
|
||||||
|
"supports_tools": false,
|
||||||
|
"supports_json": true,
|
||||||
|
"audit_hash_chain": "SHA-256 over canonical request + response JSON",
|
||||||
|
"build_date_utc": "2026-05-17T10:35:23Z"
|
||||||
|
}
|
||||||
8
requirements.txt
Normal file
8
requirements.txt
Normal file
@@ -0,0 +1,8 @@
|
|||||||
|
huggingface_hub>=0.27
|
||||||
|
numpy
|
||||||
|
torch>=2.4
|
||||||
|
transformers>=4.50
|
||||||
|
accelerate>=1.0
|
||||||
|
safetensors
|
||||||
|
sentencepiece
|
||||||
|
einops
|
||||||
176167
tokenizer.json
Normal file
176167
tokenizer.json
Normal file
File diff suppressed because it is too large
Load Diff
3
tokenizer.model
Normal file
3
tokenizer.model
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:386c49cf943d71aa110361135338c50e38beeff0a66593480421f37b319e1a39
|
||||||
|
size 1033105
|
||||||
13
tokenizer_config.json
Normal file
13
tokenizer_config.json
Normal file
@@ -0,0 +1,13 @@
|
|||||||
|
{
|
||||||
|
"add_bos_token": false,
|
||||||
|
"add_eos_token": false,
|
||||||
|
"model_max_length": 4096,
|
||||||
|
"unk_token": "<unk>",
|
||||||
|
"bos_token": "<|startoftext|>",
|
||||||
|
"eos_token": "<|endoftext|>",
|
||||||
|
"pad_token": "<unk>",
|
||||||
|
"sp_model_kwargs": {},
|
||||||
|
"clean_up_tokenization_spaces": false,
|
||||||
|
"legacy": true,
|
||||||
|
"tokenizer_class": "LlamaTokenizer"
|
||||||
|
}
|
||||||
Reference in New Issue
Block a user