49 lines
3.6 KiB
Markdown
49 lines
3.6 KiB
Markdown
|
=== NPC Reason - Dispatch 4: Packaging + Card ===
|
||
|
|
|
||
|
|
GGUF: f16 / q8_0 / q4_K_M of the shipped RL model (rl/merged), built with llama.cpp (CUDA).
|
||
|
|
Decision-fidelity vs bf16 on 100 frozen-eval problems (greedy, frozen verifier d5d146cf):
|
||
|
|
f16 dVC +0.0 OK
|
||
|
|
q8_0 dVC +0.0 OK <- RECOMMENDED (behaviorally lossless, 1.9 GB)
|
||
|
|
q4_K_M dVC +6.0 DRIFTS (exceeds +/-2pp) -> flagged, NOT recommended
|
||
|
|
The Fin Nano lesson reproduced: q4 is structurally valid but changes decisions under quant
|
||
|
|
noise. Do not pick a quant on file size alone. (reports/gguf_fidelity.md)
|
||
|
|
|
||
|
|
Card: MODEL_CARD.md - full base/SFT/RL arc (verifiable 0 -> 76.8 -> 76.2; v&c 0 -> 58.0 -> 59.6;
|
||
|
|
accuracy 61.6 -> 65.8 -> 66.6), distillation-did-the-heavy-lifting, RLVR-stable-but-small
|
||
|
|
(~tied with SFT), 90% verifiable bar NOT met (stated as the open limitation), verifier
|
||
|
|
d5d146cf documented as BOTH the metric AND the reward, MIT/V4 lineage, attribution
|
||
|
|
Rama Krishna Bachu / Bottensor / ORCID 0009-0000-1298-0681. No overclaiming, no em dashes.
|
||
|
|
USAGE.md - format prompt + vLLM/GGUF run + how to run the verifier on outputs.
|
||
|
|
|
||
|
|
Release tree (release/, 22 curated text files; model + GGUF binaries referenced separately):
|
||
|
|
MODEL_CARD.md, USAGE.md
|
||
|
|
verifier/ (step_verifier.py + VERIFIER.lock) <- the product: users verify chains
|
||
|
|
eval/ (run_eval.py, eval_set.jsonl, _eval_meta.json, EVAL.lock)
|
||
|
|
tests/ (test_verifier.py)
|
||
|
|
prereg/ (PREREG.md + PREREG.lock)
|
||
|
|
locks/ (BASELINE / TRAINSET / SFT_RESULT / RL_RESULT .lock)
|
||
|
|
reports/ (baseline, sft_result, dispatch1/2/3_complete, gguf_fidelity, fidelity_result.json)
|
||
|
|
MODEL BINARIES (push-time): rl/merged/ (bf16, shipped) + gguf/{f16,q8_0,q4_K_M}.
|
||
|
|
EXCLUDED (de-link / methodology / secrets-touching): decisions.md, data/generate_v4.py
|
||
|
|
(DeepSeek API code), all *.sh run/build scripts, raw logs, reward_stats, training scripts.
|
||
|
|
|
||
|
|
Credential scan: CLEAN (HARD-HALT gate PASSED). Adversarial multi-angle audit (5 independent
|
||
|
|
auditors + reconciling synthesizer, all CLEAN, independently re-verified on the host):
|
||
|
|
- strict secret regex (sk-/hf_/ghp_/gho_/AKIA/xox*/AIza/BEGIN PRIVATE KEY): zero matches.
|
||
|
|
- all 5 known chat-leaked key prefixes (DeepSeek / HF x2 / CoinGecko / OpenAI-style): absent.
|
||
|
|
- "DEEPSEEK_API_KEY" string: absent from release/ (only in excluded generate_v4.py + decisions.md).
|
||
|
|
- release .py files: local model-load + SymPy only, no os.environ/network/auth.
|
||
|
|
- false-positives dismissed: SHA-256 hashes, env-var NAMES, tokenizer vocab tokens, a GSM8K
|
||
|
|
"secret seasoning" word problem.
|
||
|
|
|
||
|
|
Push: NOT done (prep only, per dispatch). Preconditions before a push dispatch runs:
|
||
|
|
1. Operator supplies HF org/repo name and confirms PRIVATE.
|
||
|
|
2. Operator ROTATES the DeepSeek key (still outstanding; it passed through chat).
|
||
|
|
3. At push time, re-confirm a FULL (not sampled) credential scan against the EXACT push
|
||
|
|
manifest IF model binaries (gguf/safetensors) are bundled (they live outside release/
|
||
|
|
and were sampled-clean: safetensors header no-secret, gguf strings clean).
|
||
|
|
4. Apply the same de-link discipline used for the BigBugAI HF push (no lineage docs).
|
||
|
|
|
||
|
|
Decisions np-015..np-018 logged. 7 frozen locks intact (no training/eval-logic changes this dispatch).
|
||
|
|
Project complete: base 0% -> SFT 76.8% -> RL 76.2%/59.6% v&c, verifier-grounded, honestly reported.
|