16 lines
1.1 KiB
Markdown
16 lines
1.1 KiB
Markdown
|
- `[x]` Pre-flight & Disk Space Verification (Purge HF cache if space < 12 GB)
|
||
|
|
- `[x]` Modify `axolotl-gpt2-chatml-fp32.yml` for test split (`train[:2500]`)
|
||
|
|
- `[x]` Launch and monitor test split training to completion
|
||
|
|
- `[x]` Convert test split checkpoint to GGUF FP32 using `ggify` conda environment
|
||
|
|
- `[x]` Calculate importance matrix (`llama-imatrix`) for test split GGUF
|
||
|
|
- `[x]` Generate test split quantizations (`Q8_0`, `IQ4_NL`, `IQ3_XXS`)
|
||
|
|
- `[x]` Verify coherence on test split quants (Prompts: Capital of France, Why is sky blue, What is gravity)
|
||
|
|
- `[x]` Evaluate output quality (Troubleshoot hyperparameters if worse/incoherent)
|
||
|
|
- `[x]` Modify `axolotl-gpt2-chatml-fp32.yml` for full dataset SFT (`train`)
|
||
|
|
- `[x]` Launch and monitor full training to completion
|
||
|
|
- `[x]` Convert final checkpoint to GGUF FP32 using `ggify` conda environment
|
||
|
|
- `[x]` Calculate importance matrix (`llama-imatrix`) for final GGUF
|
||
|
|
- `[x]` Generate final quantizations (`Q8_0`, `IQ4_NL`, `IQ3_XXS`)
|
||
|
|
- `[x]` Verify coherence on final quants (Prompts: Capital of France, Why is sky blue, What is gravity)
|
||
|
|
- `[x]` Create/update `walkthrough.md` with final metrics, sizes, and test outputs
|