library_name, pipeline_tag, tags, datasets, base_model

library_name	pipeline_tag	tags	datasets	base_model
transformers	text-generation	merlina grimoire text-generation sft	hemlang/Hemlock2-DPO hemlang/hemlock-formulary-SFT hemlang/hemlock-codex-SFT	hemlang/Hemlock-Codex-7B

Hemlock-Apothecary-7B

Training Configuration

Parameter	Value
Training Mode	SFT
Base Model	hemlang/Hemlock-Codex-7B
Learning Rate	0.0001
Epochs	2
Batch Size	2
Gradient Accumulation	8
Effective Batch Size	16
Max Sequence Length	2048
Optimizer	paged_adamw_8bit
LR Scheduler	cosine
Warmup Ratio	0.05
Weight Decay	0.01
Max Grad Norm	0.3
Seed	42
LoRA Rank (r)	128
LoRA Alpha	128
LoRA Dropout	0.05
Target Modules	up_proj, down_proj, gate_proj, k_proj, q_proj, v_proj, o_proj
Quantization	4-bit (NF4)
GPU	NVIDIA RTX A6000

---

Merlina on GitHub