sruti-1.5b/README.md

license, base_model, language, tags, pipeline_tag

license	base_model	language	tags	pipeline_tag
apache-2.0	Qwen/Qwen2.5-1.5B	en sa	hinduism vedanta sanskrit philosophy qwen2	text-generation

Śruti 1.5B

Śruti is a guide to Hindu / Sanātana / Vedic / Vedāntic philosophy — the Vedas, Upaniṣads, Bhagavad Gītā, Purāṇas, the six darśanas, Yoga, Tantra, and the Bhakti traditions. It answers in clear English and, where relevant, quotes the original Sanskrit (Devanāgarī with IAST transliteration) with translation and source.

Built by fine-tuning Qwen2.5-1.5B (Apache-2.0) with LoRA on hand-authored Q&A covering the core texts and schools, curated alongside a ~19M-token corpus of primary sources (Vedas, Upaniṣads, 13 Purāṇas, the epics, Dharmaśāstra, darśana literature, Yoga, Tantra, and modern expositors such as Dasgupta and Vivekananda).

Usage

transformers

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "MohitM2/sruti-1.5b"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto")

messages = [
    {"role": "system", "content": "You are Śruti, a knowledgeable and reverent guide to Hindu philosophy."},
    {"role": "user", "content": "What is the ātman according to Vedānta?"},
]
inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
out = model.generate(inputs, max_new_tokens=400, temperature=0.7, top_p=0.9)
print(tok.decode(out[0][inputs.shape[-1]:], skip_special_tokens=True))

Ollama (GGUF)

Quantized GGUF files are in the gguf/ folder (Q4_K_M ≈ 0.9 GB, Q8_0 ≈ 1.5 GB). With a Modelfile using the Qwen2.5 chat template:

ollama create sruti -f Modelfile
ollama run sruti "What is the atman according to Vedanta?"

Training

• Base: Qwen/Qwen2.5-1.5B
• Method: LoRA (r=64, α=128) on all attention + MLP projections, merged into the base
• Data: hand-authored instruction Q&A on Hindu philosophy with Sanskrit citations
• Precision: fp16; trained on a single NVIDIA T4/P100 (Kaggle)

Limitations

A 1.5B-parameter model: it can misquote, oversimplify contested doctrinal points, or hallucinate citations despite training against it. Verify Sanskrit quotations and sources before scholarly use. Not a substitute for study with primary texts or qualified teachers.