43 lines
1.2 KiB
Markdown
43 lines
1.2 KiB
Markdown
---
|
|
language:
|
|
- pt
|
|
license: apache-2.0
|
|
base_model: openbmb/MiniCPM5-1B
|
|
library_name: transformers
|
|
tags:
|
|
- brazilian-portuguese
|
|
- minicpm5
|
|
- vivamais
|
|
- travel-agency
|
|
- grounded-qa
|
|
---
|
|
|
|
# minicpm5-1b-vivamais-v0
|
|
|
|
MiniCPM5-1B text fine-tune for Viva Mais dashboard Q&A.
|
|
|
|
Training uses a redacted-only mix: public Portuguese instruction data,
|
|
schema-shaped Viva Mais dashboard examples, and grounding/refusal cases. Raw
|
|
WhatsApp exports, full transcriptions, and client identifiers are not published.
|
|
|
|
Acceptance is the repository's Viva Mais QA eval, not generic Portuguese
|
|
leaderboards.
|
|
|
|
## Viva Mais QA Eval
|
|
|
|
This `v0` checkpoint is candidate 002 from the Viva Mais text SFT pipeline. It
|
|
was published by user decision because it beat the base model on average score,
|
|
but it is not marked as fully accepted by the automated gate.
|
|
|
|
- Base model: `openbmb/MiniCPM5-1B`
|
|
- Eval run: `vivamais_qa_candidate_002`
|
|
- Average score: `0.6588541666666667`
|
|
- Base average score: `0.6197916666666667`
|
|
- Pass rate: `0.5625`
|
|
- Gate passed: `false`
|
|
- Leakage failures: `2`
|
|
- Unknown-answer failures: `3`
|
|
|
|
Use this checkpoint as a versioned Viva Mais candidate, not as the final accepted
|
|
grounded-Q&A model.
|