multilingual_model/EVAL_REPORT.md

Automated MNLP evaluation report

• Model repo: cs-552-2026-catma/multilingual_model
• Owner(s): group catma
• Generated at: 2026-05-28T08:03:33+00:00 (UTC)
• Pipeline: mnlp-project-ci

This PR is opened automatically by the course CI. It is non-blocking — you do not need to merge it. The next nightly run will refresh this file.

Summary

Benchmark	Accuracy	Status
Math	—	not run
Knowledge	—	not run
Multilingual	0.6500	ok
Safety	—	not run

Sample completions

Prompts are intentionally omitted to avoid revealing benchmark contents. For multi-completion problems, only one completion is shown per sample.

Multilingual

Correct (1 shown)

• reference: A

• overall (1/1 completions correct)

• extracted (✓): A

• completion:

  <think>
  Analizando las opciones, la respuesta correcta es A.
  </think>
  
  \boxed{A}
  

Incorrect (1 shown)

• reference: B

• overall (0/1 completions correct)

• extracted (✗): A

• completion:

  <think>
  विकल्पों का विश्लेषण करते हुए, सही उत्तर A है।
  </think>
  
  \boxed{A}