---
license: apache-2.0
base_model:
- Qwen/Qwen3-8B
---

# Qwen3-8B-PragReST

`minchaoh2002/Qwen3-8B-PragReST` is a Qwen3-8B model trained with **PragReST**: **Prag**matic **Re**asoning via **S**elf-**T**raining.

PragReST is a self-supervised framework for improving pragmatic language understanding. It trains models to reason about implied meaning, speaker intent, implicature, presupposition, metonymy, social context, and other cases where the intended meaning is not fully explicit in the surface text.

This model is associated with the paper:

**PragReST: Self-Reinforcing Counterfactual Reasoning for Pragmatic Language Understanding**
Jihyung Park*, Minchao Huang*, Leqi Liu, Elias Stengel-Eskin
The University of Texas at Austin
arXiv: https://arxiv.org/abs/2606.18624
Code: https://github.com/jihyung803/PragReST

* Equal contribution.

## Model Details

* **Model name:** `minchaoh2002/Qwen3-8B-PragReST`
* **Base model:** `Qwen/Qwen3-8B`
* **Model type:** Causal language model
* **Training framework:** PragReST
* **Training methods:** supervised fine-tuning with counterfactual bootstrapping, followed by GRPO reinforcement learning
* **Primary capability:** pragmatic language understanding and counterfactual pragmatic reasoning
* **Language:** English
* **Paper:** https://arxiv.org/abs/2606.18624
* **Code:** https://github.com/jihyung803/PragReST


## Quickstart

Install the latest `transformers` version. Qwen3 models require recent Transformers support.

```bash
pip install -U transformers accelerate torch
```

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "minchaoh2002/Qwen3-8B-PragReST"

tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype="auto",
    device_map="auto",
)

prompt = """Ken asks Mary, "Do you want tea with milk or sugar?"
Mary replies, "In a cup."

What is Mary likely implying? Explain the pragmatic reasoning."""

messages = [
    {"role": "user", "content": prompt}
]

text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True,
    enable_thinking=True,
)

inputs = tokenizer([text], return_tensors="pt").to(model.device)

outputs = model.generate(
    **inputs,
    max_new_tokens=2048,
    temperature=0.6,
    top_p=0.95,
    top_k=20,
    do_sample=True,
)

generated = outputs[0][len(inputs.input_ids[0]):]
print(tokenizer.decode(generated, skip_special_tokens=True))
```

## Evaluation

In the paper, PragReST is evaluated on four pragmatic reasoning benchmarks:

* **PragMega**: fine-grained pragmatic QA
* **Ludwig**: implicature interpretation
* **MetoQA**: metonymic reference resolution
* **AltPrag**: open-ended pragmatic recovery

Reported Qwen3-8B results:

| Model             |  PragMega |    Ludwig |    MetoQA |  AltPrag |
| ----------------- | --------: | --------: | --------: | -------: |
| Qwen3-8B Instruct |     73.37 |     80.33 |     73.52 |     7.24 |
| PragReST-SFT      |     77.51 |     82.17 |     78.56 |     7.46 |
| PragReST-GRPO     | **79.29** | **83.33** | **80.72** | **7.62** |


## Citation

If you use this model, please cite:

```bibtex
@article{park2026pragrest,
  title={PragReST: Self-Reinforcing Counterfactual Reasoning for Pragmatic Language Understanding},
  author={Park, Jihyung and Huang, Minchao and Liu, Leqi and Stengel-Eskin, Elias},
  year={2026},
  journal={arXiv preprint arXiv:2606.18624},
  url={https://arxiv.org/abs/2606.18624},
}
```

You may also cite the Qwen3 technical report for the base model:

```bibtex
@misc{qwen3technicalreport,
  title={Qwen3 Technical Report},
  author={Qwen Team},
  year={2025},
  eprint={2505.09388},
  archivePrefix={arXiv},
  primaryClass={cs.CL},
  url={https://arxiv.org/abs/2505.09388},
}
```

## License

This model is released under the Apache 2.0 license, following the base `Qwen/Qwen3-8B` model license.

Please also refer to the licenses and terms of the original datasets, benchmarks, and artifacts used in the PragReST paper.