language, library_name, tags, base_model
language library_name tags base_model
en
zh
transformers
minicpm
duplex
text-generation
xinrongzhang2022/MiniCPM-duplex

MiniCPM-duplex (safetensors)

Modern safetensors conversion of xinrongzhang2022/MiniCPM-duplex.

Weights are identical — only the serialization format has changed from pytorch_model.bin to model.safetensors, enabling memory-mapped loading and compatibility with current versions of Transformers.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

tokenizer = AutoTokenizer.from_pretrained(
    "enochlev/MiniCPM-duplex", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    "enochlev/MiniCPM-duplex",
    trust_remote_code=True,
    dtype=torch.float16,
    device_map="auto",
)

prompt = "<用户>Hello, what can you do?<AI>"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(out[0], skip_special_tokens=True))

Original model

See xinrongzhang2022/MiniCPM-duplex for the original weights, paper, and full documentation.

Description
Model synced from source: enochlev/MiniCPM-duplex
Readme 2.1 MiB
Languages
Python 100%