AIChenKai/TinyLlama-1.1B-Chat-v1.0-x2-MoE
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
TinyLlama-1.1B-Chat-v1.0-x2…/README.md
ModelHub XC 04f2c0c44c 初始化项目，由ModelHub XC社区提供模型 
Model: AIChenKai/TinyLlama-1.1B-Chat-v1.0-x2-MoE
Source: Original Platform
2026-07-10 15:22:19 +08:00

309 B
Raw Permalink Blame History

license
license
apache-2.0

Testing model.

Config:

base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
gate_mode: hidden
dtype: bfloat16
experts:
  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    positive_prompts: [""]
  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    positive_prompts: [""]