初始化项目,由ModelHub XC社区提供模型
Model: aws-neuron/Qwen3-1.7B-TP4-BS4-SEQ2048 Source: Original Platform
This commit is contained in:
1
token_generation_model/_tp0_bk1/command.txt
Normal file
1
token_generation_model/_tp0_bk1/command.txt
Normal file
@@ -0,0 +1 @@
|
||||
neuronx-cc compile --framework=XLA model.MODULE_f53407701fa4882a24c0+55c11e15.hlo_module.pb --output model.MODULE_f53407701fa4882a24c0+55c11e15.neff --target=trn2 --auto-cast=none --model-type=transformer '--tensorizer-options=--enable-ccop-compute-overlap --cc-pipeline-tiling-factor=1 --vectorize-strided-dma ' --lnc=2 -O2 --internal-hlo2tensorizer-options=--verify-hlo=true --logfile=log-neuron-cc.txt --verbose=35
|
||||
Reference in New Issue
Block a user