Lianmin Zheng 45473d4b2b Make input_ids a torch.Tensor (#1568)

2024-10-04 01:09:59 -07:00

..

cuda_graph_runner.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

forward_batch_info.py

Make input_ids a torch.Tensor (#1568)

2024-10-04 01:09:59 -07:00

model_runner.py

Organize sampling batch info better (#1562)

2024-10-03 18:29:49 -07:00