Qubitium-ModelCloud 56a724eba3 [QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790) ...

Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
Co-authored-by: ZX-ModelCloud <zx@modelcloud.ai>

2025-03-05 01:11:00 -08:00

..

__init__.py

[CI] Improve Docs CI Efficiency (#3587)

2025-02-14 19:57:00 -08:00

custom_chat_template.md

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

function_calling.ipynb

Misc clean up; Remove the support of jump forward (#4032)

2025-03-03 07:02:14 -08:00

hyperparameter_tuning.md

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

native_api.ipynb

Add examples in sampling parameters (#4039)

2025-03-03 13:04:32 -08:00

offline_engine_api.ipynb

Add examples for returning hidden states when using the server (#4074)

2025-03-04 19:31:50 -08:00

openai_api_completions.ipynb

Docs: Fix layout to docs (#3733)

2025-02-21 11:24:13 -08:00

openai_api_embeddings.ipynb

[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)

2025-02-19 11:15:44 -08:00

openai_api_vision.ipynb

Docs: improve link to docs (#3860)

2025-02-26 10:29:25 -08:00

patch.py

[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)

2025-02-19 11:15:44 -08:00

quantization.md

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

sampling_params.md

Add examples for returning hidden states when using the server (#4074)

2025-03-04 19:31:50 -08:00

send_request.ipynb

Docs: Fix layout with sub-section (#3710)

2025-02-19 15:44:30 -08:00

separate_reasoning.ipynb

Reasoning parser (#4000)

2025-03-03 21:16:36 -08:00

server_arguments.md

example: add vlm to token in & out example (#3941)

2025-03-04 22:18:26 -08:00

speculative_decoding.ipynb

Misc clean up; Remove the support of jump forward (#4032)

2025-03-03 07:02:14 -08:00

structured_outputs.ipynb

[Feature] Support llguidance for constrained decoding (#3298)

2025-02-26 10:41:49 -08:00