haopeng 64ed2091b2 server: Add "tokens per second" information in the backend (#10548) ...

* add cmake rvv support

* add timings

* remove space

* update readme

* fix

* fix code

* remove empty line

* add test

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>

2024-12-02 14:45:54 +01:00

..

test_basic.py

server : add more test cases (#10569)

2024-11-29 21:48:56 +01:00

test_chat_completion.py

server: Add "tokens per second" information in the backend (#10548)

2024-12-02 14:45:54 +01:00

test_completion.py

server : replace behave with pytest (#10416)

2024-11-26 16:20:18 +01:00

test_ctx_shift.py

server : replace behave with pytest (#10416)

2024-11-26 16:20:18 +01:00

test_embedding.py

server : replace behave with pytest (#10416)

2024-11-26 16:20:18 +01:00

test_infill.py

server : add more test cases (#10569)

2024-11-29 21:48:56 +01:00

test_lora.py

server : replace behave with pytest (#10416)

2024-11-26 16:20:18 +01:00

test_rerank.py

server : add more test cases (#10569)

2024-11-29 21:48:56 +01:00

test_security.py

server : replace behave with pytest (#10416)

2024-11-26 16:20:18 +01:00

test_slot_save.py

server : replace behave with pytest (#10416)

2024-11-26 16:20:18 +01:00

test_speculative.py

server : add more test cases (#10569)

2024-11-29 21:48:56 +01:00

test_tokenize.py

server : replace behave with pytest (#10416)

2024-11-26 16:20:18 +01:00