Radoslav Gerganov 5e31828d3e ggml : add RPC backend (#6829) ...

* ggml : add RPC backend

The RPC backend proxies all operations to a remote server which runs a
regular backend (CPU, CUDA, Metal, etc).

* set TCP_NODELAY

* add CI workflows

* Address review comments

* fix warning

* implement llama_max_devices() for RPC

* Address review comments

* Address review comments

* wrap sockfd into a struct

* implement get_alignment and get_max_size

* add get_device_memory

* fix warning

* win32 support

* add README

* readme : trim trailing whitespace

* Address review comments

* win32 fix

* Address review comments

* fix compile warnings on macos

2024-05-14 14:27:19 +03:00

..

bench.yml

Disable benchmark on forked repo (#7034)

2024-05-05 13:38:55 +02:00

build.yml

ggml : add RPC backend (#6829)

2024-05-14 14:27:19 +03:00

close-issue.yml

ci : exempt confirmed bugs from being tagged as stale (#7014)

2024-05-01 08:13:59 +03:00

code-coverage.yml

ci: exempt master branch workflows from getting cancelled (#6486)

2024-04-04 18:30:53 +02:00

docker.yml

[bug fix] convert github repository_owner to lowercase (#6673)

2024-04-14 13:12:36 +02:00

editorconfig.yml

ci: exempt master branch workflows from getting cancelled (#6486)

2024-04-04 18:30:53 +02:00

gguf-publish.yml

ci : update checkout, setup-python and upload-artifact to latest (#6456)

2024-04-03 21:01:13 +03:00

nix-ci-aarch64.yml

ci: exempt master branch workflows from getting cancelled (#6486)

2024-04-04 18:30:53 +02:00

nix-ci.yml

ci: exempt master branch workflows from getting cancelled (#6486)

2024-04-04 18:30:53 +02:00

nix-flake-update.yml

ci: nix-flake-update: new token with pr permissions (#4879)

2024-01-11 17:22:34 +00:00

nix-publish-flake.yml

workflows: nix-flakestry: drop tag filters

2023-12-31 13:14:58 -08:00

python-check-requirements.yml

ci: exempt master branch workflows from getting cancelled (#6486)

2024-04-04 18:30:53 +02:00

python-lint.yml

convert.py : add python logging instead of print() (#6511)

2024-05-03 22:36:41 +03:00

server.yml

build(cmake): simplify instructions (cmake -B build && cmake --build build ...) (#6964)

2024-04-29 17:02:45 +01:00

zig-build.yml

ci: exempt master branch workflows from getting cancelled (#6486)

2024-04-04 18:30:53 +02:00