evilfreelancer/llama.cpp-rpc

By evilfreelancer

•Updated about 13 hours ago

Dockerized llama.cpp RPC-server

Image

Machine learning & AI

50K+

Overview Tags

Tags for evilfreelancer/llama.cpp-rpc

Sort by

TAG

latest-cuda

Last pushed about 13 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:latest-cuda

Digest	OS/ARCH	Compressed size
1b7dc1b8ea1b	linux/amd64	1.75 GB

TAG

cuda

Last pushed about 13 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:cuda

Digest	OS/ARCH	Compressed size
1b7dc1b8ea1b	linux/amd64	1.75 GB

TAG

b11553-cuda

Last pushed about 13 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11553-cuda

Digest	OS/ARCH	Compressed size
1b7dc1b8ea1b	linux/amd64	1.75 GB

TAG

b11552-cuda

Last pushed about 14 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11552-cuda

Digest	OS/ARCH	Compressed size
2e314ad018bb	linux/amd64	1.75 GB

TAG

b11387-cuda

Last pushed 8 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11387-cuda

Digest	OS/ARCH	Compressed size
f6d06823f5ec	linux/amd64	1.75 GB

TAG

b11388-cuda

Last pushed 8 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11388-cuda

Digest	OS/ARCH	Compressed size
766b6f851033	linux/amd64	1.75 GB

TAG

b11387

Last pushed 8 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11387

Digest	OS/ARCH	Compressed size
8c86e9b963ac	linux/amd64	104.27 MB
eddf2aaf5a74	linux/arm64	90.57 MB

TAG

latest

Last pushed 8 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:latest

Digest	OS/ARCH	Compressed size
0cc3f4264749	linux/amd64	104.28 MB
df2ef6c7d3de	linux/arm64	90.58 MB

TAG

b11388

Last pushed 8 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11388

Digest	OS/ARCH	Compressed size
0cc3f4264749	linux/amd64	104.28 MB
df2ef6c7d3de	linux/arm64	90.58 MB

TAG

b11211-cuda

Last pushed 15 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11211-cuda

Digest	OS/ARCH	Compressed size
e7b73c0a72ca	linux/amd64	1.75 GB

TAG

b11209-cuda

Last pushed 15 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11209-cuda

Digest	OS/ARCH	Compressed size
cc68571d8058	linux/amd64	1.75 GB

TAG

b11209

Last pushed 15 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11209

Digest	OS/ARCH	Compressed size
b012cdaef320	linux/amd64	101.33 MB
e2534a1421b7	linux/arm64	87.77 MB

TAG

b11211

Last pushed 15 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11211

Digest	OS/ARCH	Compressed size
062e9018ad88	linux/amd64	101.33 MB
f8585a0cba75	linux/arm64	87.77 MB

TAG

b11060-cuda

Last pushed 22 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11060-cuda

Digest	OS/ARCH	Compressed size
621e96dd2a3f	linux/amd64	1.74 GB

TAG

b11062-cuda

Last pushed 22 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11062-cuda

Digest	OS/ARCH	Compressed size
319278d23429	linux/amd64	1.74 GB

TAG

b11062

Last pushed 22 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11062

Digest	OS/ARCH	Compressed size
cc896eac0202	linux/amd64	99.95 MB
fa7bcd30e31d	linux/arm64	87.41 MB

TAG

b11060

Last pushed 22 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11060

Digest	OS/ARCH	Compressed size
5dcd178f2ca4	linux/amd64	99.95 MB
155241f095a2	linux/arm64	87.41 MB

TAG

b10937-cuda

Last pushed 29 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b10937-cuda

Digest	OS/ARCH	Compressed size
b64703fefa02	linux/amd64	1.74 GB

TAG

b10938-cuda

Last pushed 29 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b10938-cuda

Digest	OS/ARCH	Compressed size
42023713d193	linux/amd64	1.74 GB

TAG

b10937

Last pushed 29 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b10937

Digest	OS/ARCH	Compressed size
a6b1a6408bf4	linux/amd64	99.7 MB
970de2a40d0a	linux/arm64	87.24 MB

TAG

b10938

Last pushed 29 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b10938

Digest	OS/ARCH	Compressed size
21d48317124d	linux/amd64	99.7 MB
2c141e5e072b	linux/arm64	87.24 MB

TAG

b10818-cuda

Last pushed about 1 month by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b10818-cuda

Digest	OS/ARCH	Compressed size
2f851a6e8216	linux/amd64	1.74 GB

TAG

b10819-cuda

Last pushed about 1 month by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b10819-cuda

Digest	OS/ARCH	Compressed size
ecb103e9811f	linux/amd64	1.74 GB

TAG

b10818

Last pushed about 1 month by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b10818

Digest	OS/ARCH	Compressed size
50097042d080	linux/amd64	101.81 MB
306fac37d0f3	linux/arm64	89.17 MB

TAG

b10819

Last pushed about 1 month by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b10819

Digest	OS/ARCH	Compressed size
b4c339eff63b	linux/amd64	101.81 MB
c7aee16e81ef	linux/arm64	89.17 MB