Petals Health Monitor

Bootstrap peers: ●●

Swarm: StableBeluga2 • Llama-2-70b-hf • Meta-Llama-3-70B • bloom • bloom-560m

Top contributors: coilz.cc (20 blocks)

Model petals-team/StableBeluga2 (healthy):

Server ID »	Contributor ?	Version	Throughput »	Inference ?	Forward ?	Network ?	Precision ?	LoRAs ?	Cache ?	Avl. ?	Pings ?	Served blocks
...b7AgMP	coilz.cc	2.3.0.dev2	219 tok/s	179	2303	763	bf16 (nf4)		16384	Direct	Show Hide 140.5 ms	0:20	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●
...3NNV6q		2.3.0.dev1	112 tok/s	336	4530	695	bf16 (nf4)		12288	Direct	Show Hide 138.7 ms	0:80	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●

Model meta-llama/Llama-2-70b-hf (broken):

Server ID »	Contributor ?	Version	Throughput »	Inference ?	Forward ?	Network ?	Precision ?	LoRAs ?	Cache ?	Avl. ?	Pings ?	Served blocks

Not enough servers? Connect your GPU and increase Petals capacity!

Model meta-llama/Meta-Llama-3-70B (healthy):

This model is not officially supported. Use it at your own risk.

Server ID »	Contributor ?	Version	Throughput »	Inference ?	Forward ?	Network ?	Precision ?	LoRAs ?	Cache ?	Avl. ?	Pings ?	Served blocks
...ijyUtz	🦆FYY🌞	2.3.0.dev2	132 tok/s	187	2703	2922	bf16 (nf4)		16384	Relay	Show Hide 1.5 ms 2.1 ms 262.5 ms 133.1 ms	40:80																																									●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●
...6QBzTR	🦆FYY🌞	2.3.0.dev2	132 tok/s	187	2703	2922	bf16 (nf4)		16384	Relay	Show Hide 2.1 ms 259.6 ms	0:40	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●
...DsTAuQ	PC-Memorelab	2.3.0.dev2	84 tok/s	744	24708	419	bf16 (nf4)		16384	Relay	Show Hide 374.3 ms 139.2 ms	59:80																																																												●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●
...NYuBYy	xpedite-tech.com	2.3.0.dev2	989 tok/s	786	23232	1564	bf16 (nf4)		16384	Direct	Show Hide 513.5 ms 499.4 ms 280.0 ms 356.9 ms	34:80																																			●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●
...oRSJiD	🦆FYY🌞	2.3.0.dev2	821 tok/s	266	29929	4104	bf16 (nf4)		16384	Relay	Show Hide 2.0 ms 260.5 ms	0:40	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●

Model bigscience/bloom (broken):

This model is not officially supported. Use it at your own risk.

Server ID »	Contributor ?	Version	Throughput »	Inference ?	Forward ?	Network ?	Precision ?	LoRAs ?	Cache ?	Avl. ?	Pings ?	Served blocks
...PzwTM9	680WM	2.3.0.dev2	227 tok/s	152	18326	1137	bf16 (nf4)		4096	Relay	Show Hide	0:10	●	●	●	●	●	●	●	●	●	●

Not enough servers? Connect your GPU and increase Petals capacity!

Model bigscience/bloom-560m (healthy):

This model is not officially supported. Use it at your own risk.

Server ID »	Contributor ?	Version	Throughput »	Inference ?	Forward ?	Network ?	Precision ?	LoRAs ?	Cache ?	Avl. ?	Pings ?	Served blocks
...dLC7Z9	src.eco	2.3.0.dev2	1 tok/s	13	18	6104	bf16		4096	Relay	Show Hide	0:24	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●	●

Legend:

Status		Description
●	online	Up and running
●	joining	Loading blocks, joining soon
✖	unreachable	Unreachable from the Internet, see "Reachability issues" below
_	offline	Disconnected a few minutes ago