Petals Health Monitor

Bootstrap peers: ●●

Swarm: StableBeluga2 • Llama-2-70b-hf • Meta-Llama-3-70B • bloom • bloom-560m

Top contributors:

Model petals-team/StableBeluga2 (healthy):

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...3NNV6q 2.3.0.dev1 112 tok/s bf16 (nf4) 16384 Direct Show 0:80 ●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●

Model meta-llama/Llama-2-70b-hf (broken):

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks

Not enough servers? Connect your GPU and increase Petals capacity!

Model meta-llama/Meta-Llama-3-70B (healthy):

This model is not officially supported. Use it at your own risk.

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...qpdn7B xpedite-tech.com 2.3.0.dev2 989 tok/s bf16 (nf4) 16384 Direct Show 34:80 ●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●
...6QBzTR 🦆FYY🌞 2.3.0.dev2 132 tok/s bf16 (nf4) 16384 Relay Show 0:40 ●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●
...DsTAuQ PC-Memorelab 2.3.0.dev2 84 tok/s bf16 (nf4) 16384 Relay Show 59:80 ●●●●●●●●●●●●●●●●●●●●●

Model bigscience/bloom (broken):

This model is not officially supported. Use it at your own risk.

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...PzwTM9 680WM 2.3.0.dev2 227 tok/s bf16 (nf4) 4096 Relay Show 0:10 ●●●●●●●●●●

Not enough servers? Connect your GPU and increase Petals capacity!

Model bigscience/bloom-560m (healthy):

This model is not officially supported. Use it at your own risk.

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...oDb48o src.eco 2.3.0.dev2 1 tok/s bf16 4096 Relay 0:24 ●●●●●●●●●●●●●●●●●●●●●●●●

Legend:

StatusDescription
●onlineUp and running
●joiningLoading blocks, joining soon
✖unreachableUnreachable from the Internet, see "Reachability issues" below
_offlineDisconnected a few minutes ago