Petals Health Monitor

Bootstrap peers:

Swarm: StableBeluga2 Llama-2-70b-hf

Top contributors: coilz.cc (22 blocks)

Model petals-team/StableBeluga2 (healthy):

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...Xa9bQ5 2.3.0.dev2 15 tok/s bf16 16384 Relay Show 63:67
...SkH1Xw 2.3.0.dev2 153 tok/s bf16 (nf4) 16384 Relay Show 0:13
...aA3TZ2 2.3.0.dev2 15 tok/s bf16 16384 Relay Show 25:29
...ogNySU coilz.cc 2.3.0.dev2 200 tok/s bf16 (nf4) 16384 Direct Show 58:80
...3NNV6q 2.3.0.dev1 112 tok/s bf16 (nf4) 14268 Direct Show 0:80

Model meta-llama/Llama-2-70b-hf (broken):

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks

Not enough servers? Connect your GPU and increase Petals capacity!

Legend:

StatusDescription
onlineUp and running
joiningLoading blocks, joining soon
unreachableUnreachable from the Internet, see "Reachability issues" below
_offlineDisconnected a few minutes ago

Reachability issues:

Servers may be unreachable due to port forwarding/NAT/firewall issues. Normally, they should become reachable in a few minutes, once they join a libp2p circuit relay. If your server fails to do that, please ask for help in the #running-a-server channel of our Discord.

Peer IDError message
12D3KooWCs5UnGcfKgjWu4FanGvoyqDuAsLbFzwExx2L7SSkH1Xw Failed to connect in 5 sec. Firewall may be blocking connections