Petals Health Monitor

Bootstrap peers: โœ–โ—

Swarm: StableBeluga2 falcon-180B-chat Llama-2-70b-chat-hf Llama-2-70b-hf japanese-stablelm-instruct-beta-70b bloom-560m

Top contributors: ๐Ÿฆ†FYY๐ŸŒž (40 blocks)

Model petals-team/StableBeluga2 (healthy):

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...5SYFSS 2.3.0.dev1 296 tok/s bf16 (nf4) 16384 Direct Show 56:73 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...YHJQTP 2.3.0.dev1 112 tok/s bf16 (nf4) 16384 Direct Show 0:80 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...sNETCE 2.3.0.dev2 59 tok/s f16 16384 Relay Show 0:8 โ—โ—โ—โ—โ—โ—โ—โ—
...aqxucA ๐Ÿฆ†FYY๐ŸŒž 2.3.0.dev1 132 tok/s bf16 (nf4) 16384 Direct Show 0:40 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...AkUYuc 2.3.0.dev1 313 tok/s bf16 (nf4) 16384 Direct Show 40:56 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...TWvZkt 2.3.0.dev1 313 tok/s bf16 (nf4) 16384 Direct Show 64:80 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—

Model tiiuae/falcon-180B-chat (broken):

This model is supposed to be used by our chatbot app only. We do not provide a public API for this model due to license restrictions.

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks

Not enough servers? Connect your GPU and increase Petals capacity!

Model meta-llama/Llama-2-70b-chat-hf (broken):

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks

Not enough servers? Connect your GPU and increase Petals capacity!

Model meta-llama/Llama-2-70b-hf (broken):

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks

Not enough servers? Connect your GPU and increase Petals capacity!

Model stabilityai/japanese-stablelm-instruct-beta-70b (broken):

This model is not officially supported. Use it at your own risk.

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...JYtgoY 2.3.0.dev2 132 tok/s f16 (nf4) 16384 Relay 0:46 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—

Not enough servers? Connect your GPU and increase Petals capacity!

Model bigscience/bloom-560m (broken):

This model is not officially supported. Use it at your own risk.

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...PzbQWt src.eco 2.3.0.dev1 10 tok/s bf16 4096 Relay 0:10 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—

Not enough servers? Connect your GPU and increase Petals capacity!

Legend:

StatusDescription
โ—onlineUp and running
โ—joiningLoading blocks, joining soon
โœ–unreachableUnreachable from the Internet, see "Reachability issues" below
_offlineDisconnected a few minutes ago

Reachability issues:

Servers may be unreachable due to port forwarding/NAT/firewall issues. Normally, they should become reachable in a few minutes, once they join a libp2p circuit relay. If your server fails to do that, please ask for help in the #running-a-server channel of our Discord.

Peer IDError message
QmedTaZXmULqwspJXz44SsPZyTNKxhnnFvYRajfH7MGhCY Connect failed. msg=failed to find peers: routing: not found