Petals Health Monitor

Bootstrap peers: ●●

Swarm: Meta-Llama-3.1-405B-Instruct • Mixtral-8x22B-Instruct-v0.1 • StableBeluga2 • bloom-560m

Top contributors: 🦆FYY🌞 (36 blocks)

Model meta-llama/Meta-Llama-3.1-405B-Instruct (broken):

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...uvUTvy 🦆FYY🌞 2.3.0.dev2 84 tok/s bf16 (nf4) 16384 Direct Show 12:24 ●●●●●●●●●●●●
...N75dNF 🦆FYY🌞 2.3.0.dev2 84 tok/s bf16 (nf4) 16384 Direct Show 24:36 ●●●●●●●●●●●●
...Bvdh17 🦆FYY🌞 2.3.0.dev2 1332 tok/s bf16 (nf4) 16384 Direct Show 0:12 ●●●●●●●●●●●●

Not enough servers? Connect your GPU and increase Petals capacity!

Model mistralai/Mixtral-8x22B-Instruct-v0.1 (broken):

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks

Not enough servers? Connect your GPU and increase Petals capacity!

Model petals-team/StableBeluga2 (healthy):

This model is not officially supported. Use it at your own risk.

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...EWTFJu 2.3.0.dev2 112 tok/s bf16 (nf4) 16384 Direct Show 0:80 ●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●

Model bigscience/bloom-560m (healthy):

This model is not officially supported. Use it at your own risk.

Server ID » Contributor ? Version Throughput » Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...vFhic4 src.eco 2.3.0.dev2 1 tok/s bf16 4096 Relay Show 0:24 ●●●●●●●●●●●●●●●●●●●●●●●●

Legend:

StatusDescription
●onlineUp and running
●joiningLoading blocks, joining soon
✖unreachableUnreachable from the Internet, see "Reachability issues" below
_offlineDisconnected a few minutes ago