Petals Health Monitor

Bootstrap peers: โ—โ—

Swarm: Meta-Llama-3.1-405B-Instruct Mixtral-8x22B-Instruct-v0.1 Meta-Llama-3.1-70B-Instruct bloom-560m

Top contributors: ๐Ÿฆ†FYY๐ŸŒž (36 blocks)

Model meta-llama/Meta-Llama-3.1-405B-Instruct (healthy):

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...Jn19h3 2.3.0.dev2 595 tok/s bf16 (nf4) 16384 Direct Show 84:126 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...Ju2JaX 2.3.0.dev2 595 tok/s bf16 (nf4) 16384 Direct Show 84:126 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...uvUTvy ๐Ÿฆ†FYY๐ŸŒž 2.3.0.dev2 84 tok/s bf16 (nf4) 16384 Direct Show 12:24 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...YBJY3q 2.3.0.dev2 595 tok/s bf16 (nf4) 16384 Direct Show 0:42 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...N75dNF ๐Ÿฆ†FYY๐ŸŒž 2.3.0.dev2 84 tok/s bf16 (nf4) 16384 Direct Show 24:36 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...c5wh1m 2.3.0.dev2 595 tok/s bf16 (nf4) 16384 Direct Show 42:84 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...Bvdh17 ๐Ÿฆ†FYY๐ŸŒž 2.3.0.dev2 1332 tok/s bf16 (nf4) 16384 Direct Show 0:12 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...nJBsjb 2.3.0.dev2 595 tok/s bf16 (nf4) 16384 Direct Show 42:84 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...A3jGpN 2.3.0.dev2 595 tok/s bf16 (nf4) 12288 Direct Show 0:42 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—

Model mistralai/Mixtral-8x22B-Instruct-v0.1 (healthy):

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...ew1DSJ 2.3.0.dev2 1015 tok/s bf16 (nf4) 4096 Direct 0:56 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—

Model meta-llama/Meta-Llama-3.1-70B-Instruct (healthy):

This model is not officially supported. Use it at your own risk.

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...BcFKst 2.3.0.dev2 1342 tok/s bf16 (nf4) 16384 Direct 0:80 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—

Model bigscience/bloom-560m (healthy):

This model is not officially supported. Use it at your own risk.

Server ID ยป Contributor ? Version Throughput ยป Precision ? LoRAs ? Cache ? Avl. ? Pings ? Served blocks
...JGzrQ2 src.eco 2.3.0.dev2 3 tok/s bf16 4096 Relay Show 10:20 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—
...vFhic4 src.eco 2.3.0.dev2 1 tok/s bf16 4096 Relay Show 0:24 โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—โ—

Legend:

StatusDescription
โ—onlineUp and running
โ—joiningLoading blocks, joining soon
โœ–unreachableUnreachable from the Internet, see "Reachability issues" below
_offlineDisconnected a few minutes ago