Bootstrap peers: ●●
Swarm: Meta-Llama-3.1-405B-Instruct • Mixtral-8x22B-Instruct-v0.1 • StableBeluga2 • bloom-560m
Top contributors:
Model meta-llama/Meta-Llama-3.1-405B-Instruct (broken):
Server ID » | Contributor ? | Version | Throughput » | Precision ? | LoRAs ? | Cache ? | Avl. ? | Pings ? | Served blocks |
Not enough servers? Connect your GPU and increase Petals capacity!
Model mistralai/Mixtral-8x22B-Instruct-v0.1 (broken):
Server ID » | Contributor ? | Version | Throughput » | Precision ? | LoRAs ? | Cache ? | Avl. ? | Pings ? | Served blocks |
Not enough servers? Connect your GPU and increase Petals capacity!
Model petals-team/StableBeluga2 (broken):
This model is not officially supported. Use it at your own risk.
Server ID » | Contributor ? | Version | Throughput » | Precision ? | LoRAs ? | Cache ? | Avl. ? | Pings ? | Served blocks | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
...MkZTfp | qlyoung | 2.3.0.dev2 | 153 tok/s | bf16 (nf4) | 16384 | Relay | Show | 0:13 | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● |
Not enough servers? Connect your GPU and increase Petals capacity!
Model bigscience/bloom-560m (healthy):
This model is not officially supported. Use it at your own risk.
Server ID » | Contributor ? | Version | Throughput » | Precision ? | LoRAs ? | Cache ? | Avl. ? | Pings ? | Served blocks | ||||||||||||||||||||||||
...ghH19R | src.eco | 2.3.0.dev2 | 1 tok/s | bf16 | 4096 | Relay | 0:24 | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● |
Legend:
Status | Description | |
● | online | Up and running |
● | joining | Loading blocks, joining soon |
✖ | unreachable | Unreachable from the Internet, see "Reachability issues" below |
_ | offline | Disconnected a few minutes ago |