Abuse and Opt-out
ProbeLab measures peer-to-peer networks such as IPFS, Filecoin and Ethereum. We also measure how websites publish information for AI agents.
This page lists the software we run that may contact your systems, and how to reach us if it misbehaves or you want it to stop.
Our Software
Nebula
Nebula crawls peer-to-peer networks. It connects to each node, asks for the peers it knows, and records which nodes are reachable and what software they run. It does not download content. It crawls IPFS, Filecoin, Ethereum, Celestia, Polkadot, Bitcoin, Litecoin and Dogecoin at regular intervals.
| Networks | Identifier |
|---|---|
| libp2p and discv5 networks, such as IPFS | Agent version nebula/<version> |
| Bitcoin and networks derived from it | User agent /nebula:<version>/ |
Hermes
Hermes joins a peer-to-peer network as an ordinary node, subscribes to GossipSub topics and records how messages propagate. It runs on Ethereum, Filecoin and OP Stack networks such as Optimism and Base.
Agent version: hermes
Amphion
Amphion checks whether websites publish information for AI agents. It looks up DNS records and
fetches a few well-known paths, such as /robots.txt, /llms.txt and files
under /.well-known/. It makes a few requests per host and does not follow links,
submit forms or log in.
HTTP user agent:
amphion/<version> (+https://probelab.io/abuse/)
robots.txt token: amphion
Amphion reads robots.txt before anything else and obeys the rules for the amphion
token. To block it completely:
User-agent: amphion
Disallow: /To exclude a domain from DNS lookups, or to exclude a whole network, email us.
Report a Problem or Opt Out
Email [email protected] with:
- the domain names, IP addresses or peer IDs concerned
- the approximate time of the traffic, with time zone
- the user agent or agent version, if known
- what you want us to do, such as stop all contact or reduce the request rate
We reply within one working day. Opt-outs take effect from the next run of the software concerned, and we confirm by email once they are in place.