The Best of Both Worlds: Exploring the Role of Centralization in IPFS
Dennis Trautwein
About this talk
This Protocol Berg 2023 talk examines how IPFS uses semi-centralized "hybrid" components to address three structural challenges of a fully decentralized network: massive content publication, content retrieval performance, and adoption on resource-constrained mobile clients. Dennis walks through the design of Interplanetary Network Indexers (IPNI), Hydra Boosters, and HTTP gateways, then presents measurement results from ProbeLab showing IPNI indexes roughly two orders of magnitude more provider records than the DHT and reduces lookups from seconds to hundreds of milliseconds (single-digit milliseconds when CDN-cached). The talk also covers the trade-offs each component introduces — single-points-of-failure for indexers, route poisoning and eclipse-attack surface for Hydras, and loss of end-to-end CID verification plus operator-side privacy asymmetries for gateways. It closes with the decision to unplug the Hydra Booster shared database as the underlying DHT matured, framing this as a successful pattern of using centralized scaffolding to bootstrap a decentralized system that can later stand on its own.