Introducing indexed.xyz

We're thrilled to unveil indexed.xyz - a public, open, CC0-licensed^{note 1} crypto dataset. Indexed.xyz delivers raw and decoded blockchain data, accessible and downloadable for anyone, entirely free of charge. Beginning with Ethereum data, we're collaborating with various blockchains including Arweave, Base, and Gnosis to expand our dataset in the subsequent weeks and months.

What can I do with indexed.xyz?

Dive right into indexed.xyz and begin exploring: blocks, traces, raw and decoded event logs, all available for direct download to your device. For example, you can download the complete history of ENS registrations and renewals (i.e., event logs from the ENS Base Registry contract) with a single command. All it takes are a few lines of code to analyze the holder distribution of your favorite NFT collection, DEX trading volume over recent weeks, or Snapshot governance proposals and votes for leading DAOs.

How does indexed.xyz work?

Our data is stored in the R2 Object Storage - boasting near-complete S3 API compatibility (Cloudflare docs) - and is downloadable locally.

The Goldsky CLI incorporates indexed commands (which don't require a Goldsky account) allowing you to backfill and continuously stream data (blocks, transactions, raw and decoded event logs) to your machine using a single command. Get started by visiting indexed.xyz to generate a CLI command, or explore the documentation for more.

Files are conveniently stored and served by the Goldsky CLI as .parquet files - an efficient, versatile, and easily accessible format that allows for querying without needing a database. Want immediate analysis in Python? Pandas seamlessly supports Parquet data. Prefer SQL? Simply load the data with DuckDB in seconds and perform queries directly or via an analytics and querying platform like Metabase.

indexed.xyz offers an entirely open and community-supported experience: while our CLI provides one way to access data, others can develop their interfaces and applications on top of the core data. For example, Rill, an open-source business intelligence tool, has created a CURL script for downloading events related to specific contracts and launching interactive, editable dashboards. Learn more about their integration here.

Why did we build indexed.xyz?

Simply put - working with web3 data is slow, painful, and expensive, and indexed.xyz is built to address these pain points for specific use cases. Focused on addressing these limitations, indexed.xyz offers the following benefits:

Control over your data stack.

Current solutions primarily involve cloud platforms resulting in vendor lock-ins and limiting users' flexibility and options. Contrarily, indexed.xyz enables you to download and use data without restrictions, granting you greater control over your data stack.

Works offline.

While existing cloud-based solutions require an internet connection and often charge for compute/storage, indexed.xyz lets you download data locally and take advantage of your existing free compute/storage (e.g., your laptop or desktop!)

Community-led.

indexed.xyz is an open and community-led effort, closely aligned to the principles of web3: transparency, ownership, decentralization, and permissionless access. We're already seeing indie tools built on top of indexed.xyz, and are excited to support further development.

What comes next for indexed.xyz?

1. We'll continue expanding our dataset (e.g., adding traces)
2. We'll enhance tooling (e.g., integrity checks and user-submitted ABIs for decoding)
3. We'll expand the list of supported blockchains (any suggestions?)

If you're interested in becoming a builder or chain partner for indexed.xyz, feel free to contact the Goldsky team at [email protected]. You can also check out our Github for issues, pull requests, and discussion!

Notes

1. ^ CC0 is the "no rights reserved" license.