Changelog

Introducing Turbo Pipelines + Solana support

Slow spin-ups, constantly waiting for redeploys to test and debug, and opaque logs make building with blockchain data feel heavier than it should. Turbo Pipelines brings significant performance improvements and capabilities to blockchain data streaming.

Powered by our next-generation data pipeline engine built in Rust, Turbo offers:

• Vectorized SIMD-parallelism
• Instant startups
• Live data previews
• Solana support
• TypeScript transformations
• Dynamic tables

Fast by default

Turbo Pipelines accelerates developer workflows as well as data streaming performance.

• Microsecond processing: Single-worker pipelines decode and filter batches of thousands of records in milliseconds, thanks to vector parallelism.

• Instant deployment: Run turbo apply to immediately start your pipeline, saving you several minutes of thumb-twiddling.
• Hot-reloadable: Update your running pipelines without stopping and redeploying them. Just make your changes and run turbo apply again.
• See before you ship: Live previews of data flowing through your pipelines, local debugging with real pipeline outputs, and OpenTelemetry (coming soon) makes it obvious what’s happening at every step.
  • Live inspect: Monitor what data is flowing through your pipelines at every single step with turbo inspect. Filter it down to individual sources, transforms, and sinks.
  • Log running outputs: Use turbo logs to monitor what outputs your pipelines are producing.
• TypeScript transforms: In addition to SQL and HTTP handlers, you can now write custom logic in TypeScript/JavaScript, executed via WebAssembly in a sandboxed environment.
• Dynamic tables: Create real-time lookup tables for filtering and enrichment on unlimited addresses.
  • Auto-populate your dynamic tables from on-chain data using SQL in your pipeline config.
  • Dynamic tables are also updatable, so you can modify them in real-time without redeploying your pipeline.
• Multi-chain ready: First-class Solana support, plus 140+ other supported chains from a single pipeline config (including all your transforms and sinks!)

Solana data streaming support

In addition to the same features above, Turbo Pipelines brings to the Solana ecosystem:

• Full historical access: unlimited historical replay of all Solana blocks, transactions, instructions, and token activity all the way back to genesis.
• High availability and resilience with automatic recovery, DLQs, at-least-once delivery guarantees, and the reliability and support included in all Goldsky indexing products.
• Built-in transforms and sinks: no plugin hunting required. Write processed data to webhooks, PostgreSQL, ClickHouse, Kafka, and more.
• Pre-processed, optimized datasets for common use cases.

Getting started with Turbo Pipelines

In the Goldsky web app:

1. Log into the web app
2. Go to Pipelines
3. Create a pipeline and select Turbo

Or in your CLI:

• Follow the Turbo Pipelines quickstart guide :)

Ready to go Turbo?

View the full docs to learn more about all the new capabilities. If you have questions, reach out to us at [email protected].