Awesome Substreams

Carefully curated list of awesome Substreams resources. If you find the list helpful, please make sure to ⭐ star it!

Substreams is a powerful blockchain indexing technology, developed for The Graph Network.

Substreams enables developers to write Rust modules, composing data streams alongside the community, and provides extremely high-performance indexing by virtue of parallelization, in a streaming-first fashion.

Contents

• Technology
• Articles
• Videos
• Twitter
  • Protocols
  • Companies
  • Core Contributors
  • Community Advocates
• Blockchains
  • Substreams
  • Firehose
• Sinks
• Substreams Tools
• Substreams Examples
• Learning Rust
• SDK
  • Rust
  • Python
  • JavaScript
  • Golang
• Endpoints
• Protobuf
  • Blocks
  • Sinks

Technology

• Substreams Documentation - Substreams is a powerful blockchain indexing technology, developed for The Graph Network.
• Substreams Glossary
• Firehose Documentation - Firehose provides a files-based and streaming-first approach to processing blockchain data.
• The Graph - The Graph is an indexing protocol for querying networks like Ethereum and IPFS.

Articles

Articles related or describing to Substreams

• Parallel Indexing Of Blockchain Data With Substreams
• Substreams: Massively Faster Indexing Performance for Subgraphs
• Substreams: Unlocking Lightning-Fast Indexing of Blockchain Data
• Tips and Tricks for Developing Substreams
• Unveiling Substreams.dev: A comprehensive hub to discover, build, deploy, and share Substreams

Videos

Video content related to Substreams

• Indexing Improvements via Substreams by Sebastian Siemssen
• Introducing Substreams by Alexandre Bourget
• Introducing The Graph Substreams for High-Performance Indexing by Alexandre Bourget
• Advocating for Firehose and Substreams by Matthew Darwin of Pinax
• Substreams and Subgraph Quickstart by Yaro Shkvorets of Pinax
• How Substreams Unlock High-Speed, Composable Indexing
• House of Web3
  • Substreams Demystified: A Practitioner's Guide to High-Performance Blockchain Indexing (Soulbound Labs)
• Substreams Unleashed Demo Series
  • Substreams for Google Sheets with Étienne Donneger
  • Substreams powered open-source NFT Hub with Mathieu Lefebvre
  • Introducing the Substreams-Sink-Library with Charles Morin
  • Substream Sink Library: Revolutionizing Data Routing with Charles Morin
  • DappLooker: Pioneering Substreams for Cutting-Edge Blockchain Analytics
  • Spyglass Analytics Unleashing the Power of Substreams
• StreamingFast Substreams Tutorials
  • Substreams Tutorial - Understanding Substreams
  • Substreams Tutorial - Sink events from an Ethereum smart contract to an SQL database

Twitter

Twitter accounts related to Substreams technology

Protocols

• The Graph Protocol - The Graph is a web3 protocol for organizing and accessing blockchain data 🧑‍🚀 Official account of The Graph ecosystem 🌐.

Companies

• StreamingFast - web3 builders & investors. Building massively scalable architecture for streaming blockchain data.
• Pinax - Unleashing the power of blockchain data.
• Messari - Messari is the leading provider of crypto market intelligence products that help professionals navigate crypto with confidence.
• GraphOps - GraphOps is a blockchain data infrastructure company. We extract, transform and serve blockchain data via The Graph.
• Semiotic Labs - The Graph core dev team. Creators of ODOS. We specialize in AI/ML, zk-SNARKs, Cryptographic Engineering, and Blockchain Infrastructure.
• Geo Browser - A web3 browser and knowledge graph app built on The Graph protocol.
• House of Web3 - For web3 pioneers and those who contribute knowledge, education, and code to the community at large.
• Spyglass Pirate Collective - Delightfully simple web3 analytics powered by substreams.

Core Contributors

• Alexandre Bourget - Co-Founder and CTO at StreamingFast.
• Matthew Darwin - Co-Founder and CIO at Pinax.
• Brandon Ramirez - Edge & Node CEO.
• Eva Beylin - pilot The Graph foundation 👩‍🚀.
• Yaniv Tal - Founder & CEO Geo. Cofounder The Graph, Edge & Node & House of Web3. Building a vibrant decentralized future.
• Tegan Kline - Co-Founder Edge & Node, Launched The Graph | Ex Barclays & BAML.

Community Advocates

• GraphAdvocatesDAO - A DAO driving The Graph ecosystem growth via community grants & Graph Advocates Program.
• GRTiQ - 🎙 Weekly podcast that interviews the people building Web3 & The Graph.
• Graphtronauts - #GRT #web3 #GRTFAM #TheGraph Independent Community Group.
• Graphtronauts Indexer - Graphtronauts is the largest community for long term GRT holders who believe in The Graph's web3 vision for the future 👨‍🚀.
• Kyle LaRue - Graph Advocate, produces The Graph Advocates Spotlight as a newsletter.
• Paolo Diomede - Graph Advocate, Graphtronauts admin, community figure.
• Andy S - Graph Advocate, involved in multiple International communities.
• Abhay | dapplooker.eth - Dapplooker is a growing indexer and active in the community.
• Derek | DataNexus - One of the most active indexers, and a stable community resource.
• Jim Cousins - Runs WaveFive indexer, Council member, excellent community “conscience”.
• Chidubem - Graph Advocate in Africa, produces Graph Central, active in Advocates DAO.
• jimxjim.eth - Graph Advocate in Africa, very active in the DAO.
• Tony Kipkemboi - Graph Advocate, New Jersey/Kenya.
• Christina Mills - AdvocatesDAO director.
• GRTDataHub - Produces most the stats graphics used across the community, Graphtronaut.
• Paulieb.eth - Active in many community sectors, Graphtronaut.
• Nick Hansen - Ecosystem manager at the Foundation, GRTiQ.
• Kyle Rojas - Business Dev E&N.
• Pranav Maheshwari - Dev Rel & everything else.
• Graphrica - Graph community in Africa.
• Ujjwal Thakur - Graph Advocate, Education & Training Lead The Graph India

Blockchains

Blockchains that support (official & no-official) Substreams/Firehose technology.

Substreams

• Substreams Ethereum - Substreams development kit for Ethereum chains, contains Firehose Block model and helpers as well as utilities for Ethereum ABI encoding/decoding.
• Substreams Antelope - This library contains the generated protobuffer for the Antelope blocks as well as helper methods to extract and parse block data.

Firehose

• Firehose Overview
• Firehose Ethereum
• Firehose Near
• Firehose Aptos
• Firehose Arweave - use thegarii as source (The Graph Arweave Integration Implementation).
• Firehose Solana
• Firehose Cosmos
• Firehose Sui

Substreams Sinks

Substreams Sinks typically written in GoLang or Node.js

• Prometheus Sink
• MongoDB Sink
• PostgreSQL Sink
• ClickHouse Sink
• Files Sink - Binary application to consume your Substreams and output it's data out to files format (JSON, CSV, etc.).
• CSV Sink - CSV sink module.
• Winston Sink - Logger sink module.
• Discord Sink
• Telegram Sink
• Slack Sink

Substreams Tools

Tools related to Substreams

• Substreams Browser - Substreams Browser is a tool to help you explore the Substreams data.
• Substreams Registry - Substreams registry contains a list of useful Substreams.

Substreams Examples

Substreams code examples written in Rust

• Messari Substreams
  • Compound V2
  • ENS
  • ERC20
  • ERC721
  • ETH Balance
  • Uniswap V2
• Pinax Substreams
  • eosio.ibc
  • eosio.token
  • accounts
  • eosmechanics
• StreamingFast Substreams
  • ETH Block Meta
  • PancakeSwap Substreams
  • ETH Token Substreams
  • Solana SPL Tokens
  • Uniswap
  • Example substreams consumers (Go, JavaScript, Python, Rust)
• BuildersDAO Substreams
  • Chainlink Prices
  • ERC1155

Learning Rust

• Rustlings - 🦀 Small exercises to get you used to reading and writing Rust code!
• Effective Rust - 35 Specific Ways to Improve Your Rust Code
• Rust Lang Book
• Rust Tutorial #1 - Introduction To Rust Programming
• No Boilerplate - Fast technical videos

SDK

Software Development Kit related to Substreams

Rust

Rust libraries related to Substreams

• Substreams Rust - Substreams is a powerful blockchain indexing technology, developed for The Graph Network.
• Antelope Rust - Antelope Standard Library for Rust.
• Substreams Solana - Substreams development kit for Solana chains, contains Rust Firehose Block model and helpers.

Python

Python libraries related to Substreams

• substreams_firehose - Extract any data from the blockchain using gRPC-enabled endpoints (powered by Firehose and Substreams).
• substreams-python - WIP Python Interface for querying via substreams.

JavaScript

JavaScript libraries related to Substreams

• Substreams JS - Substream JavaScript consumer library using Node.js Event emitters.
• substreams-sink - JavaScript/TypeScript toolset to facilitate substreams sink development.

Golang

Golang libraries related to Substreams

• Substreams Sink (Golang)

Endpoints

Operator's endpoints & chains that support Substreams.

• StreamingFast endpoints - Ethereum, Polygon, BNB, Near, Solana, Arweave, Aptos.

Protobuf

Substreams commonly used Protobuf messages

Blocks

• Ethereum - sf.ethereum.type.v2.Block
• ​​NEAR - sf.near.type.v1.Block
• ​​Solana - sf.solana.type.v1.Block
• ​​Cosmos - sf.cosmos.type.v1.Block
• ​​Arweave - sf.arweave.type.v1.Block
• ​​Aptos - aptos.extractor.v1.Block

Sinks

• EntityChanges - sf.substreams.entity.v1
• DatabaseChanges - sf.substreams.sink.database.v1
• KVOperations - sf.substreams.sink.kv.v1
• PrometheusOperations - sf.substreams.sink.prometheus.v1
• soulbound_modules - Hotdog Powered 🌭