Welcome
This article provides introductory research about Substreams and The Graph. Please note that this article is an early work in progress and will be updated soon. Enjoy!
Table of Contents
- Welcome
- Resources
- How to get the on-chain data to notion
- Firehose and Substreams
- Pinax, StreamingFast, and The Graph
- Google Sheets + Antelope Substreams + Notion API
- dFuse
Resources
How to get the on-chain data to notion
It seems like it should be very simple to get the data as its not much, though blockchains can be complex. It can be done manually easily and confirmed by weekly review and agreement (ie like each delegate or signatory agrees during weekly msig proposal or meeting in a minute). So it might not be necessary to automate this anytime soon and it’s better to focus more on getting it set up in notion than the blockchain integration
There are interesting ways to export the data from the blockchain which might be easy to do. These are good to explore and learn about in general and will be increasingly necessary to scale up the cignals app to many people in the long term.
Some options that may help include:
- Pinax / The Graph
- Wharfkit
- Could see blue papers
- Other SDKs and APIs?
Firehose and Substreams
telegram chatbot
Pinax, StreamingFast, and The Graph
Most notably, the number of data sinks (or data loaders) have increased, thanks for the efforts of multiple teams:
- Pinax Network released: Prometheus, Winston, CSV file and a Google Sheets sink!
- Messari is about to release a Parquet files sink, and together with the other files options made available now provides ingestion into BigQuery, Clickhouse, Redshift and other large scale MPP engines
- Edge & Node is about to release: graph-node integration for Substreams-based Subgraphs
- We, StreamingFast, released: Postgres, Key/value store, MongoDB, CSV & JSON Files
Many thanks to those who have contributed to the ecosystem of tools, provided feedback or beta-tested the software this year:
- Pinax Networks, along with their contribution of multiple sinks, being the first to host the Substreams runtime, and their ownership and maintenance of a full blown Firehose integration for Antelope.
Google Sheets + Antelope Substreams + Notion API
This can work now.