Welcome
This article provides introductory research about Substreams and The Graph. Please note that this article is an early work in progress and will be updated soon. Enjoy!
Table of Contents
- Welcome
- Resources
- How to get the on-chain data to notion
- Firehose and Substreams
- Pinax, StreamingFast, and The Graph
- Google Sheets + Antelope Substreams + Notion API
- dFuse
- Watch Videos about Substreams and the Graph Protocol
- Research into Pinax Network
- CSV file export from bloks and JSON Conversion
- Related Posts
Resources
How to get the on-chain data to notion
It seems like it should be very simple to get the data as its not much, though blockchains can be complex. It can be done manually easily and confirmed by weekly review and agreement (ie like each delegate or signatory agrees during weekly msig proposal or meeting in a minute). So it might not be necessary to automate this anytime soon and it’s better to focus more on getting it set up in notion than the blockchain integration
There are interesting ways to export the data from the blockchain which might be easy to do. These are good to explore and learn about in general and will be increasingly necessary to scale up the cignals app to many people in the long term.
Some options that may help include:
- Pinax / The Graph
- Wharfkit
- Could see blue papers
- Other SDKs and APIs?
Firehose and Substreams
telegram chatbot
Pinax, StreamingFast, and The Graph
Most notably, the number of data sinks (or data loaders) have increased, thanks for the efforts of multiple teams:
- Pinax Network released: Prometheus, Winston, CSV file and a Google Sheets sink!
- Messari is about to release a Parquet files sink, and together with the other files options made available now provides ingestion into BigQuery, Clickhouse, Redshift and other large scale MPP engines
- Edge & Node is about to release: graph-node integration for Substreams-based Subgraphs
- We, StreamingFast, released: Postgres, Key/value store, MongoDB, CSV & JSON Files
Many thanks to those who have contributed to the ecosystem of tools, provided feedback or beta-tested the software this year:
- Pinax Networks, along with their contribution of multiple sinks, being the first to host the Substreams runtime, and their ownership and maintenance of a full blown Firehose integration for Antelope.
Google Sheets + Antelope Substreams + Notion API
This can work now.
dFuse
https://docs.dfuse.eosnation.io/
Watch this:
https://substreams.streamingfast.io/
https://substreams.streamingfast.io/concepts-and-fundamentals/benefits
Watch this:
https://github.com/pinax-network/substreams-antelope
https://docs.rs/substreams-antelope/latest/substreams_antelope/
https://github.com/pinax-network/firehose-antelope
https://github.com/pinax-network/awesome-substreams
🔥Get ready to learn about Firehose and Substreams, two powerful tools for developers working with blockchain technology! In this workshop, Matthew Darwin of Pinax introduces these tools and explains why they are essential for processing and managing the massive amount of data that will come with the future of blockchain technology. 🚀Firehose provides a scalable and stable interface for developers and indexers to handle this data more efficiently. It's currently available for several blockchains, including Ethereum, Solana, Near, Cosmos, and more. 🎨Matthew also dives into the architecture of Firehose and introduces Substreams, a feature that allows developers to extract and transform specific data from blockchains in a more efficient and customizable manner. Substreams are composable, parameterizable, transformable, and parallelizable, and can be built on top of each other like Lego blocks. 👨💻Overall, this workshop provides a comprehensive introduction to Firehose and Substreams and highlights their potential for revolutionizing the way developers work with blockchain technology. At Pinax, we're passionate about building tools and technologies that empower developers and accelerate innovation. Download all slides of the presentation as a PDF here:
https://drive.google.com/file/d/1F5h1...
Originally this presentation was held for the Learning Series of The Graph Advocates. If you're passionate about The Graph Protocol we highly recommend to get in touch with them and sign upop to join. -
https://www.graphadvocates.com/
🐦Connect with us on Twitter at
https://twitter.com/PinaxNetwork
to stay up-to-date on our latest developments and get involved in the conversation. Don't miss out on this exciting opportunity to learn about the future of blockchain technology! 🔮
Pinax is EOS Nation
EOS Canada built firehose and substreams
non-developers can access substreams easily if it’s been built already
different colors of boxes are different authors. boxes are substreams
substreams can export data in any format
telegram chatbot
Watch Videos about Substreams and the Graph Protocol
https://www.youtube.com/@dfuse4326/featured
It seems like Pinax is using the Substreams tech created by streaming fast to export filterable data to google spreadsheets. They built a plugin and it seems like it works well.
Discover the amazing potential of Substreams for Google Sheets in this detailed tutorial and demo. Learn how to access and analyze blockchain data such as token prices, transaction volumes, and on-chain activity, all within your favorite spreadsheet editor! This powerful tool offers customization, flexibility, and speed for a seamless experience. Stay tuned for future updates and developments, and join us in revolutionizing blockchain data analysis!
0:00- Introduction
0:29- Blockchain Data Use-Cases
2:40- Advantages
2:56- Demo
6:41- Google Data Studio
9:05- Project Next Steps
10:07- Conclusion & Resources
Research into Pinax Network
Martin B is the CMO of Pinax, so it might make sense to reach out to him about this. Daniel Keyes is the CEO. Can see their twitter accounts and see its often what they post about
Yaniv is co-founder of The Graph, big deal:
CSV file export from bloks and JSON Conversion
Bloks has can export csv files
perhaps vlad or other antelope devs can build JSON reciever software similar to how james mart built it