• Home
  • Videos
  • Garden
  • Events
  • About
  • Pomelo

Substreams and The Graph

Review this
Created
May 28, 2023 11:19 PM
Tags
Featured on home page?
Hidden?
Published
Published?
URL
AI summary
AI summary 1
Done?
Hidden
Last edited time
Jun 8, 2023 1:37 PM
Price
Resource tags
Thumbnail image
super:Link

Welcome

This article provides…

Please note that this article is an early work in progress and will be updated soon. Enjoy!

Table of Contents

  • Welcome
  • Resources
  • How to get the on-chain data to notion
  • CSV file export from bloks and JSON Conversion
  • Firehose and Substreams
  • Pinax, StreamingFast, and The Graph
  • Google Sheets + Antelope Substreams + Notion API
  • dFuse
  • Related Posts

Resources

How to get the on-chain data to notion

ask vlad and tadas again after i’ve created a demo with manually inputted data into notion

It seems like it should be very simple to get the data as its not much, though blockchains can be complex. It can be done manually easily and confirmed by weekly review and agreement (ie like each delegate or signatory agrees during weekly msig proposal or meeting in a minute). So it might not be necessary to automate this anytime soon and it’s better to focus more on getting it set up in notion than the blockchain integration

There are interesting ways to export the data from the blockchain which might be easy to do. These are good to explore and learn about in general and will be increasingly necessary to scale up the cignals app to many people in the long term.

Some options that may help include:

  • Pinax / The Graph
  • Wharfkit
    • Could see blue papers
  • Other SDKs and APIs?

CSV file export from bloks and JSON Conversion

Bloks has can export csv files

perhaps vlad or other antelope devs can build JSON reciever software similar to how james mart built it

Firehose and Substreams

add this to a new page, prob call it substreams

ask vlad, tadas, or other developers- do you know a bit of rust?

image

image

telegram chatbot

image

image

image

image

image

Pinax, StreamingFast, and The Graph

image

https://t.me/dfusece

https://t.me/dfusece/7074

https://t.me/dfusece/7074

Substreams reach General Availability

The Substreams engine developed for The Graph Network has reached General Availability!

streamingfastio.medium.com

Substreams reach General Availability

Most notably, the number of data sinks (or data loaders) have increased, thanks for the efforts of multiple teams:

  • Pinax Network released: Prometheus, Winston, CSV file and a Google Sheets sink!
  • Messari is about to release a Parquet files sink, and together with the other files options made available now provides ingestion into BigQuery, Clickhouse, Redshift and other large scale MPP engines
  • Edge & Node is about to release: graph-node integration for Substreams-based Subgraphs
  • We, StreamingFast, released: Postgres, Key/value store, MongoDB, CSV & JSON Files

Many thanks to those who have contributed to the ecosystem of tools, provided feedback or beta-tested the software this year:

  • Pinax Networks, along with their contribution of multiple sinks, being the first to host the Substreams runtime, and their ownership and maintenance of a full blown Firehose integration for Antelope.

Google Sheets + Antelope Substreams + Notion API

This can work now.

dFuse

https://dfuse.eosnation.io/

https://dfuse.eosnation.io/

image

image

image

https://dfuse.eosnation.io/

image

https://docs.dfuse.eosnation.io/

image

Watch this:

https://substreams.streamingfast.io/

https://substreams.streamingfast.io/concepts-and-fundamentals/benefits

Watch this:

Embed GitHub
Embed GitHub

Embed GitHub
Embed GitHub

Embed GitHub

https://github.com/pinax-network/substreams-antelope

https://docs.rs/substreams-antelope/latest/substreams_antelope/

Embed GitHub

https://github.com/pinax-network/firehose-antelope

https://github.com/pinax-network/awesome-substreams

image

🔥Get ready to learn about Firehose and Substreams, two powerful tools for developers working with blockchain technology! In this workshop, Matthew Darwin of Pinax introduces these tools and explains why they are essential for processing and managing the massive amount of data that will come with the future of blockchain technology. 🚀Firehose provides a scalable and stable interface for developers and indexers to handle this data more efficiently. It's currently available for several blockchains, including Ethereum, Solana, Near, Cosmos, and more. 🎨Matthew also dives into the architecture of Firehose and introduces Substreams, a feature that allows developers to extract and transform specific data from blockchains in a more efficient and customizable manner. Substreams are composable, parameterizable, transformable, and parallelizable, and can be built on top of each other like Lego blocks. 👨‍💻Overall, this workshop provides a comprehensive introduction to Firehose and Substreams and highlights their potential for revolutionizing the way developers work with blockchain technology. At Pinax, we're passionate about building tools and technologies that empower developers and accelerate innovation. Download all slides of the presentation as a PDF here:

https://drive.google.com/file/d/1F5h1...

103 Advocating for Firehose and Substreams.pdf5758.4KB

Originally this presentation was held for the Learning Series of The Graph Advocates. If you're passionate about The Graph Protocol we highly recommend to get in touch with them and sign upop to join. -

https://www.graphadvocates.com/

🐦Connect with us on Twitter at

https://twitter.com/PinaxNetwork

to stay up-to-date on our latest developments and get involved in the conversation. Don't miss out on this exciting opportunity to learn about the future of blockchain technology! 🔮

https://pinax.network/

image

Pinax is EOS Nation

image

image

EOS Canada built firehose and substreams

image

image

image

non-developers can access substreams easily if it’s been built already

image

image

image

different colors of boxes are different authors. boxes are substreams

image

substreams can export data in any format

image

image

image

image

telegram chatbot

image

image

image

image

image

https://www.youtube.com/@dfuse4326/featured

It seems like Pinax is using the Substreams tech created by streaming fast to export filterable data to google spreadsheets. They built a plugin and it seems like it works well.

Discover the amazing potential of Substreams for Google Sheets in this detailed tutorial and demo. Learn how to access and analyze blockchain data such as token prices, transaction volumes, and on-chain activity, all within your favorite spreadsheet editor! This powerful tool offers customization, flexibility, and speed for a seamless experience. Stay tuned for future updates and developments, and join us in revolutionizing blockchain data analysis!

0:00- Introduction

0:29- Blockchain Data Use-Cases

2:40- Advantages

2:56- Demo

6:41- Google Data Studio

9:05- Project Next Steps

10:07- Conclusion & Resources

https://pinax.network/

Martin B is the CMO of Pinax, so it might make sense to reach out to him about this. Daniel Keyes is the CEO. Can see their twitter accounts and see its often what they post about

Yaniv is co-founder of The Graph, big deal:

Related Posts

Untitled

Logo
YouTubeXTelegram

Home

Videos

Garden

Events

About

Pomelo