Description
This document provides research and tasks related ts The Graph, Substreams, and similar technologies. The Graph is a decentralized protocol for indexing and querying blockchain data, while Substreams enhance data processing efficiency. The integration of these technologies can improve Respect voting systems for Optimism Fractal by indexing data efficiently, providing real-time data feeds, and enabling modular development. Pinax and StreamingFast are mentioned as top providers on The Graph, and there are references to resources and videos for further exploration. This document is an early draft with a lot of helpful information here that should be organized better in the future.
Table of Contents
- Description
- What is The Graph and Substreams? And how can they improve Respect?
- The Graph and Substreams Overview:
- Utility of The Graph and Substreams in Enhancing Respectful Voting Systems:
- To Do
- What is Pinax and StreamingFast?
- Farcaster Frames and The Graph
- Review Pilot Use Cases with Voting with Respect in Google Spreadsheet
- How to get the on-chain data to notion
- Firehose and Substreams
- Pinax, StreamingFast, and The Graph
- Google Sheets + Antelope Substreams + Notion API
- dFuse
- Watch Videos about Substreams and the Graph Protocol
- Research into Pinax Network
- CSV file export from bloks and JSON Conversion
What is The Graph and Substreams? And how can they improve Respect?
The Graph and Substreams Overview:
The Graph is a decentralized protocol for indexing and querying data from blockchains, allowing developers to efficiently and effectively access blockchain data needed for their applications. It uses subgraphs, which are open APIs that developers can query with GraphQL.
Substreams, a part of The Graph's ecosystem, enhance this functionality by providing a way to process blockchain data in parallel, increasing the efficiency and speed of data processing. Substreams are built with Rust and can be deployed as WASM modules, making them highly efficient for data transformation tasks before loading the data into The Graph or other endpoints (The Graph) (The Graph) (The Graph) (Graph Hub).
Utility of The Graph and Substreams in Enhancing Respectful Voting Systems:
The Graph and Substreams can significantly enhance a voting system and the utility of a voting token by Indexing Respect Data Efficiently, providing Real-Time Data Feeds (that enables new kinds of expressive voting during community events), and offering Modular Development approach for composable functionalities. More details about these benefits are below:
- Indexing Voting Data Efficiently: By leveraging Substreams, the data processing for voting can be handled more rapidly and in real-time, which is crucial during active voting periods where the latest data needs to be reflected instantly.
- Real-Time Data Feeds: Substreams can provide real-time updates to subgraphs, ensuring that all interactions in the voting system are updated and accessible to users and applications without delays.
- Modular Development: Developers can use existing substreams modules to build specific functionalities—like calculating vote totals, tracking token allocations, or generating analytical insights from voting data—without starting from scratch. This modular approach saves time and resources while allowing for a high degree of customization and optimization (The Graph) (The Graph).
By integrating these technologies, a voting system with Respect can become more dynamic, transparent, and scalable, supporting a wide array of decentralized decision-making processes effectively. These improvements can lead to a more engaging and functional voting mechanism within any decentralized community or platform.
To Do
What is Pinax and StreamingFast?
We have close relationship with Pinax.network and StreamingFast.io, which are two top providers on the Graph.
Farcaster Frames and The Graph
Review Pilot Use Cases with Voting with Respect in Google Spreadsheet
How to get the on-chain data to notion
It seems like it should be very simple to get the data as its not much, though blockchains can be complex. It can be done manually easily and confirmed by weekly review and agreement (ie like each delegate or signatory agrees during weekly msig proposal or meeting in a minute). So it might not be necessary to automate this anytime soon and it’s better to focus more on getting it set up in notion than the blockchain integration
There are interesting ways to export the data from the blockchain which might be easy to do. These are good to explore and learn about in general and will be increasingly necessary to scale up the cignals app to many people in the long term.
Some options that may help include:
- Pinax / The Graph
- Wharfkit
- Could see blue papers
- Other SDKs and APIs?
Firehose and Substreams
telegram chatbot
Pinax, StreamingFast, and The Graph
Most notably, the number of data sinks (or data loaders) have increased, thanks for the efforts of multiple teams:
- Pinax Network released: Prometheus, Winston, CSV file and a Google Sheets sink!
- Messari is about to release a Parquet files sink, and together with the other files options made available now provides ingestion into BigQuery, Clickhouse, Redshift and other large scale MPP engines
- Edge & Node is about to release: graph-node integration for Substreams-based Subgraphs
- We, StreamingFast, released: Postgres, Key/value store, MongoDB, CSV & JSON Files
Many thanks to those who have contributed to the ecosystem of tools, provided feedback or beta-tested the software this year:
- Pinax Networks, along with their contribution of multiple sinks, being the first to host the Substreams runtime, and their ownership and maintenance of a full blown Firehose integration for Antelope.
Google Sheets + Antelope Substreams + Notion API
This can work now.
dFuse
https://docs.dfuse.eosnation.io/
Watch this:
https://substreams.streamingfast.io/
https://substreams.streamingfast.io/concepts-and-fundamentals/benefits
Watch this:
https://github.com/pinax-network/substreams-antelope
https://docs.rs/substreams-antelope/latest/substreams_antelope/
https://github.com/pinax-network/firehose-antelope
https://github.com/pinax-network/awesome-substreams
🔥Get ready to learn about Firehose and Substreams, two powerful tools for developers working with blockchain technology! In this workshop, Matthew Darwin of Pinax introduces these tools and explains why they are essential for processing and managing the massive amount of data that will come with the future of blockchain technology. 🚀Firehose provides a scalable and stable interface for developers and indexers to handle this data more efficiently. It's currently available for several blockchains, including Ethereum, Solana, Near, Cosmos, and more. 🎨Matthew also dives into the architecture of Firehose and introduces Substreams, a feature that allows developers to extract and transform specific data from blockchains in a more efficient and customizable manner. Substreams are composable, parameterizable, transformable, and parallelizable, and can be built on top of each other like Lego blocks. 👨💻Overall, this workshop provides a comprehensive introduction to Firehose and Substreams and highlights their potential for revolutionizing the way developers work with blockchain technology. At Pinax, we're passionate about building tools and technologies that empower developers and accelerate innovation. Download all slides of the presentation as a PDF here:
https://drive.google.com/file/d/1F5h1...
Originally this presentation was held for the Learning Series of The Graph Advocates. If you're passionate about The Graph Protocol we highly recommend to get in touch with them and sign upop to join. -
https://www.graphadvocates.com/
🐦Connect with us on Twitter at
https://twitter.com/PinaxNetwork
to stay up-to-date on our latest developments and get involved in the conversation. Don't miss out on this exciting opportunity to learn about the future of blockchain technology! 🔮
Pinax is EOS Nation
EOS Canada built firehose and substreams
non-developers can access substreams easily if it’s been built already
different colors of boxes are different authors. boxes are substreams
substreams can export data in any format
telegram chatbot
Watch Videos about Substreams and the Graph Protocol
https://www.youtube.com/@dfuse4326/featured
It seems like Pinax is using the Substreams tech created by streaming fast to export filterable data to google spreadsheets. They built a plugin and it seems like it works well.
Discover the amazing potential of Substreams for Google Sheets in this detailed tutorial and demo. Learn how to access and analyze blockchain data such as token prices, transaction volumes, and on-chain activity, all within your favorite spreadsheet editor! This powerful tool offers customization, flexibility, and speed for a seamless experience. Stay tuned for future updates and developments, and join us in revolutionizing blockchain data analysis!
0:00- Introduction
0:29- Blockchain Data Use-Cases
2:40- Advantages
2:56- Demo
6:41- Google Data Studio
9:05- Project Next Steps
10:07- Conclusion & Resources
Research into Pinax Network
Martin B is the CMO of Pinax, so it might make sense to reach out to him about this. Daniel Keyes is the CEO. Can see their twitter accounts and see its often what they post about
Yaniv is co-founder of The Graph, big deal:
CSV file export from bloks and JSON Conversion
Bloks has can export csv files
perhaps vlad or other antelope devs can build JSON reciever software similar to how james mart built it