Dune is the industry leader in highly shareable dashboards widely used by industry leaders, data analysts, marketers, and builders across the broader Web3 ecosystem. For example here is Brian Armstrong sharing a Dune dashboard about Base, compared to Moonbeam sharing dolpha.com, Astar sharing subscan or Polkadot sharing DotLake:

Common to the above is that Web3 ecosystem participants want to share on-chain data, which Dune is optimized for, better than a block explorer (Subscan - #311) or expensive dashboards (Dolpha.com - #341). Colorful Notion has built substrate-etl - #248, here proposed to be ingested by Dune as substrate-etl 2.0 in 2024.

Proposal - Onboard Polkadot + Kusama Data on Dune (12 months, 3/15/24-3/14/25)

Colorful Notion proposes to onboard the Polkadot + Kusama relay chains by mid-March 2024, available for the community for at least 2 years. This proposal funds the first year after a PoC is completed in early 2024, for 3/15/24 - 3/14/25. Onboarding Polkadot will be Dune’s second non-EVM ecosystem integration, after Solana. Separate from this OpenGov proposal, Colorful Notion has negotiated pricing for all parachains with Dune, beyond the Polkadot and Kusama Relay Chain. This will enable Polkadot + Kusama Substrate data to be represented in Dune for both relay chains (using "polkadot" and "kusama") and all Polkadot parachains in an official integration with hourly indexing.

Demonstration: Polkadot Staking Dashboard

In December 2023, Colorful Notion developed a proof of concept with key Dune engineers for the Polkadot Relay Chain with a few representative datasets. Here is one of the first Polkadot dashboards built in Dune:

https://dev.dune.com/mkchungs/polkadot-staking-validator

Once data is ingested from Colorful Notion’s substrate-etl into Dune, this dashboard can be rapidly constructed within a couple hours from SQL knowledgeable engineers such as Colorful Notion cofounder @mkchungs. Here is one query:

Any on-chain dataset from Polkadot or Kusama involves writing a query such as the against some substrate-etl 2.0 dataset. Colorful Notion’s commercial terms have been developed to allow for a certain amount of storage ingesting a certain number of chains so that “Dune wizards” can query these tables, views, and materialized views and produce shareable charts like the above.

Everyone with a Dune account can query and build these dashboards in Dune. While Google BigQuery can be connected to open source Apache Superset (and we have, see our W3F grant work on Deep Account Analytics and inkubator-supported ChainIDE + Polkaholic.io WASM Contract Explorer Integration), Dune is more usable and more shareable.

Whereas much of 2022 involved developing Polkaholic.io and 2023 involved substrate-etl 1.0 bringing data into Google BigQuery, Colorful Notion will have 2024 involve robust ingestion of Polkadot and Kusama data into Dune and ensuring the community can use it to support blockchain analytics and marketing.

Proposal Details

Full Proposal

Cost Breakdown

Slides

Requested Amount: 325,000 DOT [$1,968,200]

December 2023 Decision For DOT Tokenholders: Dune Now or late 2024?

Colorful Notion has been advocating a Polkadot Data Alliance Bounty along with Parity Data throughout much of 2023 (see this from CN and this from Parity Data). In November, we finally decided to submit #248 and reach out to Dune as an outstanding goal of both teams. From the DOT Tokenholder point of view, once it is accepted that an ecosystem wide Dune integration is desirable and both teams are competent (as we do), we believe the decision is largely a tradeoff between Dune NOW vs Dune LATER:

A simplified comparison is as follows:

Which boils down to the following choice:

If you believe you want a Dune Integration NOW (early 2024), vote Aye on #366.
If you believe you want a Dune Integration LATER (or don’t want it at all), vote Nay on #366.

We believe the answer is to integrate Dune NOW to support marketing and general ecosystem growth.

About Colorful Notion

Colorful Notion is led by Sourabh Niyogi and Michael Chung. We have been active in the Polkadot ecosystem over the last 2 years and look forward to building with others in Polkadot 2.0’s “map reduce” ubiquitous computing future.

Updates

12/21/2023 - AAG #93 - et-l brute?
12/22/2023 - PoC of Polkadot Relay Chain completed -- see Polkadot Proof-of-Concept Dashboard
1/3/2024 - Happy New Year 2024! Basic CN-Dune terms are being developed by Dune General Counsel; Partially redacted summary of Terms used for MSA draft may be posted here, with permission.
1/4/2024 - CN received MSA from Dune. Publicly sharable CN-Dune terms are included below for transparency:

1/5/2024 - 3 Order forms developed for MSA.
1/9/2024 - Relay Chain/Parachain tables (shared with Dune permission)
1/11/2024 - MSA finalized
3/19/2024 - Dune public announcement: https://twitter.com/DuneAnalytics/status/1770087920994603325