grants-program icon indicating copy to clipboard operation
grants-program copied to clipboard

Bitcoin SQL connector

Open rswol opened this issue 3 years ago • 7 comments

APPLICANT

Type:                                                                        Direct Application

Email:                                                                    [email protected]

Discord:                                                    BowTiedArcticWolf#5365

Twitter:                                                        BowTiedArcticWo

Stacks Forum:           

GRANT BASICS

Grant Name:                                        Bitcoin SQL connector

Total Budget:                              40,000

Total Duration:                 420

Grant Type:                                               Open Source Dev Repeat Grantees

Grant Track:                                          Bitcoin Utility via Stacks

Grant Goal:                                               Create New Technology

Grant Audience:             Developers

Specific Audience:         Developers and data engineers who work both with Stacks and Bitcoin

Grant Team:                                       rswol, cbadawi

Previous Grants:                      https://github.com/stacksgov/Stacks-Grant-Launchpad/issues/250

Ecosystem Programs:      Managed Stacks API Nodes is a service for achieving high availability of Stacks API. It allows rolling updates of nodes, as well as restarts, and can handle degraded nodes if needed

GRANT MISSION, IMPACT, RISKS & REFERENCE

Grant Mission:         Bitcoin powers Stacks blockchain. Anyone interested in the state of Stacks blockchain can query either the Stack API node database or go to a higher level service like stacksonchain.com to get insights using SQL queries. With more applications integrating with Bitcoin directly, it is essential to see the whole picture, including Bitcoin blockchain state. Stacks mining analytics would be incomplete without Bitcoin part.

Unfortunately, there is no easy-to-access self-hosted Bitcoin SQL service that would provide this data. Additionally, the Bitcoin data must be compatible with Stacks blockchain data (as is in Stacks Node API db) to achieve high fidelity and consistency without doing extra data cleaning and preparation work.

This feature was requested multiple times for stacksonchain. We believe the Stacks community will benefit more if such a service exists as an open source self-hosted solution - in the end, almost everyone who runs stacks nodes runs Bitcoin nodes as well.

This service would be the first in the series of compatible services extracting data from all adjacent layer-2s (Liquid Network, RSK)

Grant Impact:               The number of installations by Stacks projects that work with Bitcoin

Grant Risks:                          The bitcoin blockchain is larger than Stacks, and it could be impossible to run the target database on a single node of commodity hardware. We need to spend more time of making sure the data is compact and allows fast analytical queries using PostgreSQL

Support Link:                                     The data analytics service we run for the Stacks community

GRANT ROADMAP & DELIVERABLES

MILESTONE 1:

Deliverable:                   Bitcoin offline data extractor pushing data into db compatible with Stacks-API

MILESTONE 2:

Deliverable:                   Perfomance and data storage efficiency for faster analytical queries

FINAL DELIVERABLE

Deliverable:                   A standalone service continuously extracting all Bitcoin data into PostgreSQL db

rswol avatar Aug 27 '22 02:08 rswol

👋 @rswol Thanks for your application! We will do a pre-review and let you know if we have any immediate questions. In the mean time please refer to our review schedule here for a detailed timeline and response dates. Best, Will

stacks-foundation avatar Aug 27 '22 02:08 stacks-foundation

Hi @rswol

As of now, we have funding for 40-50% of the applications received. If you would still like to be considered in this round, we recommend rescoping your proposal to a lower amount that closer reflects the industry standard for grant funding of $75/hr.

We hope you are able to consider this adjustment.

Best, Will

will-corcoran avatar Sep 24 '22 18:09 will-corcoran

@will-at-stacks I can half the budget by using off-the-shelf components (kafka and https://github.com/alecalve/python-bitcoin-blockchain-parser for instance) and dropping storage and query performance as it can be solved by using better hardware - that would be about 6-7 weeks of work

rswol avatar Sep 24 '22 21:09 rswol

@rswol excellent. thanks for the help. we will adjust your budget by half, down to $20k

will-corcoran avatar Sep 25 '22 17:09 will-corcoran

@rswol

  • If this grant is approved on 9/39/22 are you able to complete the work and have it operational by 3/31/23?

Thanks Will

will-corcoran avatar Sep 28 '22 21:09 will-corcoran

@will-at-stacks yeah, it is doable. Should be way earlier than that

rswol avatar Sep 28 '22 21:09 rswol

Hi @rswol -

Congrats! Your grant application has been approved. We just sent you an invite (to the email the application was submitted with) to an onboarding call on Monday. We will use this call to provide an overview of next steps and expectations for proceeding with the grant.

If you are not able to make the call, don't worry, it will be recorded.

Best, Will Stacks Foundation Grants Program Manager.

will-corcoran avatar Sep 29 '22 21:09 will-corcoran

I think you have an interesting project. If you haven't already gone through the Stacks Web3 Startup Lab, I would like to invite you to apply.

Here's a 5-minute read on how we can help you turn your startup idea into an investment-ready startup: www.web3startuplab.io

If you are interested, you can apply through the "Apply Now" button.

Feel free to ping me on email: [email protected]

Scarlett-Web3 avatar Nov 01 '22 18:11 Scarlett-Web3

Published the initial version at https://github.com/rswol/bitcoin-sync

rswol avatar Nov 09 '22 01:11 rswol

Updates to this grant can also be found here

will-corcoran avatar Nov 15 '22 16:11 will-corcoran

Grant completed! https://rswol.github.io/bitcoin-sync/

will-corcoran avatar Feb 03 '23 15:02 will-corcoran