quickstarts icon indicating copy to clipboard operation
quickstarts copied to clipboard

Demographic Insight Stack

Open ThaliaBarrera opened this issue 1 year ago • 13 comments

Demographic Analysis with Airbyte

Use Airbyte to extract demographic, economic, or housing data from the US Census API. Load it into a warehouse for insightful analysis on population trends, economic indicators, or housing developments.

You can use a tool like dbt for data transformation, and an orchestrator like Airflow or Dagster if needed.

How to get started:

ThaliaBarrera avatar Oct 20 '23 12:10 ThaliaBarrera

Hey Can I Work on this ? and one more question is this also an hactoberfest repository.

WillOfHeaven avatar Oct 23 '23 04:10 WillOfHeaven

Hi @WillOfHeaven! Sure, I have assigned it to you.

Yes, these quickstarts are also rewarded as part of the Hacktoberfest :).

ThaliaBarrera avatar Oct 23 '23 13:10 ThaliaBarrera

Hey @ThaliaBarrera I am quite new to using frameworks like dagster and dbt and I would like to take some time learning them and therefore request you to unassign me so that other can have a chance while I in that time figure out these frameworks and work on them so that I can contribute.

WillOfHeaven avatar Oct 25 '23 20:10 WillOfHeaven

Ok @WillOfHeaven, thanks for letting me know! I'll unassign you now.

ThaliaBarrera avatar Oct 27 '23 13:10 ThaliaBarrera

@ThaliaBarrera If you believe that this PR can be merged, I am confident that I can resolve this issue within two days. Additionally, I'm curious if these issues will remain available after the hackathon, as there are some interesting ones I'd like to attempt, but it may not be feasible within the deadline.

bishalbera avatar Nov 01 '23 05:11 bishalbera

@bishalbera sure, you can work on this. Since you start it before the deadline we can count it in, no worries. I'm assigning it to you.

About working on these issues after the hackathon, yes, that's definitely an option. I'll contact you via Slack if you're okay and we can discuss.

ThaliaBarrera avatar Nov 01 '23 15:11 ThaliaBarrera

@ThaliaBarrera Ya I'm absolutely ok with that. Ty also plz check the PR I've mentioned some issues there

bishalbera avatar Nov 01 '23 15:11 bishalbera

@ThaliaBarrera do we have to submit all the PR before the hackathon ends?

bishalbera avatar Nov 02 '23 09:11 bishalbera

@ThaliaBarrera I'm facing a problem. when I'm directly handling the API request, I'm getting all the data, including population, income, and other details. However, after syncing the API with BigQuery, I'm getting null values for all the fields. I've attached the necessary pictures. Also, I'm running short on time.

image

image

bishalbera avatar Nov 02 '23 12:11 bishalbera

I have no idea what's going on @bishalbera! I need to try to reproduce the issue myself, but we're running out of time with the hackathon. So perhaps we cannot count this in 😞

We can continue working on this quickstart but outside of the hackathon, I'll DM you.

ThaliaBarrera avatar Nov 02 '23 13:11 ThaliaBarrera

@ThaliaBarrera that's ok . I'm thinking if I take another issue and raise the pr after the hackathon ends will that count???

bishalbera avatar Nov 02 '23 13:11 bishalbera

Yes, sure, we can count it in! Just let me know which one you'd like to take @bishalbera. Also if you have a particular stack in mind that's not listed in the issues, I can create one for you. The thing is having interesting use cases.

ThaliaBarrera avatar Nov 02 '23 13:11 ThaliaBarrera

@ThaliaBarrera Thats awesome then I would like to work on this one. Im thinking to use shopify api for that issue but the thing is my trial period is over so the api key will not work. Is it possible to give me the credentials for that or should I just use another email for it.

bishalbera avatar Nov 02 '23 13:11 bishalbera