cookiecutter-data-science icon indicating copy to clipboard operation
cookiecutter-data-science copied to clipboard
verified publisher icon drivendataorg

Google Cloud Storage support

Open jtascensao opened this issue 7 years ago • 5 comments

Hi guys! I'm wondering if you guys have any plans to add Google Cloud Storage support, in a similar way to what you already do with S3 and AWS.

That would be extremely helpful!

jtascensao avatar Jun 05 '18 08:06 jtascensao

@jtascensao would be interested in this as well. We work on Google Cloud platform, where every project has a separate:

  • Cloud Storage bucket
  • Bigquery dataset

I think it is a matter of modifying cookiecutter.json, perhaps with some additional logic if AWS then AWS options and similiar for if GCP.

If anyone can point me in the right direction as to which solution is best (quite new to cookiecutter), I can make a PR for this issue.

dkapitan avatar Mar 07 '19 07:03 dkapitan

Where are we with this issue? I'd love to pick it up - I want to adopt cookiecutter for my DS team, but we use GCP in our org.

coleholcomb avatar May 05 '21 00:05 coleholcomb

@coleholcomb It's implemented in v2 (#246), which is coming later this year. The only change is in the Makefile for syncing data from the cloud with gsutil: https://github.com/drivendata/cookiecutter-data-science/blob/1fe968d24e73180a9191152d1573dd870994fcae/%7B%7B%20cookiecutter.repo_name%20%7D%7D/Makefile#L40-L64

pjbull avatar May 05 '21 04:05 pjbull

@pjbull got it, will look forward to v2 then, thanks

coleholcomb avatar May 05 '21 13:05 coleholcomb

Just curious. When will v2 be released?

xzenggit avatar Jul 06 '22 19:07 xzenggit

Any update on this?

cristianmtr avatar Dec 05 '22 10:12 cristianmtr

@cristianmtr For information on progress on v2, see the branch tracking the overall work. It also has instructions for how to switch over to using v2 as a beta tester, which would be helpful!

pjbull avatar Dec 05 '22 19:12 pjbull

Closing—implemented for V2.

jayqi avatar Aug 30 '23 21:08 jayqi