awesome-data icon indicating copy to clipboard operation
awesome-data copied to clipboard

Bitcoin Prices

Open ghost opened this issue 6 years ago • 12 comments

Final Bitcoin prices repo with data package automated to update the data daily.

ghost avatar Apr 27 '18 11:04 ghost

https://www.coindesk.com/price/ - generates .csv, but restricted by the terms of use, quote,

You may use the Content online and solely for your personal, non-commercial use, and you may download or print a single copy of any portion of the Content for your personal, non-commercial use, provided you do not remove any trademark, copyright or other notice contained in such Content.

You may not, for example, republish the Content on any Internet, Intranet or Extranet site or incorporate the Content in any database, compilation, archive or cache or store the Content in electronic form on your computer or mobile device unless otherwise expressly permitted byCoinDesk

ghost avatar Apr 27 '18 11:04 ghost

Can't find any legal on this website. Will write script and do Github repo for it.

ghost avatar Apr 28 '18 06:04 ghost

Here's GitHub repo with the script for this source and received data.

Need advice though on how to workaround data validation error - .csv in archive directory has bad values in the last rows on the column 'Volume". One solution is to request the data from the website only for the dates with valid values, but probably this error might be ignored (since final data is valid and got no errors).

ghost avatar Apr 28 '18 07:04 ghost

@Branko-Dj can we get this dataset published?

anuveyatsu avatar Jul 12 '18 16:07 anuveyatsu

@anuveyatsu what happened here? There's no update and sprint completed.

rufuspollock avatar Sep 01 '18 13:09 rufuspollock

@rufuspollock @anuveyatsu Data on coinmarketcap.com is protected by copyright https://coinmarketcap.com/terms/. There it says:

Prohibited Activities You agree that you will not:

Copy, modify or create derivative works of the Service or any Content; Copy, manipulate or aggregate any Content (including data) for the purpose of making it available to > > any third party; Trade, sell, rent, loan, lease or license any Content or access to the Service, whether commercially or > free of charge; Use or introduce to the Service any data mining, crawling, "scraping", robot or similar automated or > > > data gathering or extraction method, or manually access, acquire, monitor or copy any portion of the > > Service, or download or store Content (unless expressly authorized by CMC). Certain data and other > > information within the Service is available by subscription, or for a fee, at https://pro.coinmarketcap.com;

So I scraped cryptocurrency data from a different website coinmetrics.io. Data can be found at https://datahub.io/cryptocurrency

Branko-Dj avatar Sep 05 '18 21:09 Branko-Dj

@Branko-Dj can we add views to the datasets? Nice time series graphs would be great here I think. Once that's done, think we can close this one

zelima avatar Sep 06 '18 03:09 zelima

@zelima Yes I think that will be nice. I will add some views for better look

Branko-Dj avatar Sep 06 '18 05:09 Branko-Dj

@Branko-Dj where this dataset lives on GitHub can't find under datasets organization https://github.com/datasets/bitcoin-prices.

Is it still under @otruja , if so @otruja could you please transfer ownership so that I can do modifications to it and re-publish

zelima avatar Oct 03 '18 11:10 zelima

@zelima what is happening here? If necessary just clone the original repo and push directly to github.com/datasets ...

rufuspollock avatar Nov 01 '18 08:11 rufuspollock

I am currently working on this

Branko-Dj avatar Nov 01 '18 09:11 Branko-Dj

@Branko-Dj what happened?

rufuspollock avatar Jan 06 '19 14:01 rufuspollock