colonyHackathon icon indicating copy to clipboard operation
colonyHackathon copied to clipboard

Distributed Data Science Colony

Open mduske opened this issue 6 years ago • 2 comments

Colony Hackathon Submission

Project Title Distributed Data Science Colony


Project Description A decentralized way to gather Data Science teams around publicly available data sets (www.data.gov and other initiatives), teams and reward work accordingly. It covers the basic 5 phases of data science projects: Question, Exploratory Data Analysis, Formal Modeling, Interpretation, Communication. A single colony can manage various Data Science Projects (defined as Domains). Some of the issues tacked by the solution:

  1. Establishing clear goals (Question)
  2. Avoiding data dredging (trying everything under the Sun for correlation), as sources are tasks and require approval
  3. Provide random seeds for reproducible results while avoiding peers from selecting seed that yield specific results when applying non-deterministic algorithms (i.e: K-Means Clustering)
  4. Document not only positive results but negative ones too. There is currently an enormous bias towards only publishing positive results while negative ones are equally valid and useful. All research start is public and so are the results
  5. Data is greatly available nowadays, never before at this speed and openness, only a fully distributed solution will allow geographically disperse teams (Civic Hackers mostly) to coordinate work and contribute research.

** Very Late submission, I know ** Only got a chance to start serious work on Friday 22th, but I plan on continuing work an eventually publishing the fully operation solution. It uses Electron so to allow browser free use, only relying on the Blockchain client of choice.

Project Repository https://github.com/mduske/colonyHackathon

Team Members and Contact info https://github.com/mduske https://twitter.com/MarkDuske https://www.linkedin.com/in/markduske/

mduske avatar Jun 24 '18 18:06 mduske

a4bfe4a670518532ee485b55b7793983e3224992

mduske avatar Jun 24 '18 23:06 mduske

Hey @mduske not sure if you made the cut for Colony, but I wanted to extend an invite to ours that just kicked off here https://github.com/Blockternship/take-off we would love to see you continue work on this project!

YalorMewn avatar Jul 24 '18 13:07 YalorMewn