Aaron Raddon
Aaron Raddon
Be able to query k8 as if it was a mysql server. Allow easier consumption of info in K8 such as get list of pods, services, ip's by making it...
Instead of keeping all source information (ie, which data sources, their connection info, tables) in either 1) config files or 2) memory only create storage for them. Ideally long term...
Backend source for google big-table. **Phase I** - [x] plain vanilla selects **Phase II** - [ ] schema discovery to inspect columns and give them data types for describe. -...
- [ ] read partition info from schema and re-use in dataux - [ ] support detecting json inside columns, and exploding those - [ ] pluggable row parsers bc...
Understand the contents of underlying data sources via inspection to feed into planners, and schema. Deep understanding of data types, volatility, cardinality, muteability are the decisive factors in guiding good...
Create a dataux _Backend_ for Google Datastore - _Datasource implementation_ - [x] `Tables()` get list of available table names - [x] scan some set of rows to do type inspection....
It would be nice to read file if it already exists in local-file cache, checking md5 to make sure it is the same md5. Use md5 as filename? Would require...
Tests were not failing for #66 that aws-s3 did not appropriately handle paging. Before merging in https://github.com/lytics/cloudstorage/pull/67 ensure we have unit tests to catch.
There are `Copy/Move` that are not currently implemented on S3. These are performance optimizations that when copy/move from s3 -> to s3 don't do network transfer, instead allow s3 to...
Integrate with Box.com