Aaron Raddon
Aaron Raddon
Many usecases require getting notification immediately after a file is added to a store for import. Support Interfaces for event based file-change-event models. * http://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html * https://docs.microsoft.com/en-us/azure/storage/blobs/storage-blob-event-overview * https://cloud.google.com/storage/docs/object-change-notification *...
From this comment https://github.com/lytics/cloudstorage/pull/53#issuecomment-392784874
I have noticed use of os.FileInfo inside quite a few projects for reading/iterating files. Would be nice to be able to cast cloudstorage.Object as os.FileInfo for easy alignment with existing...
The current `Object` implementation assumes it is a file, and doesn't have any affordance for directory only types. https://golang.org/pkg/os/#FileMode Google Storage has a `Delimiter` for filtering to certain types https://developers.google.com/apis-explorer/#p/storage/v1/storage.objects.list?bucket=lytics-dataux-tests&delimiter=%252F&maxResults=1000&prefix=tables%252F&_h=8&...
Currently this Public Static var is used to configure ES which has a number of consequences: 1) can't do multiple hosts (in same cluster), 2) can't do multiple es "clusters"....
The current design of elastigo requests hide the `http.Response` (and its http status) returning json. This makes error handling problematic. https://github.com/mattbaird/elastigo/pull/21#issuecomment-20821385 Propose to: add a new `DoResponse` method https://github.com/mattbaird/elastigo/blob/master/api/request.go#L86
@mattbaird do you mind looking at this? It is an experimental search dsl and it would be great to get other input. https://github.com/araddon/elastigo/blob/newsearch/core/search_test.go It is based on new test data...
It would be great to have easier to get going and less dependencies, less overlap with emerging Norms in Cloud Native Distributed Compute. 1. less dependencies (than etcd) on import...
It might be helpful to be able to pass in a context to grid server so an an outside agent can cancel it? And or the context used in Server...
similar to l2met, but support a row prefix, and different formats (json)