mds-provider

mds-provider copied to clipboard

put on pypy

1

once we ship #20 #21 we should put this library on pypy to make it pip installable

hunterowens

Client resiliance to provider server errors

3

# What happens now? Some providers have implementation issues with their MDS endpoints. It's common for standard requests to result in un-explained 500 errors that will disappear when retrying or...

zaksoup

don't infer schema on tmp tables

8

if using `stage_first`, tmp table schema is inferred from the dataframe. Rather, the tmp table schema should be copied from the table in which you are going to upsert from.

hunterowens

Initial docs

7

MDS Provider deserves some docs. This PR creates a `docs` directory, where you can place `.md` or `.rst` files to generate documentation. You can then serve it on the web...

hunterowens

Implement proper logging

2

It would be nice to be able to quiet some of the output if desired.

thekaveman

Usage examples

1

Using the [docs/](https://github.com/CityofSantaMonica/mds-provider/tree/init-docs). Short, simple examples of how to use the various components of this library. **To Do:** - [x] Fake data generation - [ ] Reading data from files...

thekaveman

Write some.

thekaveman

The [`ProviderClient` logic](https://github.com/CityofSantaMonica/mds-provider/blob/master/mds/api/client.py#L48) revolves around looping over a list of providers, and sending a bunch of serial requests for each (e.g. to get multiple pages of data for a given...

thekaveman