Nikolay Grishchenko

[WIP] Initialization of support for S3

2

## Types of changes - New feature (non-breaking change which adds functionality) ## Summary - New S3File subtype - helpers_aws with lazy S3 client - check that S3 file exists...

This was one of the very shameful things in DDBC

Support AWS Glue Schema Registry for DDB Client row_mappers

1

- Implement component to work with AWS Glue - Support automatic schema fetching from Glue by name - Support in `get_ddbc` - Have good documentation of Data Catalog usage

Implement optional ``pattern`` attribute for ``validate_datetime_from_something``

1

Something with this logic, to have this built-in in the ``validate_datetime_from_something``: ``` def validate_date(value: str, pattern: str = None) -> datetime.datetime: return datetime.datetime.strptime(value, pattern) if pattern else validate_datetime_from_something(value) ```

- in `sosw-examples` - serverless form with APIGW config - look for prototypes in public repos - have a placeholder for authentication - model should be based on existing `ddb_models`...

Make a good tutorial of how to create Layer with sosw.

2

Documentation article and some examples for CloudFormation to deploy Layer

`dict_to_dynamo`: support strings with float numbers

1

``` In [20]: '1672531200.0'.isnumeric() Out[20]: False ``` Handle this when you automatically detect type of field. For normal scenarios `dict_to_dynamo` uses `row_mapper`, but it doesn't work when called from `_parse_filter_expression()`...

Implement get_ddbc for custom row_mappers

1

Implement in Processor something like this and add documentation and tests: ``` def get_ddbc(self, prefix: str) -> DynamoDbClient: """ Lazy init of custom DDB clients. """ names = list([x.split('_dynamo_db_config')[0] for...

Now it supports timestamps only as int or float. Should also recognize the strings with timestamps both seconds and floats.