Vincent Claes

handler.js defined in package.json but it's not in the project

1

there is this line in the package.json `"main": "handler.js", ` but the handler file is not present in the project. is this a mistake? does this run? thanks. vincent

**Is your feature request related to a problem? Please describe.** I would like to use bentoml to make offline batch predictions where my dataset is stored on S3. Datasets can...

How to deserialize pyspark bundle in python without the dependency on a sparkcontext?

4

I have a "bundle.zip" serialized from pyspark. I want to deserialize this pipeline object in my python application without needing a spark context. according to the documentation this is possible:...

``` with StepfunctionsWorkflow( datajob_stack=mailswitch_stack, name="workflow" ) as step_functions_workflow: join_labels >> ... ``` it might also be easier to execute a workflow that has the same name as the stack

- to avoid errors when executing datajob cli - set region per project - set AWS_PROFILE per project - maybe in a `.datajob/` folder ?

- start an execution from a specific step in the workflow. - --from "job-name" - start from last error `--from-last-error` - get the current workflow and save it, construct an...

``` @stepfunctions_workflow.task class SomeMockedClass(object): def __init__(self, unique_name): self.unique_name = unique_name self.sfn_task = Task(state_id=unique_name) ``` better resemble reality

let the user add **kwargs to; - all the cdk object, the create functions - to all the step functions object. check the stepfunctions_workflow

``` (node:17808) ExperimentalWarning: The fs.promises API is experimental python: can't open file 'deployment_glue_datajob.py': [Errno 2] No such file or directory Subprocess exited with error 2 DVCL643@10NB03610:~/workspace/python/aws_best_practices$ cd glue DVCL643@10NB03610:~/workspace/python/aws_best_practices/glue$ cdk...