Vamshidhar Dantu

Add a configuration property which customers can use to configure the directory where MMS book-keeping information is kept. Currently it defaults to TEMP/TMPDIR.

The latest release on github is at 1.0.8 but the latest package on PyPi is at 1.1.0. Are there not going to be any Github releases going forward?

Check if there are better JVM config values that can be used. There are guidelines published by oracle for JVM GC configurations in production setup https://docs.oracle.com/cd/E40972_01/doc.70/e40973/cnf_jvmgc.htm#autoId0

Default output function encodes results to JSON and that seems to add to response latency.

1

**Describe the bug** By default the accept type in inference container seems to be [application/json](https://github.com/aws/sagemaker-inference-toolkit/blob/master/src/sagemaker_inference/environment.py#L71-L73). The default encoder which converts [results to JSON](https://github.com/aws/sagemaker-inference-toolkit/blob/master/src/sagemaker_inference/encoder.py#L25-L44) seems to add significantly to the response...

Question on FuseSupportedOps pass

2

I was just playing around with this optimization pass with the main PyTorch project. I was curious to understand why [control flow operators are not handled here](https://github.com/pytorch/tvm/blob/master/torch_tvm/fusion_pass.cpp#L30). What was the...