Aaqib
Please have a look at [FAQ's](../../docs/FAQs.md) and [Troubleshooting guide](../../docs/Troubleshooting.md), your query may be already addressed. Your issue may already be reported! Please search on the [issue tracker](https://github.com/pytorch/serve/issues) before creating one....
## Description * Folly log integration: I tried to implement a factory pattern to keep logging decoupled to some extent but Generics and Macros were giving a lot of trouble....
**Describe the bug** Setting `load_in_8bit=True` in `DJLModel` or `HuggingFaceAccelerateModel` forces you to set `dtype=int8` as well which is not correct behaviour. **To reproduce** ```python import sagemaker from sagemaker.djl_inference.model import DJLModel,...