Kartik Khare

Complete stackTrace ```software.amazon.awssdk.core.exception.SdkClientException: Unable to unmarshall response (Unable to parse date : 1.611248009879E9). Response Code: 200, Response Text: OK at software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:98) ~[sdk-core-2.15.67.jar:?] at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handleSuccessResponse(CombinedResponseHandler.java:108) ~[sdk-core-2.15.67.jar:?] at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handleResponse(CombinedResponseHandler.java:72) ~[sdk-core-2.15.67.jar:?] at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handle(CombinedResponseHandler.java:59)...

Yeah, I have been a victim of this as well. It is because of apache CommonsConfiguration class we are using.

Weird that AWS Java SDK 2 doesn't have encryption based S3 client. The issue seems to be open from last 5 years - https://github.com/aws/aws-sdk-java-v2/issues/34

Added some unit tests as well.

@navina @mcvsubbu Is this blocked on something? Some pinot users are asking for this metric .

Taking this up!

Is there a reason we can't enable this by default and need a config?

It is failing in some cases like local environment but multi threaded. Working on fixing those post which we can merge.

> I can see that for json and text column, we might not want to create dictionary, but for other dimensions, in most cases we still want to create dictionaries,...

Still Flaky. https://github.com/apache/pinot/runs/6754124273?check_suite_focus=true