quantile() input tensor must be either float or double dtype

[chris-aeviator]

for anybody running into this when loading a gptq.int4 model, it can be fixed by running pip install -U --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/Triton-Nightly/pypi/simple/ triton-nightly `` as per https://github.com/openai/triton/pull/1741