Manjeet Singh

what type of model is this?

1

is this a fp32 model or what's the precision of this model?

undefined symbol error

1

I build nginx 1.20.1 with master lua-nginx-module and have luajit 2.1 built in, the nginx image with lua builds fine however I get following error while running nginx symbol lookup...

assisted model offload

1

is there a library I could use to distribute model loading b/w gpu and cpu, I have gpu with 16gb memory and tried https://huggingface.co/blog/assisted-generation (the model upto 1.3b params works...

I see tlsv1.1 working fine with wrk2 but tlsv1.3 isn't working with wrk2.

doesn't work on CPU only environment

1

The documentation is misleading https://github.com/intel/torch-ccl#install-from-source here it says for cpu only backend python setup.py install when its built on cpu only environment it looks for cuda related libraries and fails...