Lu Fang

https://github.com/pytorch/pytorch/issues/2892

Make IntNBitTableBatchedEmbeddingBagsCodegen compatible with torch.jit.script

1

Summary: Without weight lists, the script is broken. The issue was probably introduced in D30824731 (https://github.com/pytorch/FBGEMM/commit/10c3f6a4f9238ffad9e30479f959f5f5a452d388). Differential Revision: D31436538

Otherwise GPU build and test is not covered.

[Do NOT Merge] Test aten export and execution

3

This is for testing, please don't merge. To run it, please build your Caffe2 with -DUSE_ATEN=ON

[v1] Support allowed_token_ids in v1 Sampler

3

Follow the implementation in vllm/entrypoints/openai/logits_processors.py. The idea is straightforward, adding a [batch_size x vocab_size] mask tensor, and leverage a list of bools to determine whether to do the inplace masked...

Use 88 as the line length to be compatible with Black

2

Black by default uses 88 characters as line length, and reasoning is here: https://black.readthedocs.io/en/stable/the_black_code_style/current_style.html#line-length To be compatible with Black, using 88 seems a wise choice.