BUG: Runtime error: task attach to another loop when the pool stops

[ChengjieLi28]

Note that the issue tracker is NOT the place for general support. For discussions about development, questions about usage, or any general questions, contact us on https://discuss.xorbits.io/. Xinference UT test_opt 4-bit can reproduce this error.