inference
inference copied to clipboard
FEAT: Dynamic batching for the state-of-the-art FLUX.1 `text_to_image` interface
Parameters between requests must have same image size and max_sequence_length and ~~sampler name~~.
- ~~TODO: error handling~~
- ~~TODO: more log (processbar?)~~
- TODO: doc
- TODO: abort request