text-generator.io
text-generator.io copied to clipboard
Add streaming speech API
Summary
- introduce
/api/v1/generate_speech_streamendpoint returning streamed chunks - support
chunk_wordsparameter with environment variable default - add async chunk generator and Python example
- document API via new blog post and README note
Testing
pytest tests/integ/test_inference_server_speech.py::test_generate_speech_stream_route -q(fails: ModuleNotFoundError: No module named 'httpx')
https://chatgpt.com/codex/tasks/task_e_68436a0ead1c8333915bf9fa7aec0bfd