Darren Grant comments

Repositories
Issues
Comments

Results 3 comments of


                                            Darren Grant

Does Cog support batched inference?

Hi, can we get a comment on this? I am also confused by contradictory information found in the repo: From the README: > 🥞 Automatic queue worker. Long-running deep learning...

Does Cog support batched inference?

Hi, any comment here @zeke @technillogue @daanelson ?

Does Cog support batched inference?

Just an FYI to the team: the lack of support as demonstrated in this ticket (including a parallel open support ticket) has made us reconsider using Cog in our operation.