could i use taskweaver by api?

[colorButton]

trafficstars

[liqul]

what do you mean by 'use taskweaver by api'? running a service and call it via an api?

[srikar-kodakandla]

yes, I am also looking for an answer for it. I am looking to run it as a service and call it via an api?

[srikar-kodakandla]

Contributor yes, I am also looking for an answer for it. I am looking to run it as a service and call it via an api?

[liqul]

This is not available today. We currently consider TaskWeaver more like a personal assistant (via the CLI) or shared between a small group of users (via the web UI). There is tons of work to do to make it a scalable service and we are lacking of such resources.

[ShilinHe]

Hi, we use chainlit to pack TaskWeaver as a web application, and it supports api endpoint call. You may find more details in their doc. You need to implement the api call in the playground/UI/app.py to support this feature.

[SHX9610]

UI

#386

hi, I found you use chainlit to pack TaskWeaver as a web application, and make it supports api endpoint call. FastAPI opens a chainlit server, then mock a client for posting message to server

I wonder to know that does your server output the intermediate log to client during the conversation?

[srikar-kodakandla]

No, it is not providing an intermediate log.

On Tue, Jul 16, 2024, 17:22 NIMING @.***> wrote:

UI

hi, I found you use chainlit to pack TaskWeaver as a web application, and make it supports api endpoint call. FastAPI opens a chainlit server, then mock a client for posting message to server

I wonder to know that does your server output the intermediate log to client during the conversation?

— Reply to this email directly, view it on GitHub https://github.com/microsoft/TaskWeaver/issues/371#issuecomment-2230699813, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALCAKY4MYFEXGRX7W7D2573ZMUCQHAVCNFSM6AAAAABJ2BOIDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMZQGY4TSOBRGM . You are receiving this because you commented.Message ID: @.***>

[SHX9610]

No, it is not providing an intermediate log. … On Tue, Jul 16, 2024, 17:22 NIMING @.> wrote: UI hi, I found you use chainlit to pack TaskWeaver as a web application, and make it supports api endpoint call. FastAPI opens a chainlit server, then mock a client for posting message to server I wonder to know that does your server output the intermediate log to client during the conversation? — Reply to this email directly, view it on GitHub <#371 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALCAKY4MYFEXGRX7W7D2573ZMUCQHAVCNFSM6AAAAABJ2BOIDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMZQGY4TSOBRGM . You are receiving this because you commented.Message ID: @.>

thanks

[shivakharbanda]

Hi i built a service around task weaver using django channels. If you’re interested i could add you to that repo. You can communicate to taskweaver using websockets.

[SHX9610]

Hi i built a service around task weaver using django channels. If you’re interested i could add you to that repo. You can communicate to taskweaver using websockets.

I've done the same work as you, but I'm wondering how to stream the processing of a large model in real time.

[shivakharbanda]

i dont think it will scale as much without changing the internal code of taskweaver but i would love to help you out if you could share some architecture or implementation details of your project