[Feat] Support more running mode in workforce

[Ol1ver0413]

Description

Add pipeline running mode in workforce. #1663

Checklist

Go over all the following points, and put an x in all the boxes that apply.

• [ ] I have read the CONTRIBUTION guide (required)
• [ ] I have linked this PR to an issue using the Development section on the right sidebar or by adding Fixes #issue-number in the PR description (required)
• [ ] I have checked if any dependencies need to be added or updated in pyproject.toml and uv lock
• [ ] I have updated the tests accordingly (required for a bug fix or a new feature)
• [ ] I have updated the documentation if needed:
• [ ] I have added examples if this is a new feature

If you are unsure about any of these, don't hesitate to ask. We are here to help!

[coderabbitai[bot]]

[!IMPORTANT]

Review skipped

Auto reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

• [ ] Create PR with unit tests
• [ ] Post copyable unit tests in a comment
• [ ] Commit unit tests in branch workforce_pipeline

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[Ol1ver0413]

graph TD
    A[Task: Generate 5 AI/ML Papers] --> B[Literature Researcher]
    B --> C{Fork: 5 Parallel Tasks}
    
    C --> D1[Summary Specialist 1<br/>Summarize Paper 1]
    C --> D2[Summary Specialist 2<br/>Summarize Paper 2]
    C --> D3[Summary Specialist 3<br/>Summarize Paper 3]
    C --> D4[Summary Specialist 4<br/>Summarize Paper 4]
    C --> D5[Summary Specialist 5<br/>Summarize Paper 5]
    
    D1 --> E{Join: Collect Summaries}
    D2 --> E
    D3 --> E
    D4 --> E
    D5 --> E
    
    E --> F[Research Synthesizer<br/>Analyze AI/ML Trends]
    F --> G[Final Result]
    
    style A fill:#e1f5fe
    style B fill:#fff3e0
    style D1 fill:#f3e5f5
    style D2 fill:#f3e5f5
    style D3 fill:#f3e5f5
    style D4 fill:#f3e5f5
    style D5 fill:#f3e5f5
    style F fill:#e8f5e8
    style G fill:#fff9c4

[Ol1ver0413]

graph TD
    A[Task: Generate 4 RESTful API Types] --> B[API Researcher]
    B --> C{Fork: 4 Parallel Tasks}
    
    C --> D1[API Analyst 1<br/>Analyze API 1]
    C --> D2[API Analyst 2<br/>Analyze API 2]
    C --> D3[API Analyst 3<br/>Analyze API 3]
    C --> D4[API Analyst 4<br/>Analyze API 4]
    
    D1 --> E{Join: Collect Analyses}
    D2 --> E
    D3 --> E
    D4 --> E
    
    E --> F[Documentation Writer<br/>Generate API Usage Guide]
    F --> G[Final Result]
    
    style A fill:#e1f5fe
    style B fill:#fff3e0
    style D1 fill:#f3e5f5
    style D2 fill:#f3e5f5
    style D3 fill:#f3e5f5
    style D4 fill:#f3e5f5
    style F fill:#e8f5e8
    style G fill:#fff9c4

[Ol1ver0413]

graph TD
    A[Task: Code Review Analysis] --> B[Code Scanner]
    B --> C{Fork: 3 Parallel Tasks}
    
    C --> D1[Code Reviewer 1<br/>Review File 1]
    C --> D2[Code Reviewer 2<br/>Review File 2]
    C --> D3[Code Reviewer 3<br/>Review File 3]
    
    D1 --> E{Join: Collect Reviews}
    D2 --> E
    D3 --> E
    
    E --> F[Review Summarizer<br/>Generate Comprehensive Report]
    F --> G[Final Result]
    
    style A fill:#e1f5fe
    style B fill:#fff3e0
    style D1 fill:#f3e5f5
    style D2 fill:#f3e5f5
    style D3 fill:#f3e5f5
    style F fill:#e8f5e8
    style G fill:#fff9c4

[Ol1ver0413]

Hey @Wendong-Fan @fengju0213 ! I've already add pipeline mode in workforce, and maybe we can try more cases to test this mode.

[Wendong-Fan]

Hey @Wendong-Fan @fengju0213 ! I've already add pipeline mode in workforce, and maybe we can try more cases to test this mode.

thanks @Ol1ver0413 !

[Wendong-Fan]

hi @Ol1ver0413

Hope you're doing well!

Just wanted to check in on this PR. It looks like there's some feedback that needs to be addressed, along with some failing in pre-commit checks.

Please let us know if you have any questions or need a hand with anything. We're looking forward to getting this merged!

Cheers

[Ol1ver0413]

hi @Ol1ver0413

Hope you're doing well!

Just wanted to check in on this PR. It looks like there's some feedback that needs to be addressed, along with some failing in pre-commit checks.

Please let us know if you have any questions or need a hand with anything. We're looking forward to getting this merged!

Cheers

Hi, @Wendong-Fan! I’ve been handling some work transitions lately, which may have caused me to overlook enhancing the running mode in the workforce. I’ll make sure to complete it soon. Thanks again.

[review-notebook-app[bot]]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[a7m-1st]

@Ol1ver0413 There is merge conflicts I guess as I am seeing 140+ files changes. cc: @Wendong-Fan

[Ol1ver0413]

@Ol1ver0413 There is merge conflicts I guess as I am seeing 140+ files changes. cc: @Wendong-Fan

Yeah, I see that too. It's quite weird because I only modified workforce.py and example file. Let me take a check.

[a7m-1st]

Cool. all good now, thanks for the update will review it asap !

[Ol1ver0413]

Thanks for your updates. I checked the PR again and added a few more comments.

Thanks @hesamsheikh for reviewing. Let me take a check.

[Ol1ver0413]

Thanks @Ol1ver0413 for your work. All worked well with my side, except some small points I would like your opinion on, and a small change perhaps overlooked when merging conflicts 🙌

Thanks @a7m-1st . I'll take a review asap.

[Ol1ver0413]

Thanks for the new changes @Ol1ver0413. Aside from the comments I previously mentioned, which don't seem resolved yet, and a lack of test cases, I have nothing more to add.

Thanks for the feedback! I’ll review your previous comments again and make sure to address them. I’ll also add the missing test cases soon.

[Ol1ver0413]

Thanks @a7m-1st @hesamsheikh a lot for such a long time reviewing! You guys' feedback helped me improve the PR a lot. Love U guys ❤️.

[hesamsheikh]

You're welcome @Ol1ver0413 Please fix the pre-commit issues so the checks are passed and this is ready for merge.

[hesamsheikh]

Hey @Ol1ver0413 Is this ready for the final review?

[Ol1ver0413]

Hey @Ol1ver0413 Is this ready for the final review?

Yeah， relevant

Hey @Ol1ver0413 Is this ready for the final review?

Yeah, it's ready for final review.