feat(llm): Add CometAPI as an LLM provider
Integrates CometAPI as a new LLM provider, giving users access to over 500+ models through its OpenAI-compatible endpoints.
This commit updates the README with the necessary environment variables and documentation for the new provider.
Closes #3690
Closes #3690
🚀 This PR integrates CometAPI as a new LLM provider for Skyvern, expanding the available model options to over 500+ models through OpenAI-compatible endpoints. The changes primarily focus on updating documentation and configuration options to support the new provider integration.
🔍 Detailed Analysis
Key Changes
- Documentation Update: Added CometAPI to the supported LLM providers table in README.md
- Configuration Variables: Introduced new environment variables for CometAPI integration (ENABLE_COMETAPI, COMETAPI_API_KEY, COMETAPI_MODEL, COMETAPI_API_BASE)
- Code Block Formatting: Removed markdown code block formatting throughout the README (appears to be an unintended change)
Technical Implementation
flowchart TD
A[User Configuration] --> B[Environment Variables]
B --> C[ENABLE_COMETAPI=true]
B --> D[COMETAPI_API_KEY]
B --> E[COMETAPI_MODEL]
B --> F[COMETAPI_API_BASE]
C --> G[CometAPI Provider Registration]
D --> G
E --> G
F --> G
G --> H[Access to 500+ Models]
H --> I[OpenAI-Compatible Endpoints]
Impact
- Model Diversity: Users gain access to over 500+ models through a single provider integration
- OpenAI Compatibility: Leverages existing OpenAI-compatible infrastructure for seamless integration
- Configuration Flexibility: Provides optional API base URL configuration for different endpoint variations
- Documentation Issue: The removal of code block formatting may impact README readability and should be addressed
Created with Palmier
[!IMPORTANT] Adds CometAPI as a new LLM provider and updates the README with setup instructions and environment variables.
- Integration:
- Adds CometAPI as a new LLM provider, offering access to 500+ models via OpenAI-compatible endpoints.
- Documentation:
- Updates
README.mdwith environment variables for CometAPI:ENABLE_COMETAPI,COMETAPI_API_KEY,COMETAPI_MODEL,COMETAPI_API_BASE.- Adds CometAPI to the list of supported LLMs in
README.md.- Misc:
- Closes issue #3690.
This description was created by
for 5203e381bd48c80440397a7f2fd0d1fccc412784. You can customize this summary. It will automatically update as commits are pushed.
Summary by CodeRabbit
- Documentation
- Added CometAPI to OpenAI-compatible documentation with naming, keys, and base URL guidance.
- Included commented docker-compose guidance for CometAPI configuration (enable flag, key, base, model, vision).
- Improved README formatting and examples, revised initialization parameters, and added a high-level Code Sage reference.
[!NOTE]
Other AI code review bot(s) detected
CodeRabbit has detected other AI code review bot(s) in this pull request and will avoid duplicating their findings in the review comments. This may lead to a less comprehensive review.
Walkthrough
Documentation updates add CometAPI references and examples to the OpenAI-compatible flow in README.md and introduce a commented CometAPI configuration block in docker-compose.yml; all edits are formatting and content-only with no runtime or control-flow changes. (50 words)
Changes
| Cohort / File(s) | Summary |
|---|---|
Documentation - README README.md |
Inserted CometAPI into OpenAI-compatible documentation and Supported LLMs table; added environment variable descriptions and examples (CometAPI naming, API key, base URL, model naming); updated Python examples and code block formatting; added Code Sage link. |
Compose Configuration docker-compose.yml |
Added a commented CometAPI configuration block under LLM/OpenAI-compatible section describing enable flag, API key, base URL, model name, and vision support. No functional changes. |
Sequence Diagram(s)
(omitted — changes are documentation-only and do not modify control flow)
Estimated code review effort
🎯 2 (Simple) | ⏱️ ~10 minutes
- Check
README.mdfor accuracy of CometAPI env var names and example snippets. - Verify
docker-compose.ymlcommented block is informational and does not alter service definitions. - Confirm formatting and links (Code Sage, CometAPI docs) are correct.
Poem
🐰 I nibbled notes and hopped through lines so neat,
CometAPI now joins our fleet,
Keys and bases written clear,
Examples snug and docs sincere,
A little hop — integration complete! ✨
Pre-merge checks and finishing touches
❌ Failed checks (2 warnings)
| Check name | Status | Explanation | Resolution |
|---|---|---|---|
| Linked Issues check | ⚠️ Warning | The PR documentation changes address the core requirement from issue #3690 to introduce CometAPI support; however, critical backend implementation (config registration, handler logic) required by the issue's intent is missing. | Implement backend support: add ENABLE_COMETAPI and COMETAPI_* config entries, register CometAPI in config_registry.py, and add handler logic in api_handler_factory.py following the OpenRouter pattern. |
| Out of Scope Changes check | ⚠️ Warning | Changes are scoped to documentation (README.md and docker-compose.yml); however, the scope mismatch is that issue #3690 requires functional backend implementation, not only documentation. | Either complete backend implementation to match issue requirements or clarify with maintainers that only documentation is in scope for this PR and backend will be addressed separately. |
✅ Passed checks (2 passed)
| Check name | Status | Explanation |
|---|---|---|
| Description Check | ✅ Passed | Check skipped - CodeRabbit’s high-level summary is enabled. |
| Title check | ✅ Passed | The PR title accurately reflects the primary objective stated in the linked issue: adding CometAPI as an LLM provider option to Skyvern. |
✨ Finishing touches
🧪 Generate unit tests (beta)
- [ ] Create PR with unit tests
- [ ] Post copyable unit tests in a comment
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.
Comment @coderabbitai help to get the list of available commands and usage tips.
@fixodev please Skip to content Navigation Menu https://github.com/Skyvern-AI skyvern
Type / to search Code Issues 127 Pull requests 60 Discussions Actions Security Insights Open feat(llm): Add CometAPI as an LLM provider #3911 SoulSniper1212 wants to merge 1 commit into Skyvern-AI:main from SoulSniper1212:fix-issue-3690-request-add-cometapi-as-an-llm-provider-option +32 −21 Conversation 5 Commits 1 Checks 0 Files changed 1 Conversation @SoulSniper1212 SoulSniper1212 commented 47 minutes ago • Integrates CometAPI as a new LLM provider, giving users access to over 500+ models through its OpenAI-compatible endpoints.
This commit updates the README with the necessary environment variables and documentation for the new provider.
Closes https://github.com/Skyvern-AI/skyvern/issues/3690
Closes https://github.com/Skyvern-AI/skyvern/issues/3690
🚀 This PR integrates CometAPI as a new LLM provider for Skyvern, expanding the available model options to over 500+ models through OpenAI-compatible endpoints. The changes primarily focus on updating documentation and configuration options to support the new provider integration.
🔍 Detailed Analysis Created with Palmier
Important
Adds CometAPI as a new LLM provider and updates the README with setup instructions and environment variables.
Integration: Adds CometAPI as a new LLM provider, offering access to 500+ models via OpenAI-compatible endpoints. Documentation: Updates README.md with environment variables for CometAPI: ENABLE_COMETAPI, COMETAPI_API_KEY, COMETAPI_MODEL, COMETAPI_API_BASE. Adds CometAPI to the list of supported LLMs in README.md. Misc: Closes issue https://github.com/Skyvern-AI/skyvern/issues/3690. This description was created by Ellipsis for https://github.com/Skyvern-AI/skyvern/commit/5203e381bd48c80440397a7f2fd0d1fccc412784. You can customize this summary. It will automatically update as commits are pushed. Summary by CodeRabbit
Documentation Added CometAPI as a supported LLM provider with configuration details Included environment variables and setup instructions for CometAPI integration Enhanced code examples and formatting throughout documentation @SoulSniper1212 feat(llm): Add CometAPI as an LLM provider
5203e38 @coderabbitai Contributor coderabbitai bot commented 47 minutes ago • Walkthrough
The README.md was updated to introduce CometAPI as a supported LLM provider, adding configuration environment variables, usage examples, and Python code samples demonstrating CometAPI integration alongside existing LLM providers. Changes are documentation-focused with no code logic modifications.
Changes
Cohort / File(s) Summary Documentation Update README.md Added CometAPI as a supported LLM provider in the Supported LLMs table; introduced CometAPI environment variable configuration block with ENABLE_COMETAPI, COMETAPI_API_KEY, COMETAPI_MODEL, and COMETAPI_API_BASE; expanded LLM configuration section with CometAPI-specific details and recommended LLM_KEY entry; updated Python code samples and usage examples; minor formatting adjustments throughout. Estimated code review effort
🎯 2 (Simple) | ⏱️ ~10 minutes
Verify CometAPI configuration variable names and descriptions match provider documentation Confirm Python code samples are syntactically correct and align with Skyvern's initialization patterns Review placement and consistency of new configuration entries relative to existing providers Poem
🐰 A hop, skip, and jump through docs so bright, Five hundred models now in sight! CometAPI joins the LLM crew, Configuration options fresh and new. Skyvern's toolkit grows each day— More choices lead the bot astray! 🤖✨ Pre-merge checks and finishing touches
✅ Passed checks (4 passed) Check name Status Explanation Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled. Title check ✅ Passed The PR title accurately describes the main change: adding CometAPI as an LLM provider. It is concise, clear, and directly reflects the documentation updates in the README. Linked Issues check ✅ Passed The PR fully addresses the objectives from issue https://github.com/Skyvern-AI/skyvern/issues/3690 by documenting CometAPI integration with environment variables, configuration examples, and adding it to the supported LLM providers table. Out of Scope Changes check ✅ Passed All changes in the PR are directly related to adding CometAPI as an LLM provider per issue https://github.com/Skyvern-AI/skyvern/issues/3690. The README updates consistently document the new provider without introducing unrelated modifications. ✨ Finishing touches Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.
❤️ Share Comment @coderabbitai help to get the list of available commands and usage tips. ellipsis-dev[bot] ellipsis-dev bot reviewed 45 minutes ago Contributor ellipsis-dev bot left a comment Caution
Changes requested ❌
Reviewed everything up to https://github.com/Skyvern-AI/skyvern/commit/5203e381bd48c80440397a7f2fd0d1fccc412784 in 2 minutes and 22 seconds. Click for details. You can customize Ellipsis by changing your verbosity settings, reacting with 👍 or 👎, replying to comments, or adding code review rules. README.md
Star History
[
Contributor
@ellipsis-dev
ellipsis-dev bot
45 minutes ago
There's a dangling [ on this line with no closing text or link. This appears to be an unfinished markdown element. Please verify if this was intended or if there is a typographical error.
@SoulSniper1212 Reply...
coderabbitai[bot]
coderabbitai bot reviewed 45 minutes ago
Contributor
coderabbitai bot
left a comment
Actionable comments posted: 1
📜 Review details README.md | Gemini | Gemini 2.5 Pro and flash, Gemini 2.0 | | Ollama | Run any locally hosted model via Ollama | | OpenRouter | Access models through OpenRouter | | CometAPI | 500+ models via CometAPI | Contributor @coderabbitai coderabbitai bot 45 minutes ago ⚠️ Potential issue | 🔴 Critical
🧩 Analysis chain CometAPI documentation added to README without corresponding backend implementation.
Verification reveals a critical issue: The documentation (lines 427, 497-506 in README.md) describes CometAPI as a fully supported LLM provider with environment variables and configuration options, but the backend implementation is completely absent from the codebase.
Evidence:
OpenRouter (documented similarly) has complete implementation in config_registry.py (lines 44-55, 1331-1348), api_handler_factory.py (lines 508-510, 869-871), and config.py (line 157: ENABLE_OPENROUTER) CometAPI has zero implementation: no entries in config registry, no handler factory logic, no ENABLE_COMETAPI in config.py CometAPI references exist only in README.md The original review comment's verification requests were justified—they correctly identified that documented environment variables (ENABLE_COMETAPI, COMETAPI_API_KEY, COMETAPI_MODEL, COMETAPI_API_BASE) and LLM provider registration do not exist in the backend code.
Either remove the CometAPI documentation from README pending actual implementation, or implement the full backend support following the OpenRouter integration pattern. @SoulSniper1212 Reply... Merge info
Review required At least 1 approving review is required by reviewers with write access. 1 workflow awaiting approval This workflow requires approval from a maintainer. Learn more about approving workflows. pending checks Frontend Lint and Build Frontend Lint and BuildExpected — Waiting for status to be reported Required Run tests and pre-commit hooks Run tests and pre-commit hooksExpected — Waiting for status to be reported Required successful checks CodeRabbit CodeRabbit — Review completed Merging is blocked At least 1 approving review is required by reviewers with write access. Still in progress? @SoulSniper1212
Add a comment
Comment
Remember, contributions to this repository should follow its contributing guidelines, security policy, and code of conduct. ProTip! Add comments to specific lines under Files changed. Reviewers
@ellipsis-dev ellipsis-dev[bot]
@coderabbitai coderabbitai[bot]
At least 1 approving review is required to merge this pull request.
Still in progress? Assignees
No one assigned Labels
None yet Projects
None yet Milestone
No milestone Development
Successfully merging this pull request may close these issues.
https://github.com/Skyvern-AI/skyvern/issues/3690
Notifications Customize You’re receiving notifications because you authored the thread. 1 participant
@SoulSniper1212 Allow edits by maintainers Footer © 2025 GitHub, Inc. Footer navigation Terms Privacy Security Status Community Docs Contact Manage cookies Do not share my personal information feat(llm): Add CometAPI as an LLM provider by SoulSniper1212 · Pull Request #3911 · Skyvern-AI/skyvernn
[!TIP] For best results, initiate chat on the files or code changes.
@SoulSniper1212, it looks like your comment may have been an accidental paste of the GitHub PR page content. You also mentioned @fixodev rather than @coderabbitai.
Could you please clarify what you'd like help with?
In the meantime, I'd like to draw your attention to the critical issue identified in the review: The PR currently only adds CometAPI documentation to the README, but the backend implementation is completely missing. To make CometAPI functional, you'll need to add:
- Configuration entries in
config.py(e.g.,ENABLE_COMETAPI,COMETAPI_API_KEY, etc.) - Provider registration in
config_registry.py - Handler logic in
api_handler_factory.py
You can reference the existing OpenRouter implementation as a pattern to follow. Would you like me to help you plan these code changes?
@coderabbitai can you fix it
[!TIP] For best results, initiate chat on the files or code changes.
[!CAUTION] The CodeRabbit agent failed during execution: Clone operation failed