julep icon indicating copy to clipboard operation
julep copied to clipboard

f/rec sum experiments

Open creatorrr opened this issue 9 months ago • 6 comments

  • fix: Disable model-serving by default (#207)
  • fix: patch fix for function calling (#203)
  • remove model surgery notebooks (#208)
  • feat: Create github action changelog-ci.yml (#209)
  • feat: Updated memory-store/README.md (#214)
  • fix: Display agent instructions (#216)
  • feat: Updated examples/discord-bot/README.md (#215)
  • fix: Set metadata to an empty dict by default (#217)
  • feat: Updated sdks/ts/src/env.ts (#235)
  • feat: Updated sdks/ts/src/managers/memory.ts (#236)
  • feat: Updated sdks/ts/src/utils/invariant.ts (#237)
  • feat: Updated sdks/ts/src/managers/agent.ts (#238)
  • feat: Updated sdks/ts/src/managers/tool.ts (#239)
  • Sweep: Update the docstrings and comments in sdks/ts/src/utils/isValidUuid4.ts to fix any issues and mismatch between the comment and associated code (#240)
  • feat: Updated sdks/ts/src/client.ts (#241)
  • feat: Updated sdks/ts/src/utils/requestConstructor (#242)
  • feat: Updated sdks/ts/src/managers/base.ts (#243)
  • feat: Updated sdks/ts/src/managers/user.ts (#244)
  • feat: Updated sdks/ts/src/managers/session.ts (#245)
  • feat: Updated sdks/ts/src/utils/openaiPatch.ts (#246)
  • Sweep: Update the docstrings and comments in sdks/ts/src/managers/doc.ts to fix any issues and mismatch between the comment and associated code (#247)
  • doc(sdks/ts): Generate documentation for the typescript SDK (#248)
  • feat: Updated sdks/python/julep/env.py (#262)
  • feat(.github): Generate typescript sdk using github actions
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix(sdks/python): Python sdk had a broken poe script
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/memory.py (#271)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/utils/openai_patch (#270)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/base.py (#263)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/types.py (#269)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/utils.py (#268)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/tool.py (#267)
  • feat: Updated sdks/python/julep/managers/doc.py (#266)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/session.p (#265)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/agent.py (#264)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • refactor(agents-api): Add decorator to wrap cozo queries inside and execute (#273)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: update python sdk docs (#272)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Set default values for function description and parameters (#274)
  • fix: use correct python doc script
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Create dependabot.yml
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat(openapi): Update spec to include role=function + render_templates (#276)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • docs: update SUMMARY.md (#281)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • chore(deps): bump fastapi (#280)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • chore(deps): bump idna from 3.6 to 3.7 in /memory-store/backup (#278)
  • chore(deps): bump follow-redirects from 1.15.5 to 1.15.6 in /sdks/ts (#277)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • docs: update agents docs (#282)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Add files via upload
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Fix queries calls (#283)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Add files via upload
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Add files via upload
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Add files via upload
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Sweep: Create CONTRIBUTING.md based on README.md in the root / directory (#285)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-65: No subject
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-66: add self hosting docs
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: added docker-compose.yml and .env.example for self-hosting (#286)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-67: No subject
  • doc(sdks/python): Generate docs for sdks/python (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Set default value for user's about text (#287)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Update sessions with given IDs only (#290)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • F/readme update (#291)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Truncate messages (#294)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat(agents-api): Merge upstream
  • fix(agents-api): Fix e.token_count None
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix(agents-api): Fix agents-api Dockerfile; use python3.10 and poetry 1.8
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix(agents-api): Fix agents-api Dockerfile.worker
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • x/fix python sdk (#296)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat(agents-api): Allow single instructions str for agents (#297)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • version(sdks): 0.3.0
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Session.user_id should be optional (#298)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat(agents-api): Add jinja templates support (#300)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • version(sdks): 0.3.2
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Add summarizer source type to the query (#301)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Get summarization model form env var and create a corresponsing generation client instance (#302)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-68: docs revamp
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-69: remove extra githublink
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Make docs content be splited by users (#303)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: litellm for multiple model support (#304)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-70: deepnote example
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • research: Recursive summarization experiments

:rocket: This description was created by Ellipsis for commit 91a9e784bf64f0781305eaf24ba69c4b7acc5a3f

Summary:

This PR updates SDKs, fixes defaults, enhances documentation automation, and improves the development environment with interactive notebook support, including new functionalities for recursive summarization experiments.

Key points:

  • fix: Disable model-serving by default (#207)
  • fix: patch fix for function calling (#203)
  • remove model surgery notebooks (#208)
  • feat: Create github action changelog-ci.yml (#209)
  • feat: Updated memory-store/README.md (#214)
  • fix: Display agent instructions (#216)
  • feat: Updated examples/discord-bot/README.md (#215)
  • fix: Set metadata to an empty dict by default (#217)
  • feat: Updated sdks/ts/src/env.ts (#235)
  • feat: Updated sdks/ts/src/managers/memory.ts (#236)
  • feat: Updated sdks/ts/src/utils/invariant.ts (#237)
  • feat: Updated sdks/ts/src/managers/agent.ts (#238)
  • feat: Updated sdks/ts/src/managers/tool.ts (#239)
  • Sweep: Update the docstrings and comments in sdks/ts/src/utils/isValidUuid4.ts to fix any issues and mismatch between the comment and associated code (#240)
  • feat: Updated sdks/ts/src/client.ts (#241)
  • feat: Updated sdks/ts/src/utils/requestConstructor (#242)
  • feat: Updated sdks/ts/src/managers/base.ts (#243)
  • feat: Updated sdks/ts/src/managers/user.ts (#244)
  • feat: Updated sdks/ts/src/managers/session.ts (#245)
  • feat: Updated sdks/ts/src/utils/openaiPatch.ts (#246)
  • Sweep: Update the docstrings and comments in sdks/ts/src/managers/doc.ts to fix any issues and mismatch between the comment and associated code (#247)
  • doc(sdks/ts): Generate documentation for the typescript SDK (#248)
  • feat: Updated sdks/python/julep/env.py (#262)
  • feat(.github): Generate typescript sdk using github actions
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix(sdks/python): Python sdk had a broken poe script
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/memory.py (#271)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/utils/openai_patch (#270)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/base.py (#263)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/types.py (#269)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/utils.py (#268)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/tool.py (#267)
  • feat: Updated sdks/python/julep/managers/doc.py (#266)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/session.p (#265)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Updated sdks/python/julep/managers/agent.py (#264)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • refactor(agents-api): Add decorator to wrap cozo queries inside and execute (#273)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: update python sdk docs (#272)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Set default values for function description and parameters (#274)
  • fix: use correct python doc script
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Create dependabot.yml
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat(openapi): Update spec to include role=function + render_templates (#276)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • docs: update SUMMARY.md (#281)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • chore(deps): bump fastapi (#280)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • chore(deps): bump idna from 3.6 to 3.7 in /memory-store/backup (#278)
  • chore(deps): bump follow-redirects from 1.15.5 to 1.15.6 in /sdks/ts (#277)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • docs: update agents docs (#282)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Add files via upload
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Fix queries calls (#283)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Add files via upload
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Add files via upload
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Add files via upload
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Sweep: Create CONTRIBUTING.md based on README.md in the root / directory (#285)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-65: No subject
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-66: add self hosting docs
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: added docker-compose.yml and .env.example for self-hosting (#286)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-67: No subject
  • doc(sdks/python): Generate docs for sdks/python (CI)
  • Update README.md
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Set default value for user's about text (#287)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Update sessions with given IDs only (#290)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • F/readme update (#291)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Truncate messages (#294)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat(agents-api): Merge upstream
  • fix(agents-api): Fix e.token_count None
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix(agents-api): Fix agents-api Dockerfile; use python3.10 and poetry 1.8
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix(agents-api): Fix agents-api Dockerfile.worker
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • x/fix python sdk (#296)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat(agents-api): Allow single instructions str for agents (#297)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • version(sdks): 0.3.0
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Session.user_id should be optional (#298)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat(agents-api): Add jinja templates support (#300)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • version(sdks): 0.3.2
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Add summarizer source type to the query (#301)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • fix: Get summarization model form env var and create a corresponsing generation client instance (#302)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-68: docs revamp
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-69: remove extra githublink
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: Make docs content be splited by users (#303)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • feat: litellm for multiple model support (#304)
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • GITBOOK-70: deepnote example
  • doc(sdks/ts): Generate docs for sdks/ts (CI)
  • research: Recursive summarization experiments
  • Added new modules in /agents-api/notebooks/rec_sum/ for recursive summarization experiments.
  • Implemented entity extraction, message summarization, and message trimming functionalities.
  • Utilized OpenAI API for generating chat completions.
  • Enhanced error handling with asynchronous calls and retry mechanisms.
  • Updated pyproject.toml to include new dependencies for interactive notebook support.
  • Updated agents-api/agents_api/activities/summarization.py to integrate new summarization functionalities.
  • Expanded agents-api/agents_api/rec_sum with new modules for entity extraction, message summarization, and trimming.
  • Added new data examples in agents-api/agents_api/rec_sum/data.py to support the new functionalities.
  • Enhanced utility functions in agents-api/agents_api/rec_sum/utils.py to support new summarization features.
  • Updated agents-api/agents_api/activities/logger.py for enhanced logging.
  • Updated agents-api/agents_api/models/entry/delete_entries.py to handle entry deletions more effectively.
  • Enhanced data handling in agents-api/agents_api/rec_sum/data.py.
  • Improved entity extraction in agents-api/agents_api/rec_sum/entities.py.
  • Enhanced message generation capabilities in agents-api/agents_api/rec_sum/generate.py.
  • Updated message summarization in agents-api/agents_api/rec_sum/summarize.py.
  • Improved message trimming in agents-api/agents_api/rec_sum/trim.py.
  • Refactored agents-api/agents_api/rec_sum/generate.py to use litellm.acompletion for simplified API calls.

Generated with :heart: by ellipsis.dev

creatorrr avatar May 01 '24 15:05 creatorrr

Skipped PR review on b14b0f79b5d48272a524b50e216c5ac3e4f804f8 because no changed files had a supported extension. If you think this was in error, please contact us and we'll fix it right away.


Generated with :heart: by ellipsis.dev

ellipsis-dev[bot] avatar May 01 '24 15:05 ellipsis-dev[bot]

Skipped PR review on 5fb33addbbc14bce253fd43908e01245d8c08865 because no changed files had a supported extension. If you think this was in error, please contact us and we'll fix it right away.


Generated with :heart: by ellipsis.dev

ellipsis-dev[bot] avatar May 03 '24 04:05 ellipsis-dev[bot]

Skipped PR review on f40c35fd149965dc50e45c9f45b8813853fd2bce because no changed files had a supported extension. If you think this was in error, please contact us and we'll fix it right away.


Generated with :heart: by ellipsis.dev

ellipsis-dev[bot] avatar May 03 '24 09:05 ellipsis-dev[bot]

Skipped PR review on e77381e2b6ac742382aa745cda0056f57045d8b3 because no changed files had a supported extension. If you think this was in error, please contact us and we'll fix it right away.


Generated with :heart: by ellipsis.dev

ellipsis-dev[bot] avatar May 21 '24 12:05 ellipsis-dev[bot]

Hey @creatorrr, founder @ellipsis-dev here. You can disable code reviews from certain branch names, such as into dev or from f/* by adding a config file: https://docs.ellipsis.dev/config#ignore-certain-basehead-branches.

hbrooks avatar May 25 '24 16:05 hbrooks

Sorry, I don't know how to help with that. If you tag me (@ellipsis-dev) in a comment, I can do one of these things (but not multiple at once):

  • review and summarize this pull request
  • make changes to this pull request
  • answer questions about this PR, or about the codebase in general
  • hide my old reviews on this PR (to reduce clutter)

ellipsis-dev[bot] avatar May 25 '24 16:05 ellipsis-dev[bot]

Hey @creatorrr, founder @ ellipsis-dev here. You can disable code reviews from certain branch names, such as into dev or from f/* by adding a config file: https://docs.ellipsis.dev/config#ignore-certain-basehead-branches.

Thanks for the pro tip @hbrooks :)

creatorrr avatar May 30 '24 16:05 creatorrr

We need a flag for adaptive context, maybe an environment variable like EXPERIMENTAL_ADAPTIVE_CONTEXT_ON

creatorrr avatar May 30 '24 16:05 creatorrr

multimodal-support is now merged in to dev and the main change is that the content field of chatml messages can now be a list of [{type: "image_url", image_url: {...}}, {type: "text", text: "..."}]

and if content is an array, the text parts should be concatenated with a single space and the images need to be replaced with the string <UPLOADED IMAGE>

I think that should work without changing the prompt but the tricky thing will be to test it and also still keep the image

creatorrr avatar May 30 '24 16:05 creatorrr