BasedHardware
Chat With Summary
There shd be an option to chat but with just one particular summary/convo if I have smng particular to discuss regarding just one convo so that the context of that one convo is used in an amplified manner in that chat. Example (superlist)
![featurebase-for-github[bot] avatar](https://avatars.githubusercontent.com/in/902140?v=4 "Published by a pub.dev verified publisher"){kind=small}
Proposal
- Modify the summary section of conversations such that it underlines parts for which it has available citations for. Effectively connecting the summary with the transcript
- When the user taps on a highlighted part of the summary, open a new view with the full transcript and the part cited highlighted
- In the summary section, also add a "chat with summary" button which when tapped opens a new chat with that conversation's transcript loaded in the chat's context with highest priority
- When in chat, allow the user to add specific convos in context (like tactiq AI / cursor)
Addressing the "Summary Organisation with bookmark" feature request: The easy thing here would be to add a new button to bookmark a specific convo but isn't that the purpose of memories (hold important information from convos) ? I think further discussion here would be beneficial to try and fit this new feature request within the app's current mental model / framework instead of creating something completely new
cc @aaravgarg
@aaravgarg @harrispap03 Tactiq.io has good features for this..
One you can select conversations to have the chat with but also they have a chat area on each summary to chat with it.
There's a proposed idea for this in the feedback board as well
https://feedback.omi.me/p/search-on-summary-and-chat-with-summary
Videos in the post and comments
This is an important feature for me, because it's one of the main reasons I still don't use Omi for a lot of my desktop meetings.
@nathansudo Thanks for the feedback. I edited my proposal to include the custom conversation context feature with the chip you mentioned. With this we'll be covering all the features you asked for and more
Ofc, here's a quick demo for the first 2
https://github.com/user-attachments/assets/048b499c-09b5-402d-810c-3a94000e7ba7
Here's also a preview of the code for the first 2: https://github.com/BasedHardware/omi/pull/2882
@aaravgarg
@harrispap03 I'm not hearing any audio... Plus not really clear that I'm seeing features in the video.
Agree with @aaravgarg that the chat with the summary should be on the page of the summary.
Also I would want to be able to pin some of those results from the chat on the shared view of the summary.
Also I would want to be able to pin some of those results from the chat on the shared view of the summary.
this sounds super niche use case
everything else makes sense
The video has no audio. The feature demo is the one of citations (1&2 of my proposal)
Regarding the chat with summary being on the page of the summary, can you clarify ?
My plan is to have a button that loads the convo into a chat interface and navigates to it. We'll definitely need the proper chat UI otherwise there's not enough space to go back and forth with the LLM, include more convos etc. I can have the chat navigation be in part of the purple menu at the bottom to make it easier. What do you think ? @aaravgarg @nathansudo
The video has no audio. The feature demo is the one of citations (1&2 of my proposal)
Regarding the chat with summary being on the page of the summary, can you clarify ?
My plan is to have a button that loads the convo into a chat interface and navigates to it. We'll definitely need the proper chat UI otherwise there's not enough space to go back and forth with the LLM, include more convos etc. I can have the chat navigation be in part of the purple menu at the bottom to make it easier. What do you think ? @aaravgarg @nathansudo
Yes, like a 4th button there for chat and that is a 4th page within a conversation which is just for chat where you can chat with the conversation. The responses need to refer to certain parts of the convo or summary if needed btw.
I'm piecing together the last pieces for the UI and for the "chat with this summary" feature, I think it will make sense to build on top on the new "multiple chats" feature I've seen around the codebase.
This way when you want to chat with a new summary we don't delete your other chat
I've pulled the latest changes from main (rebased) but I still don't see any changes / code that will allow for multiple chats
Can you please tell me how you'd like me to move on ? @aaravgarg
For reference: https://github.com/BasedHardware/omi/pull/2683
so the multiple chats PR was reverted, i think you can implement multiple chats functionality
Status update:
Since we added a new requirement (multiple chats functionality) the PR is taking a bit longer
It's pretty close, most of functionality is there, just need to add some last few bits and refinements
@harrispap03 can you post a video of the current implementation?
I'd be curious to see that and give feedback.
I'm curious about the multiple chats as well, haven't seen that in action but I do think it would be great to have something like that.
Similar to how Tactic works but I'm guessing this is different.
Sure here it is:
There are bits to improve which I'm working on, what do you think @nathansudo ?
https://github.com/user-attachments/assets/9997f3d3-49ed-451f-bd43-5be8e6b70070
@harrispap03 the experience should be much simpler, it should chat right there instead of going to the chat page and adding memories to context etc
example: look at how granola does it
The difference with Granola is that they only allow for time based filtering and not for handpicked context (that's why their UX is simpler) which will lead to less accurate results (especially as the time window increases) as well as increased cost for Omi. In any case, I'll make the changes prioritizing UX simplicity
Regarding the chat itself you can still go back to the summary with one tap (arrow on top left) though it's true it gives a feeling of a harder navigation instead of a drawer you're not trapped into. I'll change that too
@aaravgarg
I'll be working on it during the weekend. I've gone through the UI changes. I need to add some extra bits missing and fix bugs
ETA early next week
@aaravgarg
FYI I run into some issues this will be delayed... sorry about that
Still aim to have it done this week