seq-tickets icon indicating copy to clipboard operation
seq-tickets copied to clipboard

Add support for creating new signals without re-indexing all data

Open DanAvni opened this issue 1 year ago • 3 comments

I have 2TB+ of events and need to create a new signal. I do not care about filtering events earlier than now as I know they are not relevant and/or do not exist. When I create the new signal, all data is re-indexed, which is a huge waste of time as it takes days to complete. Please add support for adding a signal without re-indexing of old data.

DanAvni avatar Oct 23 '22 14:10 DanAvni

Hi @DanAvni ,

Thanks for the suggestion. I have a few questions to help me understand.

Q1. If signals do not index the log, what do they do? Is it a way to save a search expression?

Q2. If what you want is saved searches, have you tried pinning the search in the HISTORY window?

Thanks.

liammclennan avatar Oct 23 '22 22:10 liammclennan

Hi @liammclennan

Maybe I wasn't clear so let me explain: The new signals do index the log but they will only index new data and not existing data. The idea is to skip the indexing of the existing 2TB of data as I know the signal will not find anything there.

DanAvni avatar Oct 24 '22 05:10 DanAvni

Thanks for the clarification.

liammclennan avatar Oct 24 '22 06:10 liammclennan