Add content wide search

[hkirat]

Allow users to search deep inside the contents of the blogs

1. Should use something like algolia/elastic search
2. There should be a way to refresh it whenever the notion doc changes

[RaghavenderSingh]

@hkirat can you assign it to me

[sameet11]

on it.

[saxenaaman17]

Looking into this.

[SujithThirumalaisamy]

Proposal of the approach: Procedure:

1. Add or Use a existing cache DB
2. Create a function addSearchTokenToCacheDB ( Which creates seach tokens with the words inside the paths of the track and store it to Cache)
3. Call it everytime admin creates a track
4. Create a GET /search endpoint (Which returns a array of links which are inside the token with the key as x which is a superset of the search query)
5. Might also need a Lambda kind of function initially propogates the cache db in the CI/CD workflow. ( Not sure about this )

Expecting this feature to be added with a deep discussion and implementation plan.

[nimit9]

Will it be able to search from the notion Doc?

[SujithThirumalaisamy]

We should fetch the notion doc somehow and feed the data to the token generation and store it in the datastore or some kind of cache to be fast enough

[sameet11]

are we creating a Search functionality to search data from the whole track or to search data only from a single page of the track ?@hkirat @SujithThirumalaisamy

[SujithThirumalaisamy]

Yes exactly, But I cannot proceed until we have access to the API. Ready with a elastic search local setup in my homelab server.

[ShubhamMewara]

hey @hkirat I have used algolia.com to search Would you like to remove the previous search or want to keep it?

https://github.com/code100x/daily-code/assets/136337515/63c24a5c-994b-4d7f-ab95-699f7142dd3b

[D3vq]

hi @ShubhamMewara , did you added the deep search for the whole blog( notion doc as well)?

[ShubhamMewara]

@D3vq yes i did

[D3vq]

@ShubhamMewara can we connect on discord, my username is mister0261 if you want to connect

[ShubhamMewara]

@D3vq ok