yujonglee

currently we only use content

Currently we normalize url. URL of search result item do not contain fragment.

currently, flash is only in app, so we sometimes miss error flash. For ex, authcontroller

Configurable URL filtering for website source

1

- `web_base_url ` -> `web_start_url ` - `base_url` is one way of filtering (`start_with: ` https://github.com/fastrepl/canary/blob/62346f2a89b915f4e62c1b8decfcee2e51c7e5d7/core/lib/canary/sources/source.ex#L6-L15 For example, https://svelte-5-preview.vercel.app/docs/introduction is `start_url`, but should not be `base_url`. https://svelte-5-preview.vercel.app/doc is invalid url...

Migrate to spider-rs

1

https://github.com/spider-rs/spider This looks very mature project. Our current implementation: https://github.com/fastrepl/canary/blob/62346f2a89b915f4e62c1b8decfcee2e51c7e5d7/core/lib/canary/crawler.ex#L1-L3

Note that for embedding model, embedding size should be consistent for the whole app. embedding model itself should be consistent for the account,

Support Billing meter

1

### Problem Statement > Stripe is deprecating usage-records billing. Moving forward, you can migrate to billing meters, our only solution for usage-based billing. https://docs.stripe.com/billing/subscriptions/usage-based-legacy/migration-guide#start-recording-usage ### Solution Brainstorm _No response_

Update readme.md

1

Add new theme.

docs: add searchbar

7

### Description Resolves #224. It use [Pagefind](https://pagefind.app/) to create local search index at build-time, and use [Canary](https://getcanary.dev/docs/local/playground) to build SearchBar UI. https://github.com/user-attachments/assets/f31c8bcf-c2f7-4ae6-b9f6-6f41f1aebac0 ### Additional context --- ### What is the...