verified-sources icon indicating copy to clipboard operation
verified-sources copied to clipboard

Add pages resource to notion

Open adrianbr opened this issue 1 year ago • 1 comments

Source name

Notion

Describe the data you'd like to see

I want to see page contents. Multiple of our users mentioned that's what they need for ML cases.

See filter here, https://github.com/dlt-hub/verified-sources/blob/master/sources/notion/init.py#L33

Please group all pages under a single resource, and add the page(document id as a column, so we have a simple access point for the pages. Do not create a table per page as we do with databases (there it makes sense to have separation)

Are you a dlt user?

Yes, I'm already a dlt user.

Do you ready to contribute this extension?

No.

dlt destination

No response

Additional information

No response

adrianbr avatar Apr 05 '24 10:04 adrianbr

Rahul reports we only get metadata, could you please have another look? We want the page text contents, so like if this is documentation someone wants to ingest it to vector dbs and "talk to it"

adrianbr avatar May 10 '24 06:05 adrianbr

@adrianbr, @rudolfix, ping

IlyaFaer avatar May 29 '24 06:05 IlyaFaer