[SPO] Exclude "not allowed for search" objects

[llermaly]

Problem Description

Sharepoint allows to disable items from sharepoint search. I think we should align with this and not show this documents in Elasticsearch either.

Proposed Solution

Filter out the excluded documents. https://stackoverflow.com/questions/76787756/how-to-figure-out-if-search-enabled-in-sharepoint-using-the-api

Additional Context

The disable for search option is under Advanced settings:

This flag is exposed as NoCrawl through sharepoint rest API.

[llermaly]

https://learn.microsoft.com/en-us/search/?scope=graph&view=graph-rest-beta&terms=nocrawl