John Kellerman

I can see the meta data updates after this recent deploy, but the search results remain unchanged. Is there a mechanism to tell the bots to update?

@chrisguindon I see that same line at the end of `eclipse.org/robots.txt`. I tried running that file through the Google analyzer, but I don't know enough or have the right access.

@chrisguindon Right, sorry, my point was that if this line, `Disallow: /` is blocking pages on open-vsx.org from being crawled, why is the same line in `eclipse.org/robots.txt` not having the...

@chrisguindon let me preface this with, my knowledge here is thin... In https://www.eclipse.org/robots.txt are the two blocks separated by the empty line? If yes, top block says everyone can scan...

@chrisguindon Good observation. You mean, e.g. with this page https://open-vsx.org/extension/ms-toolsai/jupyter, we'd generate different text for the meta tags (presumably based on the plug-in information): ``` ```

Awesome! Thanks!

Yes.

@amvanbaren Good question. @spoenemann @chrisguindon?

Same priority as #468