Gokapi icon indicating copy to clipboard operation
Gokapi copied to clipboard
verified publisher icon Forceu

[Feature Request] Allow modification of the robots.txt

Open luki34567780 opened this issue 3 months ago • 1 comments

I'd like to be able to modify the robots.txt because in some cases I want to allow scrapers to access some of the paths (for example it would be nice to allow the discord scraper to access files so it can generate previews)

luki34567780 avatar Nov 27 '25 00:11 luki34567780

Thanks for the feedback! For me Discord is showing the preview:

Image

Does this not appear for your server? If not, the robots.txt is most likely not the reason

Forceu avatar Nov 27 '25 21:11 Forceu