Setup sitemap without appsettings.json

[imclint21]

Hi,

How is possible to setup the sitemap link without JSON ?

THanks

[Philo]

Hi,

You can configure you own implementation by creating a class that derives from IRobotifyRobotGroupProvider. Then add this during configuration. The reasons contains an example of this

[imclint21]

Hey,

I've this for now, and I don't really see how to setup sitemap link ^^

namespace Librum
{
    public class RobotsProvider : IRobotifyRobotGroupProvider
    {
        public IEnumerable<RobotGroup> Get()
        {
            yield return new RobotGroup()
            {
                UserAgent = "*",
                Disallow = new[] { "/account", "/saved-articles", "/search" }
            };
        }
    }
}

[Philo]

Hi @clintnetwork - apologies for the super late reply here. There is a documentation issue here are you are able to configure the sitemap url via the .UseRobotify() extension:

            app.UseRobotify(c => c
                .Enabled(true)
                .WithSitemap(new Uri("https://www.example.com/sitemap.xml"))
                .DisableFileHeaderComments()
                .WithCrawlDelay(delayInSeconds: 10)
            );

See https://github.com/stormid/robotify-netcore/blob/master/sample/Robotify.AspNetCore.Sample/Startup.cs#L32