Results 150 comments of Glyn Normington

I would say the priority of this project is to block AI crawlers. It is not clear that facebookexternalhit gathers data for AI training, but we don't know it isn't...

> Maybe the solution here is a comment above it describing what it does and what the risks are? I like the sound of this. Would it be possible to...

That link was helpful, thanks. Also Dark Visitors classifies this crawler as a "fetcher" which we [currently exclude](https://github.com/ai-robots-txt/ai.robots.txt/blob/71db599b41e476555e5d718942e7e8bfffdc30d6/code/dark_visitors.py#L35). PR raised to fix this issue.

> > Perhaps we should submit a new PR? > > By all means. I noted in [#21](https://github.com/ai-robots-txt/ai.robots.txt/pull/21) that > > > We also observed that it didn’t double-check robots.txt...

I tried building HEAD with Rust 1.70.0 and got: ~~~ error: package `clap v4.5.28` cannot be built because it requires rustc 1.74 or newer, while the currently active rustc version...

Although the above measurements show Linux to be ten times slower than macOS and five times slower than Windows, it's not clear to me why this is unexpected. The platform...

Thanks @alshdavid. Although Servo is probably the main consumer of IPC channel, I would be grateful for more information about your use case: 1. How much faster would IPC channel...

That's helpful - thank you. So it seems we don't yet have evidence that _any_ multi-process implementation could perform sufficiently well for very chatty use cases such as yours on...

> Unlikely. Is the overhead seen here a result of the serialization/deserialization of values across the IPC bridge? If that's the case, can we just send pointers? I believe IPC...

@alshdavid Thanks and I wish you good progress with https://github.com/atlassian-labs/atlaspack.