Auto-Linker limits

[yitzchoklowy]

when using the auto linker on a page with a lot of sources, after about 55 or 56 sources the popup fails (api/bulktext returns internal server error from cloudflare ) and it falls back to links. I tested this and it is related to the amount of sources I am trying to link. Is there anything i can do about this or is this just a limitation of the auto-linker?

[EliezerIsrael]

Thanks for the error report. I imagine that we're bumping up against a maximum length for the URL. Do you have an example call to /api/bulktext that fails? We should be able to work around the issue...

[yitzchoklowy]

here is an example from my page

https://www.sefaria.org/api/bulktext/%D7%A9%D7%95%D7%9C%D7%97%D7%9F%20%D7%A2%D7%A8%D7%95%D7%9A%20%D7%90%D7%95%D7%A8%D7%97%20%D7%97%D7%99%D7%99%D7%9D%20%D7%AA%D7%A7%D7%A2%D7%95,%20%D7%91%20%E2%80%93%20%D7%94%7C%D7%A9%D7%95%D7%9C%D7%97%D7%9F%20%D7%A2%D7%A8%D7%95%D7%9A%20%D7%99%D7%95%D7%A8%D7%94%20%D7%93%D7%A2%D7%94%20%D7%A7%D7%98%D7%96,%20%D7%94%7C%D7%A9%D7%95%D7%9C%D7%97%D7%9F%20%D7%A2%D7%A8%D7%95%D7%9A%20%D7%99%D7%95%D7%A8%D7%94%20%D7%93%D7%A2%D7%94%20%D7%A9%D7%A2%D7%93,%20%D7%99%D7%90%7C%D7%93%D7%91%D7%A8%D7%99%20%D7%94%D7%99%D7%9E%D7%99%D7%9D%20%D7%90,%20%D7%9B%D7%90%7C%D7%9E%D7%A9%D7%A0%D7%94%20%D7%AA%D7%A2%D7%A0%D7%99%D7%AA%20%D7%A4%D7%A8%D7%A7%20%D7%92%20%D7%9E%D7%A9%D7%A0%D7%94%20%D7%93%7C%D7%A4%D7%A8%D7%A7%D7%99%20%D7%90%D7%91%D7%95%D7%AA%20%D7%94,%20%D7%97%7C%D7%A4%D7%A8%D7%A7%D7%99%20%D7%90%D7%91%D7%95%D7%AA%20%D7%94,%20%D7%98%7C%D7%A1%D7%A0%D7%94%D7%93%D7%A8%D7%99%D7%9F%20%D7%A7%D7%90,%20%D7%90%7C%D7%A9%D7%9E%D7%95%D7%90%D7%9C%20%D7%91,%20%D7%9B%D7%93%7C%D7%9E%D7%9C%D7%9B%D7%99%D7%9D%20%D7%90%20%D7%97,%20%D7%9C%D7%96%7C%D7%91%D7%91%D7%90%20%D7%A7%D7%9E%D7%90%20%D7%A1,%20%D7%91%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%99%D7%93,%20%D7%99%D7%91%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%90,%20%D7%95%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%90,%20%D7%96%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%90,%20%D7%98%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%93,%20%D7%99%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%96,%20%D7%97%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%96,%20%D7%99%D7%92%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%97,%20%D7%97%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%98,%20%D7%99%D7%96%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9B%D7%98,%20%D7%99%D7%97%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9C%D7%91,%20%D7%9B%D7%93%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9C%D7%91,%20%D7%9C%D7%95%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9C%D7%93,%20%D7%99%D7%96%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9C%D7%97,%20%D7%91%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9E%D7%91,%20%D7%99%D7%96%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9E%D7%91,%20%D7%9B%D7%91%7C%D7%99%D7%A8%D7%9E%D7%99%D7%94%D7%95%20%D7%9E%D7%93,%20%D7%99%D7%92%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%99%D7%93,%20%D7%99%D7%91%20%E2%80%93%20%D7%9B%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%94,%20%D7%99%D7%91%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%94,%20%D7%99%D7%96%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%95,%20%D7%99%D7%90%20%E2%80%93%20%D7%99%D7%91%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%96,%20%D7%98%D7%95%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%99%D7%91,%20%D7%98%D7%96%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%99%D7%93,%20%D7%9B%D7%90%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%9B%D7%97,%20%D7%9B%D7%91%20%E2%80%93%20%D7%9B%D7%92%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%9C%D7%92,%20%D7%9B%D7%96%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%9C%D7%97,%20%D7%9B%D7%91%7C%D7%99%D7%97%D7%96%D7%A7%D7%90%D7%9C%20%D7%9B%D7%93,%20%D7%98%D7%96%7C%D7%96%D7%9B%D7%A8%D7%99%D7%94%20%D7%99%D7%93,%20%D7%99%D7%91%20%E2%80%93%20%D7%98%D7%95%7C%D7%91%D7%9E%D7%93%D7%91%D7%A8%20%D7%97,%20%D7%99%D7%98%7C%D7%91%D7%9E%D7%93%D7%91%D7%A8%20%D7%99%D7%93,%20%D7%99%D7%91%7C%D7%91%D7%9E%D7%93%D7%91%D7%A8%20%D7%99%D7%93,%20%D7%9C%D7%96%7C%D7%91%D7%9E%D7%93%D7%91%D7%A8%20%D7%99%D7%96,%20%D7%98%20%E2%80%93%20%D7%98%D7%95%7C%D7%91%D7%9E%D7%93%D7%91%D7%A8%20%D7%9B%D7%94,%20%D7%93%20%E2%80%93%20%D7%98%7C%D7%91%D7%9E%D7%93%D7%91%D7%A8%20%D7%9B%D7%94,%C2%A0%20%D7%99%D7%97%20%E2%80%93%20%D7%99%D7%98%7C%D7%91%D7%9E%D7%93%D7%91%D7%A8%20%D7%9C%D7%90,%20%D7%98%D7%96%7C%D7%AA%D7%94%D7%9C%D7%99%D7%9D%20%D7%A2%D7%97,%20%D7%A0%7C%D7%AA%D7%94%D7%9C%D7%99%D7%9D%20%D7%A7%D7%95,%20%D7%9B%D7%92%7C%D7%AA%D7%94%D7%9C%D7%99%D7%9D%20%D7%A7%D7%95,%20%D7%9B%D7%98%20%E2%80%93%20%D7%9C%7C%D7%AA%D7%94%D7%9C%D7%99%D7%9D%20%D7%A6%D7%90%7C%D7%AA%D7%94%D7%9C%D7%99%D7%9D%20%D7%A6%D7%90,%20%D7%92%7C%D7%AA%D7%94%D7%9C%D7%99%D7%9D%20%D7%A6%D7%90,%20%D7%95%7C%D7%95%D7%99%D7%A7%D7%A8%D7%90%20%D7%9B%D7%95,%20%D7%9B%D7%94%7C%D7%97%D7%91%D7%A7%D7%95%D7%A7%20%D7%92,%20%D7%94%7C%D7%AA%D7%A2%D7%A0%D7%99%D7%AA%20%D7%9B%D7%90,%20%D7%90%7C%D7%AA%D7%A2%D7%A0%D7%99%D7%AA%20%D7%9B%D7%90,%20%D7%91%7C%D7%AA%D7%A2%D7%A0%D7%99%D7%AA%20%D7%91,%C2%A0%20%D7%90%7C%D7%AA%D7%A2%D7%A0%D7%99%D7%AA%20%D7%91%7C%D7%99%D7%94%D7%95%D7%A9%D7%A2%20%D7%9B%D7%91,%20%D7%99%D7%96%7C%D7%93%D7%91%D7%A8%D7%99%D7%9D%20%D7%9B%D7%97,%20%D7%9B%D7%90%7C%D7%93%D7%91%D7%A8%D7%99%D7%9D%20%D7%9C%D7%91,%20%D7%9B%D7%94%7C%D7%93%D7%91%D7%A8%D7%99%D7%9D%20%D7%96,%20%D7%98%D7%95%7C%D7%93%D7%91%D7%A8%D7%99%D7%9D%20%D7%9B%D7%97,%20%D7%9B%D7%96%7C%D7%93%D7%91%D7%A8%D7%99%D7%9D%20%D7%9B%D7%97,%20%D7%A1%7C%D7%A2%D7%9E%D7%95%D7%A1%20%D7%93,%20%D7%99%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%94,%20%D7%92%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%98,%20%D7%90%20%E2%80%93%20%D7%96%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%98,%20%D7%98%D7%95%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%99%D7%90,%20%D7%93%20%E2%80%93%20%D7%97%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%99%D7%91,%20%D7%96%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%99%D7%91,%20%D7%99%D7%91%20%E2%80%93%20%D7%99%D7%92%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%99%D7%91,%20%D7%9B%D7%90%20%E2%80%93%20%D7%9B%D7%96%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%98%D7%95,%20%D7%9B%D7%95%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%9C,%20%D7%99%D7%91%7C%D7%A9%D7%9E%D7%95%D7%AA%20%D7%9C%D7%91,%20%D7%9C%D7%94%7C%D7%A9%D7%99%D7%A8%20%D7%A9%D7%9C?useTextFamily=1

[yairm210]

The real solution to this is to enable sending the a POST request and including the information in the body, instead of via GET with the info in the URL.

I don't know your frontend policies very well, is there something limiting you from using POST instead of GET?

If so, this can probably be mitigated by zipping the text using gzip or the like (should allow about 6x the number of references)... but best practice is through the body to allow arbitrary data size.