Michael Penkov
Michael Penkov
Cannot reproduce on linux Python 3.10.6 and smart_open 6.1.0.
smart_open's main use case is streaming. If your application does a lot of seeking, then it may be better for you to handle buffering separately (e.g. using tempfile). Ideally, yes,...
Thank you for creating such a well-documented issue. Are you able to make a PR?
Hi George, Thank you for your interest in the smart_open library. The below is my personal opinion. @piskvorky , please let us know what you think about this, too. I...
Yes, that's exactly right. The tradeoffs when building a product and a library are different. That said, we can probably find significant common ground. For example, I'm not opposed to...
Thanks for reporting this. Could you simplify the example a bit? It's too long and requires external data (wind_2012_test_parts.zip). From your description of the problem, it sounds like the following...
@davidparks21 Thank you for confirming the problem. I think we can resolve the issue by ensuring that a single write call never puts more than 5GB. If there is more...
I think we understand the problem, now we "just" need to fix it.
Thank you for reporting this. Are you interested in making a PR?
There is no existing example code I'm aware of that would help in your case. @petedannemann may be able to help here.