brimdata
Value not displayed if > ~2MB
Repro is with Zui commit 445bdf1.
A community user recently bumped up against a 64 KB buffer in Zed's "line" reader which led to addressing https://github.com/brimdata/zed/issues/5043 to bump that up to 25 MB. Now that the Zed layer is no longer as limiting, I happened to try loading some large values into Zui and found it seems to have a limit when it comes to displaying values larger than about 2 MB.
The repro video below shows the exact moment where the limit is reached. For the largest value that's known to work, we create and populate a pool with a 2097153-character string and then another pool with a 2097154-character string. As you you can see, the 2097153-character string gets rendered ok, but the 2097154-character string is blank.
$ zed create -use 2097153
$ perl -E 'say "=" x 2097152' | zed load -i line -
$ zed create -use 2097154
$ perl -E 'say "=" x 2097153' | zed load -i line -
https://github.com/brimdata/zui/assets/5934157/a3e8d9bb-c3bf-495d-ad58-9299241c13f1
This doesn't preclude the user from working with the data if they know what's in there, e.g., slicing the first 50 characters out of the string that could not be displayed in full:
I also wanted to report a similar problem
Problem reading data as one line
I made 24MB data for testing. Only in one line, but even though the data is imported and it is written that one line is imported, no data is displayed.
