brimdata
Import to multiple pools
Community user @SoftTools59654 made the following feature suggestion. In their own words:
Import by pool name
I think this can be a good option in some cases where I want to import several data at the same time, but I don't want all the data to be imported in one pool. The option can be to enter any data as a pool, not just + New pool, but multi Poll
@SoftTools59654: I'd like to make sure we understand the idea correctly. Let's imagine there's a new pull-down option added for + Multi-pool. Using your example above, is it your expectation that by using this option you'd end up with three separate pools ("people-1000.csv", "userdata1.parquet", "userdata5.parquet") each storing the data from the corresponding named file, and each pool would have the same Pool Settings & Commit message?
@SoftTools59654: Ok, thanks for confirming. We understand the feature then.
It may be a while before someone on our team implements it because there's currently some higher priorities. In the meantime, a possible workaround would be to script this at the command line using the zed tooling. I know you've opened your issues to date in the context of the Zui desktop app so you might not be fully aware of the role of Zed and its role within Zui, but there's plenty of docs from that URL you can check out if you're interested.
Specific to your use case, the same zed command described at this doc and this tutorial is bundled with Zui in an OS-specific zdeps directory described in this article. So if you have that zdeps directory in your PATH and run the following in a UNIX-type shell (such as on macOS, Linux, or if you run Cygwin or similar on Windows), this would load all the files in a directory each into their own pool.
$ ls -l
total 24
-rw-r--r-- 1 phil staff 15 Nov 30 16:49 people-1000.csv
-rw-r--r-- 1 phil staff 15 Nov 30 16:49 userdata1.parquet
-rw-r--r-- 1 phil staff 15 Nov 30 16:49 userdata5.parquet
$ for file in *; do zed create $file; zed load -use $file $file; done
pool created: people-1000.csv 2Yv2gcpXpSZricEXnEXwn5EGNCp
(2/1) 15B/15B 15B/s 100.00%
2Yv2gePGddOxMXdfrylzbiGH7a7 committed
pool created: userdata1.parquet 2Yv2gdIXxE6YdUORBskGTub2cK6
(2/1) 15B/15B 15B/s 100.00%
2Yv2gZWzoi8coCNjFJtSzx8Ch1g committed
pool created: userdata5.parquet 2Yv2gdCGxbmZ0u9pNDAZ1VCLxsY
(2/1) 15B/15B 15B/s 100.00%
2Yv2gcuUeMyxBgGRhuNHW1HdCqo committed
Similar logic could surely be scripted in PowerShell or other shells on Windows, though I'm less proficient there so I don't have an example close at hand.
Hope that helps!