Beth Cimini

Bumping this, because we now have had multiple people asking for it and I'm in the process of writing into the recipe, but I do think it might be better...

I think it should be trivial, because you're [already loading in data in chunks by strata](https://github.com/cytomining/pycytominer/blob/master/pycytominer/cyto_utils/cells.py#L672-L674) based on configurable columns, so it's just a matter of subsetting which chunks to...

Hi Jenna, Can you take a step back and talk to me a bit more about your use case? How are you hoping to cache/use this information? Briefly, in the...

Thanks Jenna, that's helpful! >Firstly, the goal in mind for this project is to use pycytominer.collate to create a SQLite file. Ok, well then all of this is probably unnecessary,...

I think it would be good to loop in @shntnu as well here. I can understand wanting to also support other data sources (ie parquet), but is there a reason...

I just want to make sure also though to put this problem in a larger context- I think an SQLiteToX (where X is Parquet or whatever else) is a good...

My straw proposal for what the right thing to do here is to try to finish [cytominer-transport](https://github.com/cytomining/cytominer-transport) . When we last left it off 14 months ago, it was working...

Code is done, still needs documentation (pending outcome of internal Slack discussion of if it's a good idea to expose this option or not, given it saves late stochastic failures...

(Not solved yet, notes) So in doing a bit of reading, we either need to have all of our containers in the Amazon ECR, and use [Private Link](https://aws.amazon.com/blogs/compute/setting-up-aws-privatelink-for-amazon-ecs-and-amazon-ecr/), and/or set...

I don't see any reason not to clean up run_batch_general, but if the major distinction is just path structure, any major reason to not to just have one script that...