etl
etl copied to clipboard
adding parallelism
The most obvious candidate is etl_transform()
, since those operations are local. Download speed is usually limited by the Internet connection speed, not the CPU. Also with database locking I'm not sure that concurrent importing would work.