helpers
helpers copied to clipboard
Helpers container very slow
After a bit of debugging, the issue is related to importing pandas
I believe that we don't have a multi-arch version of the //helpers container
In //cmamp
user_501@6a797ec3d57c:/app$ python -X importtime -c "import pandas"
import time: self [us]| cumulative | imported package
import time: 1755 | 854726 | pandas
In //helpers
user_501@e9d72c989fa7:/app/helpers_root$ python -X importtime -c "import pandas"
import time: self [us] | cumulative | imported package
import time: 19320 | 8155299 | pandas
Confirmed
> docker inspect --format='{{.Os}}/{{.Architecture}}' 623860924167.dkr.ecr.eu-north-1.amazonaws.com/helpers:dev
linux/amd64
~/src/helpers1
> docker inspect --format='{{.Os}}/{{.Architecture}}' 623860924167.dkr.ecr.eu-north-1.amazonaws.com/cmamp:dev
linux/arm64
We need to build a multi-arch version of the //helpers image
Maybe we need to check if the container is not "compatible" with the underlying CPU and break or issue a warning