helpers icon indicating copy to clipboard operation
helpers copied to clipboard

Helpers container very slow

Open gpsaggese opened this issue 10 months ago • 2 comments

After a bit of debugging, the issue is related to importing pandas

I believe that we don't have a multi-arch version of the //helpers container

In //cmamp

user_501@6a797ec3d57c:/app$ python -X importtime -c "import pandas"
import time: self [us]| cumulative | imported package
import time:      1755 |     854726 | pandas

In //helpers

user_501@e9d72c989fa7:/app/helpers_root$ python -X importtime -c "import pandas"
import time: self [us]  | cumulative | imported package
import time:     19320 |    8155299 | pandas

gpsaggese avatar Feb 16 '25 23:02 gpsaggese

Confirmed

> docker inspect --format='{{.Os}}/{{.Architecture}}' 623860924167.dkr.ecr.eu-north-1.amazonaws.com/helpers:dev
linux/amd64

~/src/helpers1
> docker inspect --format='{{.Os}}/{{.Architecture}}' 623860924167.dkr.ecr.eu-north-1.amazonaws.com/cmamp:dev
linux/arm64

We need to build a multi-arch version of the //helpers image

gpsaggese avatar Feb 16 '25 23:02 gpsaggese

Maybe we need to check if the container is not "compatible" with the underlying CPU and break or issue a warning

gpsaggese avatar Feb 26 '25 14:02 gpsaggese