[BUG] polars incompatible with long callbacks?

[liammcknight95]

Describe your context dash app with python 3.11.4 deployed on AWS EC2 instance

dash[diskcache]  2.11.1
polars 0.18.11

Describe the bug

When running long callbacks in dash with polars, they run infinitely & don't get collected - I imagine it's something to do with polars parallelism & multithreading? don't run into these issues with pandas

Expected behavior

Callback to run

[acrixl]

check celery & redis as background_callback_manager

[liammcknight95]

hey, seems to work fine for celery - guess diskcache is the issue

[liammcknight95]

my testing wasn't very thorough it would seem.

on further investigation - the initial callbacks collect correctly, unlike with diskcache. however when running with celery & redis, the callback doesn't get updated after the first call to it