hello; how to fix this error; Error importing optional module IPython.core.display

[tianhao909]

$python -m vidur.main \

--replica_config_device a100
--replica_config_model_name meta-llama/Meta-Llama-3-8B
--cluster_config_num_replicas 1
--replica_config_tensor_parallel_size 1
--replica_config_num_pipeline_stages 1
--request_generator_config_type synthetic
--synthetic_request_generator_config_num_requests 512
--length_generator_config_type trace
--trace_request_length_generator_config_max_tokens 16384
--trace_request_length_generator_config_trace_file ./data/processed_traces/splitwise_conv.csv
--interval_generator_config_type poisson
--poisson_request_interval_generator_config_qps 6.45
--replica_scheduler_config_type sarathi
--sarathi_scheduler_config_batch_size_cap 512
--sarathi_scheduler_config_chunk_size 512
--random_forrest_execution_time_predictor_config_prediction_max_prefill_chunk_size 16384
--random_forrest_execution_time_predictor_config_prediction_max_batch_size 512
--random_forrest_execution_time_predictor_config_prediction_max_tokens_per_request 16384 INFO 12-17 16:26:28 trace_request_length_generator.py:78] Loaded request length trace file ./data/processed_traces/splitwise_conv.csv with 19366 requests

INFO 12-17 16:26:54 simulator.py:60] Starting simulation with cluster: Cluster({'id': 0, 'num_replicas': 1}) and 512 requests INFO 12-17 16:26:55 simulator.py:80] Simulation ended at: 85.98978289077179s INFO 12-17 16:26:55 simulator.py:83] Writing output Error importing optional module IPython.core.display Traceback (most recent call last): File "/home/xiaohao.fth/.conda/envs/vidur02/lib/python3.10/site-packages/_plotly_utils/optional_imports.py", line 28, in get_module return import_module(name) File "/home/xiaohao.fth/.conda/envs/vidur02/lib/python3.10/importlib/init.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 1050, in _gcd_import File "", line 1027, in _find_and_load File "", line 992, in _find_and_load_unlocked File "", line 241, in _call_with_frames_removed File "", line 1050, in _gcd_import

[renyinCheng001]

I had the same problem and it seems to be caused by IPython and my IPython version is 8.31.0

(vidur) user@s04:~/project25/vidur$ python -m vidur.main
INFO 01-17 17:14:43 simulator.py:60] Starting simulation with cluster: Cluster({'id': 0, 'num_replicas': 1}) and 128 requests
INFO 01-17 17:14:45 simulator.py:80] Simulation ended at: 240.50675835545405s
INFO 01-17 17:14:45 simulator.py:83] Writing output
Error importing optional module IPython.core.display
Traceback (most recent call last):
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/_plotly_utils/optional_imports.py", line 28, in get_module
    return import_module(name)
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/IPython/__init__.py", line 55, in <module>
    from .terminal.embed import embed
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/IPython/terminal/embed.py", line 16, in <module>
    from IPython.terminal.interactiveshell import TerminalInteractiveShell
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/IPython/terminal/interactiveshell.py", line 48, in <module>
    from .debugger import TerminalPdb, Pdb
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/IPython/terminal/debugger.py", line 18, in <module>
    from concurrent.futures import ThreadPoolExecutor
  File "<frozen importlib._bootstrap>", line 1075, in _handle_fromlist
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/concurrent/futures/__init__.py", line 49, in __getattr__
    from .thread import ThreadPoolExecutor as te
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/concurrent/futures/thread.py", line 37, in <module>
    threading._register_atexit(_python_exit)
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/threading.py", line 1504, in _register_atexit
    raise RuntimeError("can't register atexit after shutdown")
RuntimeError: can't register atexit after shutdown