dify icon indicating copy to clipboard operation
dify copied to clipboard
Published 2 weeks ago • verified publisher icon langgenius

plugin Markitdown not working

Open terrysun1216 opened this issue 10 months ago • 7 comments

Self Checks

  • [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • [x] Please do not modify this template :) and fill in all the required fields.

Dify version

1.0.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

plugin Markitdown runs for long time and reports plugin server error. is it due to bad network? I am using proxy which works fine.

✔️ Expected Behavior

No response

❌ Actual Behavior

2025/03/13 10:54:24 runtime_lifetime.go:70: [INFO]init environment for plugin yevanchen/markitdown:0.0.1
[GIN] 2025/03/13 - 10:54:24 | 200 |    1.193109ms |      172.18.0.8 | GET      "/plugin/7d080b8b-5d54-49a1-a27d-7eadf4833338/management/tool?provider=markitdown&plugin_id=yevanchen%2Fmarkitdown"
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing '.'......
[GIN] 2025/03/13 - 10:54:24 | 200 |      311.01µs |      172.18.0.8 | GET      "/plugin/7d080b8b-5d54-49a1-a27d-7eadf4833338/management/tool?provider=markitdown&plugin_id=yevanchen%2Fmarkitdown"
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/PIL/report.py'......
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/azure/core/configuration.py'......
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/azure/identity/_credentials/default.py'......
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/bs4/builder/__init__.py'......
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing './.venv/lib/python3.12/site-packages/cryptography/hazmat/bindings/openssl'......
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/dateutil/utils.py'......
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing './.venv/lib/python3.12/site-packages/dify_plugin/interfaces/model'......
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/dpkt/ospf.py'......
2025/03/13 10:54:24 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/gevent/libuv/loop.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/gevent/tests/test__core_loop_run.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/gevent/tests/test__subprocess_interrupted.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/httpcore/_models.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/jwt/exceptions.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/markitdown/_markitdown.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/numpy/_core/tests/test_arraymethod.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/numpy/core/__init__.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/numpy/f2py/tests/test_return_logical.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/numpy/ma/tests/test_regression.py'......
2025/03/13 10:54:25 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing './.venv/lib/python3.12/site-packages/numpy/typing/tests/data/fail'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/openai/cli/_api/models.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/openai/resources/vector_stores/file_batches.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/openai/types/beta/realtime/input_audio_buffer_speech_started_event.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing './.venv/lib/python3.12/site-packages/openai/types/beta/threads/runs'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/openai/types/file_deleted.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/openai/types/responses/response_function_web_search_param.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/openai/types/static_file_chunking_strategy_param.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/openpyxl/descriptors/base.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/openpyxl/worksheet/_read_only.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/core/algorithms.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/core/indexes/category.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/io/excel/_calamine.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/arrays/__init__.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/arrays/sparse/test_accessor.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/dtypes/test_inference.py'......
2025/03/13 10:54:26 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/frame/methods/test_combine_first.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/frame/test_stack_unstack.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/indexes/categorical/test_setops.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/indexes/multi/test_get_set.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/indexes/timedeltas/test_constructors.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/io/formats/test_css.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/io/pytables/test_select.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/reshape/merge/__init__.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/series/indexing/test_where.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/series/test_ufunc.py'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing './.venv/lib/python3.12/site-packages/pandas/tests/util'......
2025/03/13 10:54:27 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pdfminer/data_structures.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pptx/oxml/chart/legend.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pydantic/_internal/_schema_generation_shared.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/pydub/logging_utils.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing './.venv/lib/python3.12/site-packages/setuptools/_distutils/compat'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_vendor/autocommand/autoasync.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing './.venv/lib/python3.12/site-packages/setuptools/_vendor/platformdirs-4.2.2.dist-info'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/setuptools/command/setopt.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/setuptools/tests/test_sandbox.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/tqdm/contrib/discord.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Listing './.venv/lib/python3.12/site-packages/urllib3-2.3.0.dist-info/licenses'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/xlsxwriter/theme.py'......
2025/03/13 10:54:28 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.1 - Compiling './.venv/lib/python3.12/site-packages/zope/interface/tests/test_exceptions.py'......
2025/03/13 10:54:28 runtime_lifetime.go:76: [ERROR]init environment failed: failed to pre-compile the plugin: ./.venv/lib/python3.12/site-packages/pydub/utils.py:300: SyntaxWarning: invalid escape sequence '\('
  m = re.match('([su]([0-9]{1,2})p?) \(([0-9]{1,2}) bit\)$', token)
./.venv/lib/python3.12/site-packages/pydub/utils.py:301: SyntaxWarning: invalid escape sequence '\('
  m2 = re.match('([su]([0-9]{1,2})p?)( \(default\))?$', token)
./.venv/lib/python3.12/site-packages/pydub/utils.py:310: SyntaxWarning: invalid escape sequence '\('
  elif re.match('(flt)p?( \(default\))?$', token):
./.venv/lib/python3.12/site-packages/pydub/utils.py:314: SyntaxWarning: invalid escape sequence '\('
  elif re.match('(dbl)p?( \(default\))?$', token):
./.venv/lib/python3.12/site-packages/youtube_transcript_api/test/test_cli.py:134: SyntaxWarning: invalid escape sequence '\-'
  parsed_args = YouTubeTranscriptCli("\-v1 \-\-v2 \--v3".split())._parse_args()
, retry in 30s

terrysun1216 avatar Mar 13 '25 11:03 terrysun1216

The issue you're experiencing with the Markitdown plugin seems to be related to syntax warnings during the pre-compilation process. Specifically, there are several SyntaxWarning messages indicating invalid escape sequences in the Python code, which can cause the plugin initialization to fail.

To address this, you can try the following steps:

  1. Check the Code for Escape Sequences: Review the code in the files mentioned in the warnings (e.g., pydub/utils.py and youtube_transcript_api/test/test_cli.py) and correct the invalid escape sequences. For instance, replace '\(' with '\\(' to properly escape the parentheses.

  2. Update Dependencies: Ensure that all dependencies are up-to-date. Sometimes, these issues are resolved in newer versions of the libraries.

  3. Modify the Plugin Code: If you have access to the plugin's source code, you can manually fix these warnings by editing the code to use raw strings (prefixing strings with r) or by properly escaping the sequences.

  4. Retry Initialization: After making these changes, try reinitializing the plugin to see if the issue persists.

If the problem continues, you might need to look into the specific libraries causing the warnings and see if there are any known issues or patches available.

To continue talking to Dosu, mention @dosu.

Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

dosubot[bot] avatar Mar 13 '25 11:03 dosubot[bot]

Thanks, I will try.

terrysun1216 avatar Mar 13 '25 11:03 terrysun1216

Same issue (code error), have been trying to install the Markitdown plugin, is there any way to stop the installation?

Image

LargeFace avatar Mar 13 '25 14:03 LargeFace

yes, i have reported the problem to the linux maintainer. They said the library is fine. it seems the plugin developer should fix the problem. meanwhile i have to use python in code node instead.

terrysun1216 avatar Mar 13 '25 15:03 terrysun1216

It seems to be caused by the regular expression of pydub. I tried to create a fix_dependencies.py file in the plugin root directory to fix the problematic dependencies before the plugin is loaded. I am not sure about the availability of self host. I have tested it in saas and there is no problem.

Yevanchen avatar Mar 13 '25 18:03 Yevanchen

The new version of the plugin is being installed, looks like working fine ......

but at the same time i see that the old version is still being installed in the logs 😕

LargeFace avatar Mar 14 '25 00:03 LargeFace

It seems to be caused by the regular expression of pydub. I tried to create a fix_dependencies.py file in the plugin root directory to fix the problematic dependencies before the plugin is loaded. I am not sure about the availability of self host. I have tested it in saas and there is no problem.

@Yevanchen How to manually add the fix_dependencies.py to the directory of the plugin is installing, and whether i can replace the main.py file? In order to stop the old version of the crazy loop

LargeFace avatar Mar 14 '25 01:03 LargeFace

I'm not sure, so the new version is able to work properly, but will the old version still install? Maybe you can try it before initializing in the main function. try: import fix_dependencies except ImportError: pass @LargeFace

Yevanchen avatar Mar 14 '25 02:03 Yevanchen

@Yevanchen still not working for 0.0.2 in self docker hosted dify. how to try "try: import fix_dependencies except ImportError: pass"

2025/03/14 02:58:57 runtime_lifetime.go:70: [INFO]init environment for plugin yevanchen/markitdown:0.0.2 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Listing '.'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/PIL/features.py'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/azure/core/configuration.py'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/azure/identity/_credentials/default.py'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/bs4/builder/init.py'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Listing './.venv/lib/python3.12/site-packages/cryptography/hazmat/bindings/openssl'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/dateutil/utils.py'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Listing './.venv/lib/python3.12/site-packages/dify_plugin/interfaces/model'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/dpkt/ospf.py'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/gevent/libuv/loop.py'...... 2025/03/14 02:58:57 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/gevent/tests/test__core_loop_run.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/gevent/tests/test__subprocess_interrupted.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/httpcore/_models.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/jwt/exceptions.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/markitdown/_markitdown.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/numpy/_core/tests/test_array_interface.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/numpy/conftest.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/numpy/f2py/tests/test_return_complex.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/numpy/ma/tests/test_mrecords.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/numpy/typing/tests/init.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openai/cli/_api/files.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openai/resources/vector_stores/init.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openai/types/beta/realtime/input_audio_buffer_committed_event.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openai/types/beta/threads/run_submit_tool_outputs_params.py'...... 2025/03/14 02:58:58 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openai/types/file_chunking_strategy_param.py'...... 2025/03/14 02:58:59 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openai/types/responses/response_function_tool_call_param.py'...... 2025/03/14 02:58:59 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openai/types/static_file_chunking_strategy_object.py'...... 2025/03/14 02:58:59 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openpyxl/compat/strings.py'...... 2025/03/14 02:58:59 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/openpyxl/workbook/workbook.py'...... 2025/03/14 02:58:59 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/core/numba/kernels/sum.py'...... 2025/03/14 02:58:59 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/core/indexes/accessors.py'...... 2025/03/14 02:58:59 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Listing './.venv/lib/python3.12/site-packages/pandas/io/excel'...... 2025/03/14 02:58:59 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/arithmetic/test_period.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/arrays/period/test_reductions.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/dtypes/test_concat.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/frame/methods/test_between_time.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/frame/test_query_eval.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/indexes/categorical/test_map.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/indexes/multi/test_formats.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/indexes/timedeltas/methods/test_shift.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/io/formats/style/test_to_string.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/io/pytables/test_read.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/reshape/concat/test_series.py'...... 2025/03/14 02:59:00 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/series/indexing/test_set_value.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/series/test_npfuncs.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pandas/tests/tslibs/test_timezones.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pdfminer/ccitt.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Listing './.venv/lib/python3.12/site-packages/pptx/oxml/dml'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pydantic/_internal/_validate_call.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Listing './.venv/lib/python3.12/site-packages/python_dateutil-2.9.0.post0.dist-info'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_distutils/compilers/C/cygwin.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Listing './.venv/lib/python3.12/site-packages/setuptools/_vendor/backports'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_vendor/tomli/_types.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/compat/py39.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/tests/test_warnings.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/tqdm/contrib/concurrent.py'...... 2025/03/14 02:59:01 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Listing './.venv/lib/python3.12/site-packages/urllib3-2.3.0.dist-info'...... 2025/03/14 02:59:02 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/xlsxwriter/table.py'...... 2025/03/14 02:59:02 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/zope/interface/tests/test_exceptions.py'...... 2025/03/14 02:59:02 runtime_lifetime.go:76: [ERROR]init environment failed: failed to pre-compile the plugin: ./.venv/lib/python3.12/site-packages/pydub/utils.py:300: SyntaxWarning: invalid escape sequence '(' m = re.match('(sup?) (([0-9]{1,2}) bit)$', token) ./.venv/lib/python3.12/site-packages/pydub/utils.py:301: SyntaxWarning: invalid escape sequence '(' m2 = re.match('(sup?)( (default))?$', token) ./.venv/lib/python3.12/site-packages/pydub/utils.py:310: SyntaxWarning: invalid escape sequence '(' elif re.match('(flt)p?( (default))?$', token): ./.venv/lib/python3.12/site-packages/pydub/utils.py:314: SyntaxWarning: invalid escape sequence '(' elif re.match('(dbl)p?( (default))?$', token): ./.venv/lib/python3.12/site-packages/youtube_transcript_api/test/test_cli.py:134: SyntaxWarning: invalid escape sequence '-' parsed_args = YouTubeTranscriptCli("-v1 --v2 --v3".split())._parse_args() , retry in 30s

terrysun1216 avatar Mar 14 '25 03:03 terrysun1216

I'm not sure, so the new version is able to work properly, but will the old version still install? Maybe you can try it before initializing in the main function. try: import fix_dependencies except ImportError: pass @LargeFace

@Yevanchen No. It's a pity, the issue is still with the new version :cry:

LargeFace avatar Mar 14 '25 03:03 LargeFace

Hi.

I also encountered the same bug! Why close this issue? Please fix bug.

@Yevanchen

python3.12/site-packages/pandas/util/_exceptions.py'......
2025/03/16 10:23:52 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pptx/enum/base.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pydantic/__init__.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pydantic/version.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_distutils/command/_framework_compat.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_distutils/tests/test_version.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_vendor/packaging/licenses/__init__.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/command/_requirestxt.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/tests/test_build_py.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/tiktoken/load.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/urllib3/fields.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/xlsxwriter/chart_scatter.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/zope/interface/declarations.py'......
2025/03/16 10:23:54 runtime_lifetime.go:76: [ERROR]init environment failed: failed to pre-compile the plugin: ./.venv/lib/python3.12/site-packages/pydub/utils.py:300: SyntaxWarning: invalid escape sequence '\('
  m = re.match('([su]([0-9]{1,2})p?) \(([0-9]{1,2}) bit\)$', token)
./.venv/lib/python3.12/site-packages/pydub/utils.py:301: SyntaxWarning: invalid escape sequence '\('
  m2 = re.match('([su]([0-9]{1,2})p?)( \(default\))?$', token)
./.venv/lib/python3.12/site-packages/pydub/utils.py:310: SyntaxWarning: invalid escape sequence '\('
  elif re.match('(flt)p?( \(default\))?$', token):
./.venv/lib/python3.12/site-packages/pydub/utils.py:314: SyntaxWarning: invalid escape sequence '\('
  elif re.match('(dbl)p?( \(default\))?$', token):
./.venv/lib/python3.12/site-packages/youtube_transcript_api/test/test_cli.py:134: SyntaxWarning: invalid escape sequence '\-'
  parsed_args = YouTubeTranscriptCli("\-v1 \-\-v2 \--v3".split())._parse_args()
, retry in 30s

yoshiki-0428 avatar Mar 16 '25 10:03 yoshiki-0428

Hi.  你好。

I also encountered the same bug! Why close this issue? Please fix bug.我也遇到了同样的 bug！为什么要关闭这个问题？请修复 bug。

@Yevanchen

python3.12/site-packages/pandas/util/_exceptions.py'......
2025/03/16 10:23:52 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pptx/enum/base.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pydantic/__init__.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/pydantic/version.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_distutils/command/_framework_compat.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_distutils/tests/test_version.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/_vendor/packaging/licenses/__init__.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/command/_requirestxt.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/setuptools/tests/test_build_py.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/tiktoken/load.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/urllib3/fields.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/xlsxwriter/chart_scatter.py'......
2025/03/16 10:23:53 environment_python.go:281: [INFO]pre-compiling yevanchen/markitdown:0.0.2 - Compiling './.venv/lib/python3.12/site-packages/zope/interface/declarations.py'......
2025/03/16 10:23:54 runtime_lifetime.go:76: [ERROR]init environment failed: failed to pre-compile the plugin: ./.venv/lib/python3.12/site-packages/pydub/utils.py:300: SyntaxWarning: invalid escape sequence '\('
  m = re.match('([su]([0-9]{1,2})p?) \(([0-9]{1,2}) bit\)$', token)
./.venv/lib/python3.12/site-packages/pydub/utils.py:301: SyntaxWarning: invalid escape sequence '\('
  m2 = re.match('([su]([0-9]{1,2})p?)( \(default\))?$', token)
./.venv/lib/python3.12/site-packages/pydub/utils.py:310: SyntaxWarning: invalid escape sequence '\('
  elif re.match('(flt)p?( \(default\))?$', token):
./.venv/lib/python3.12/site-packages/pydub/utils.py:314: SyntaxWarning: invalid escape sequence '\('
  elif re.match('(dbl)p?( \(default\))?$', token):
./.venv/lib/python3.12/site-packages/youtube_transcript_api/test/test_cli.py:134: SyntaxWarning: invalid escape sequence '\-'
  parsed_args = YouTubeTranscriptCli("\-v1 \-\-v2 \--v3".split())._parse_args()
, retry in 30s

This issue is very troublesome during the pre-compilation stage. I have clarified this situation with the markitdown officials. The best approach is to wait for a markitdown update, as any fixes from the source code cannot take effect during the pre-compilation stage.

Yevanchen avatar Mar 16 '25 19:03 Yevanchen

https://github.com/microsoft/markitdown/issues/1126#issuecomment-2727539767

Yevanchen avatar Mar 16 '25 19:03 Yevanchen