superduper icon indicating copy to clipboard operation
superduper copied to clipboard

[ERROR]: sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:clickhouse

Open cansayin opened this issue 1 year ago • 1 comments

Contact Details [Optional]

No response

System Information

Linux Python3.10 installed These are the packages that i currently use from superduperdb import superduper from superduperdb.backends.ibis.query import RawSQL import os from superduperdb.ext.openai import OpenAIChatCompletion from IPython.display import Markdown

And then i receive following error. Could you please help me on this issue ?

Thanks

What happened?

2024-Jan-15 16:44:08.67| INFO | ip-172-31-36-202| efe97a26-ec05-4056-9d73-39a1247e7e5e| superduperdb.base.build:137 | Data Client is ready. <ibis.backends.clickhouse.Backend object at 0x7fa541693dc0> 2024-Jan-15 16:44:08.67| DEBUG | ip-172-31-36-202| efe97a26-ec05-4056-9d73-39a1247e7e5e| superduperdb.base.build:50 | Parsing data connection URI:clickhouse:///SAMPLE_SCHEMA/customers Traceback (most recent call last): File "/root/test.py", line 18, in <module> db = superduper( File "/usr/local/lib/python3.10/dist-packages/superduperdb/base/superduper.py", line 23, in superduper return _auto_identify_connection_string(item, **kwargs) File "/usr/local/lib/python3.10/dist-packages/superduperdb/base/superduper.py", line 48, in _auto_identify_connection_string return build_datalayer(CFG, **kwargs) File "/usr/local/lib/python3.10/dist-packages/superduperdb/base/build.py", line 148, in build_datalayer build(cfg.metadata_store, metadata_stores, type='metadata') File "/usr/local/lib/python3.10/dist-packages/superduperdb/base/build.py", line 96, in build sql_conn = create_engine(uri) File "<string>", line 2, in create_engine File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/util/deprecations.py", line 375, in warned return fn(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/engine/create.py", line 518, in create_engine entrypoint = u._get_entrypoint() File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/engine/url.py", line 662, in _get_entrypoint cls = registry.load(name) File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/util/langhelpers.py", line 343, in load raise exc.NoSuchModuleError( sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:clickhouse root@ip-172-31-36-202:~#

Steps to reproduce

No response

Relevant log output

No response

cansayin avatar Jan 15 '24 16:01 cansayin

Hi @cansayin.

You can see the snippet for ClichHouse on this notebook:

https://github.com/SuperDuperDB/superduperdb/blob/c395aff5a9fbdc0f32279f9e003374ffe7b5269c/examples/sql-example.ipynb#L116

# ---------------------------------
# ClickHouse (Cloud)
# ---------------------------------
# !pip install "ibis-framework[clickhouse]"
# user = 'play'
# password = ''
# host = 'play.clickhouse.com'
# port = 443
# connection_uri = f"clickhouse://{user}:{password}@{host}:{port}"

fnikolai avatar Jan 15 '24 17:01 fnikolai