superduper
superduper copied to clipboard
[ERROR]: sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:clickhouse
Contact Details [Optional]
No response
System Information
Linux
Python3.10 installed
These are the packages that i currently use
from superduperdb import superduper from superduperdb.backends.ibis.query import RawSQL import os from superduperdb.ext.openai import OpenAIChatCompletion from IPython.display import Markdown
And then i receive following error. Could you please help me on this issue ?
Thanks
What happened?
2024-Jan-15 16:44:08.67| INFO | ip-172-31-36-202| efe97a26-ec05-4056-9d73-39a1247e7e5e| superduperdb.base.build:137 | Data Client is ready. <ibis.backends.clickhouse.Backend object at 0x7fa541693dc0> 2024-Jan-15 16:44:08.67| DEBUG | ip-172-31-36-202| efe97a26-ec05-4056-9d73-39a1247e7e5e| superduperdb.base.build:50 | Parsing data connection URI:clickhouse:///SAMPLE_SCHEMA/customers Traceback (most recent call last): File "/root/test.py", line 18, in <module> db = superduper( File "/usr/local/lib/python3.10/dist-packages/superduperdb/base/superduper.py", line 23, in superduper return _auto_identify_connection_string(item, **kwargs) File "/usr/local/lib/python3.10/dist-packages/superduperdb/base/superduper.py", line 48, in _auto_identify_connection_string return build_datalayer(CFG, **kwargs) File "/usr/local/lib/python3.10/dist-packages/superduperdb/base/build.py", line 148, in build_datalayer build(cfg.metadata_store, metadata_stores, type='metadata') File "/usr/local/lib/python3.10/dist-packages/superduperdb/base/build.py", line 96, in build sql_conn = create_engine(uri) File "<string>", line 2, in create_engine File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/util/deprecations.py", line 375, in warned return fn(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/engine/create.py", line 518, in create_engine entrypoint = u._get_entrypoint() File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/engine/url.py", line 662, in _get_entrypoint cls = registry.load(name) File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/util/langhelpers.py", line 343, in load raise exc.NoSuchModuleError( sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:clickhouse root@ip-172-31-36-202:~#
Steps to reproduce
No response
Relevant log output
No response
Hi @cansayin.
You can see the snippet for ClichHouse on this notebook:
https://github.com/SuperDuperDB/superduperdb/blob/c395aff5a9fbdc0f32279f9e003374ffe7b5269c/examples/sql-example.ipynb#L116
# ---------------------------------
# ClickHouse (Cloud)
# ---------------------------------
# !pip install "ibis-framework[clickhouse]"
# user = 'play'
# password = ''
# host = 'play.clickhouse.com'
# port = 443
# connection_uri = f"clickhouse://{user}:{password}@{host}:{port}"