superset
superset copied to clipboard
apache
Error installing Superset 2.0
A clear and concise description of what the bug is.
How to reproduce the bug
- Go to linux server
- pip install pip install apache-superset
Using cached https://files.pythonhosted.org/packages/59/7c/e39aca596badaf1b78e8f547c807b04dae603a433d3e7a7e04d67f2ef3e5/wcwidth-0.2.5-py2.py3-none-any.whl Collecting h11<1,>=0.9.0 Using cached https://files.pythonhosted.org/packages/19/d2/32a15a4955be1b8114a1c570999eefd31279c7f9aa2d2a43d492a79b53c5/h11-0.13.0-py3-none-any.whl ERROR: flask-appbuilder 4.1.3 has requirement Flask-WTF<1.0.0,>=0.14.2, but you'll have flask-wtf 1.0.1 which is incompatible. ERROR: flask-caching 2.0.0 has requirement cachelib>=0.9.0, but you'll have cachelib 0.4.1 which is incompatible. ERROR: flask-caching 2.0.0 has requirement Flask<=2.1.2, but you'll have flask 2.1.3 which is incompatible. Installing collected packages: backoff, webencodings, pyparsing, packaging, six, bleach, cachelib, click, click-didyoumean, billiard, vine, wcwidth, prompt-toolkit, click-repl, pytz, click-plugins, amqp, kombu, celery, colorama, python-dateutil, croniter, cron-descriptor, pycparser, cffi, cryptography, deprecation, itsdangerous, MarkupSafe, Werkzeug, zipp, importlib-metadata, Jinja2, flask, PyJWT, pyyaml, apispec, sqlalchemy, importlib-resources, attrs, pyrsistent, jsonschema, marshmallow, WTForms, Flask-JWT-Extended, sqlalchemy-utils, prison, Flask-SQLAlchemy, Babel, Flask-Babel, flask-wtf, marshmallow-enum, marshmallow-sqlalchemy, Flask-Login, dnspython, idna, email-validator, flask-appbuilder, flask-caching, brotli, flask-compress, flask-talisman, Ma
- superset db upgrade
getting the following error
Traceback (most recent call last):
File "/home/dbaseuser/venv/bin/superset", line 6, in
I got this error, I think this version is not stable!
Fetching a set of all perms to lookup which ones are missing 2022-07-29 16:48:42,418:INFO:superset.security.manager:Fetching a set of all perms to lookup which ones are missing Creating missing datasource permissions. 2022-07-29 16:48:42,488:INFO:superset.security.manager:Creating missing datasource permissions. Traceback (most recent call last): File "/home/sigma/venv/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/home/sigma/venv/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: no such table: tables
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/sigma/venv/bin/superset", line 11, in
I had no issues getting pip install working for Superset 2.0.
- Are you using the minimum required Python version for Superset?
- Have you updated pip recently?
I tried to install via source and pip, upgraded pip to the latest version, attempted installation within a virtual environment (venv), and even tried without a virtual environment.
I am seeing similar errors with pip installation , what fixed it was upgrading pip to latest.. then all warnings about deps went away
Ubuntu 20.04 (inside an LXC container)
sudo pip3 install --upgrade pip
Collecting pip
Downloading pip-22.2.1-py3-none-any.whl (2.0 MB)
|████████████████████████████████| 2.0 MB 6.9 MB/s
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Not uninstalling pip at /usr/lib/python3/dist-packages, outside environment /usr
Can't uninstall 'pip'. No files were found to uninstall.
Successfully installed pip-22.2.1
ubuntu@juju-e920ce-32:~$ pip --version
pip 22.2.1 from /home/ubuntu/.local/lib/python3.8/site-packages/pip (python 3.8)
ubuntu@juju-e920ce-32:~$ python3 --version
Python 3.8.10
ubuntu@juju-e920ce-32:~$ pip install apache-superset
Defaulting to user installation because normal site-packages is not writeable
Collecting apache-superset
Downloading apache-superset-2.0.0.tar.gz (40.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.8/40.8 MB 9.1 MB/s eta 0:00:00
....
Successfully installed Babel-2.10.3 Flask-Babel-2.0.0 Flask-JWT-Extended-4.4.3 Flask-Login-0.6.2 Flask-SQLAlchemy-2.5.1 Jinja2-3.1.2 Mako-1.2.1 MarkupSafe-2.1.1 PyJWT-2.4.0 PySocks-1.7.1 WTForms-2.3.3 Werkzeug-2.2.1 aiohttp-3.8.1 aiosignal-1.2.0 alembic-1.8.1 amqp-5.1.1 apache-superset-2.0.0 apispec-3.3.2 async-generator-1.10 async-timeout-4.0.2 backoff-2.1.2 billiard-3.6.4.0 bleach-3.3.1 brotli-1.0.9 cachelib-0.4.1 celery-5.2.7 cffi-1.15.1 charset-normalizer-2.1.0 click-8.1.3 click-didyoumean-0.3.0 click-plugins-1.1.1 click-repl-0.2.0 convertdate-2.4.0 cron-descriptor-1.2.31 croniter-1.3.5 cryptography-37.0.4 deprecated-1.2.13 deprecation-2.1.0 dnspython-2.2.1 email-validator-1.2.1 flask-2.1.3 flask-appbuilder-4.1.3 flask-caching-1.11.1 flask-compress-1.12 flask-migrate-3.1.0 flask-talisman-1.0.0 flask-wtf-0.15.1 frozenlist-1.3.0 func_timeout-4.3.5 geographiclib-1.52 geopy-2.2.0 graphlib-backport-1.0.3 gunicorn-20.1.0 h11-0.13.0 hashids-1.3.1 holidays-0.10.3 humanize-4.2.3 importlib-metadata-4.12.0 importlib-resources-5.9.0 isodate-0.6.1 itsdangerous-2.1.2 kombu-5.2.4 korean_lunar_calendar-0.2.1 markdown-3.4.1 marshmallow-3.17.0 marshmallow-enum-1.5.1 marshmallow-sqlalchemy-0.26.1 msgpack-1.0.4 multidict-6.0.2 numpy-1.22.1 outcome-1.2.0 packaging-21.3 pandas-1.3.5 parsedatetime-2.6 pgsanity-0.2.9 polyline-1.4.0 prison-0.2.1 prompt-toolkit-3.0.30 pyarrow-5.0.0 pycparser-2.21 pymeeus-0.5.11 pyparsing-3.0.9 python-dateutil-2.8.2 python-dotenv-0.20.0 python-geohash-0.8.5 pytz-2022.1 pyyaml-6.0 redis-4.3.4 selenium-4.3.0 slackclient-2.5.0 sniffio-1.2.0 sortedcontainers-2.4.0 sqlalchemy-1.3.24 sqlalchemy-utils-0.37.9 sqlparse-0.3.0 tabulate-0.8.9 trio-0.21.0 trio-websocket-0.9.2 typing-extensions-3.10.0.2 urllib3-1.26.11 vine-5.0.0 wcwidth-0.2.5 webencodings-0.5.1 wrapt-1.14.1 wsproto-1.1.0 wtforms-json-0.3.5 yarl-1.7.2 zipp-3.8.1
If you still have issues, what I do in past is preinstall on certain pinned versions until the errors go away.. you can also do this by installing apache-superset via poetry project and inspect the poetry.lock file
Unfortunately right after that I hit this error on superset db upgrade
<module>
from superset.models.tags import ObjectTypes
File "/home/ubuntu/.local/lib/python3.8/site-packages/superset/models/__init__.py", line 17, in <module>
from . import core, datasource_access_request, dynamic_plugins, sql_lab, user_attributes
File "/home/ubuntu/.local/lib/python3.8/site-packages/superset/models/core.py", line 63, in <module>
from superset.utils import cache as cache_util, core as utils
File "/home/ubuntu/.local/lib/python3.8/site-packages/superset/utils/cache.py", line 28, in <module>
from werkzeug.wrappers.etag import ETagResponseMixin
ModuleNotFoundError: No module named 'werkzeug.wrappers.etag'
as have others #20723
Same issue.
Temporarily resolved by commenting out the include https://github.com/apache/superset/blob/1ebdaac487ec1684050174957a1d5699912bf001/superset/utils/cache.py#L28
And removing it's reference as a return type. https://github.com/apache/superset/blob/1ebdaac487ec1684050174957a1d5699912bf001/superset/utils/cache.py#L178
getting issues while installing.. could not find any proper fix. its like not stable one, no confidence to use this in any production environment.
Same issue.
Temporarily resolved by commenting out the include
https://github.com/apache/superset/blob/1ebdaac487ec1684050174957a1d5699912bf001/superset/utils/cache.py#L28
And removing it's reference as a return type.
https://github.com/apache/superset/blob/1ebdaac487ec1684050174957a1d5699912bf001/superset/utils/cache.py#L178
how can we make sure other issues will not generate by commenting this
Installation working well in my venv (using python 3.8.0), but I facing issue when execute superset db upgrade :
ModuleNotFoundError: No module named 'wtforms.ext'
@afifdevtest
https://wtforms.readthedocs.io/en/3.0.x/changes/#version-2-3-1 , wtforms.ext was removed in version 3.0.
Downgrading to 2.3.0 worked for me.
pip uninstall WTForms
pip install WTForms==2.3.0
I was able to workaround ALL the issues with ApacheSuperset by backing OFF of 22.04 (python 3.10 is the version in that ubuntu and it's too new for some of the debpendencies of the project)
So with python 3.8 within Ubuntu 20.04 LTS.. I do the following and all is working
apt-get update
apt-get -y upgrade
apt-get -y install build-essential libssl-dev libffi-dev python3-dev python3-pip libsasl2-dev libldap2-dev default-libmysqlclient-dev libpq-dev python-is-python3
pip install --upgrade pip
sudo -u ubuntu pip install --upgrade pip --no-warn-script-location
sudo -u ubuntu pip install werkzeug==2.0.3 --no-warn-script-location
sudo -u ubuntu pip install flask==2.1.3 --no-warn-script-location
sudo -u ubuntu pip install wtforms==2.3.0 --no-warn-script-location
sudo -u ubuntu pip install --upgrade pyopenssl --no-warn-script-location
sudo -u ubuntu pip install psycopg2-binary pillow gunicorn gevent --no-warn-script-location
sudo -u ubuntu pip install apache-superset --no-warn-script-location
sudo touch /etc/profile.d/superset.sh
echo -e 'export FLASK_APP=superset' >> /etc/profile.d/superset.sh
export FLASK_APP=superset
sudo -u ubuntu FLASK_APP=superset /home/ubuntu/.local/bin/superset db upgrade
sudo -u ubuntu FLASK_APP=superset /home/ubuntu/.local/bin/superset fab create-admin --username admin --firstname admin --lastname user --email [email protected] --password etcxxxx
sudo -u ubuntu FLASK_APP=superset /home/ubuntu/.local/bin/superset init
For those who are facing cachelib version conflict error. In addition to @EMCP's steps after installing apache-superset, run
pip install Flask-Caching==1.11.1
Also struggled with this problem
superset db upgrade
ModuleNotFoundError: No module named 'wtforms.ext'
I found the installed superset (from an earlier attempt) was using a different python than my venv
(venv) rfuller@Roberts-MBP superset % head -1 $(which superset
/usr/local/bin/superset
(venv) rfuller@Roberts-MBP superset % head -1 $(which superset)
#!/usr/local/opt/[email protected]/bin/python3.10
(venv) rfuller@Roberts-MBP superset % which python
/Users/rfuller/dev/superset/venv/bin/python
I resolved the issue by changing superset to use python from my environment.
(venv) rfuller@Roberts-MBP superset % vi $(which superset)
(venv) rfuller@Roberts-MBP superset % head -1 $(which superset)
#!/usr/bin/env python
All good now.
Same problem during superset db upgrade with python 3.9 ModuleNotFoundError: No module named 'werkzeug.wrappers.etag
This seems to be the latest issue to the 2.0.1 install: TypeError: validate() got an unexpected keyword argument 'extra_validators'
Cant figure out which package versions are required for this.
Yes i see the same error on 'extra_validators'
2023-02-13 20:55:05,807:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:05] "GET /login/ HTTP/1.1" 200 - 2023-02-13 20:55:06,186:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/theme.a7e2abf6a9f3e70a343c.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,191:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/theme.a7e2abf6a9f3e70a343c.entry.css HTTP/1.1" 200 - 2023-02-13 20:55:06,633:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/vendors.57b36d6e3a2ad4b369c5.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,941:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/5010.45f6108a4decceaaeb0b.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,948:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/4113.e4abf47e55f746a6d7fe.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,949:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/789.22284d193feb04432df3.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,954:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/3389.e22df7156d4c7985a2e1.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,956:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/6315.a94f44b7f86c25943a86.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:07,489:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:07] "GET /static/assets/menu.1010f89bd3a467d71506.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:07,496:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:07] "GET /static/assets/6052.0cdbb57cd94afe15d58e.entry.js HTTP/1.1" 200 - validate() got an unexpected keyword argument 'extra_validators' Traceback (most recent call last): File "/home/azureuser/venv/lib/python3.8/site-packages/flask/app.py", line 1523, in full_dispatch_request rv = self.dispatch_request() File "/home/azureuser/venv/lib/python3.8/site-packages/flask/app.py", line 1509, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) File "/home/azureuser/venv/lib/python3.8/site-packages/flask_appbuilder/security/views.py", line 516, in login if form.validate_on_submit(): File "/home/azureuser/venv/lib/python3.8/site-packages/flask_wtf/form.py", line 86, in validate_on_submit return self.is_submitted() and self.validate(extra_validators=extra_validators) TypeError: validate() got an unexpected keyword argument 'extra_validators'
pip install apache-superset for some reason installs different package versions opposed to the ones being used in the master channel. You may have to install the specific versions yourself.
pip install flask-wtf==1.0.1
Yes i see the same error on 'extra_validators'
2023-02-13 20:55:05,807:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:05] "GET /login/ HTTP/1.1" 200 - 2023-02-13 20:55:06,186:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/theme.a7e2abf6a9f3e70a343c.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,191:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/theme.a7e2abf6a9f3e70a343c.entry.css HTTP/1.1" 200 - 2023-02-13 20:55:06,633:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/vendors.57b36d6e3a2ad4b369c5.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,941:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/5010.45f6108a4decceaaeb0b.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,948:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/4113.e4abf47e55f746a6d7fe.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,949:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/789.22284d193feb04432df3.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,954:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/3389.e22df7156d4c7985a2e1.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:06,956:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:06] "GET /static/assets/6315.a94f44b7f86c25943a86.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:07,489:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:07] "GET /static/assets/menu.1010f89bd3a467d71506.entry.js HTTP/1.1" 200 - 2023-02-13 20:55:07,496:INFO:werkzeug:172.18.37.16 - - [13/Feb/2023 20:55:07] "GET /static/assets/6052.0cdbb57cd94afe15d58e.entry.js HTTP/1.1" 200 - validate() got an unexpected keyword argument 'extra_validators' Traceback (most recent call last): File "/home/azureuser/venv/lib/python3.8/site-packages/flask/app.py", line 1523, in full_dispatch_request rv = self.dispatch_request() File "/home/azureuser/venv/lib/python3.8/site-packages/flask/app.py", line 1509, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) File "/home/azureuser/venv/lib/python3.8/site-packages/flask_appbuilder/security/views.py", line 516, in login if form.validate_on_submit(): File "/home/azureuser/venv/lib/python3.8/site-packages/flask_wtf/form.py", line 86, in validate_on_submit return self.is_submitted() and self.validate(extra_validators=extra_validators) TypeError: validate() got an unexpected keyword argument 'extra_validators'
Here is the link to the base requirements.txt.
If you compare the versions in here, with the package versions installed by pip , they are different and lead to errors when starting superset. Hope this will be fixed in future releases
I installed apache suprerset from scratch when I did run command "superset db upgrade" I got this error, I'm using LMDE 5 (Linux mint Debian 11 version).
Traceback (most recent call last):
File "/home/sigma/venv/bin/superset", line 11, in
I did , but when I ran "superset fab create-admin" I got new error message:
2023-02-23 10:42:43,695:ERROR:superset.app:Failed to create app
Traceback (most recent call last):
File "/home/sigma/venv/lib/python3.9/site-packages/superset/app.py", line 37, in create_app
app_initializer.init_app()
File "/home/sigma/venv/lib/python3.9/site-packages/superset/initialization/init.py", line 460, in init_app
self.init_app_in_ctx()
File "/home/sigma/venv/lib/python3.9/site-packages/superset/initialization/init.py", line 410, in init_app_in_ctx
self.configure_data_sources()
File "/home/sigma/venv/lib/python3.9/site-packages/superset/initialization/init.py", line 476, in configure_data_sources
ConnectorRegistry.register_sources(module_datasource_map)
File "/home/sigma/venv/lib/python3.9/site-packages/superset/connectors/connector_registry.py", line 42, in register_sources
module_obj = import(module_name, fromlist=class_names)
File "/home/sigma/venv/lib/python3.9/site-packages/superset/connectors/sqla/init.py", line 17, in
Since my last post, I noticed a new bug has popped up #22571 , in there.. there's a tip to do some one-liner that pip installs.. I don't trust one-liners off web assets so I went ahead and printed out the command .. this is what ended up working now with v2.0.1
Ubuntu 20.04 and Py38
pip install --upgrade pip
sudo -u ubuntu pip install --upgrade pip --no-warn-script-location
sudo -u ubuntu pip install testresources --no-warn-script-location
sudo -u ubuntu pip install aiohttp==3.8.1 aiosignal==1.2.0 alembic==1.6.5 amqp==5.1.0 apispec[yaml]==3.3.2 async-timeout==4.0.2 attrs==21.2.0 babel==2.9.1 backoff==1.11.1 billiard==3.6.4.0 bleach==3.3.1 brotli==1.0.9 cachelib==0.4.1 celery==5.2.2 cffi==1.14.6 charset-normalizer==2.0.4 click==8.0.4 click-didyoumean==0.3.0 click-plugins==1.1.1 click-repl==0.2.0 colorama==0.4.4 convertdate==2.4.0 cron-descriptor==1.2.24 croniter==1.0.15 cryptography==3.4.7 deprecation==2.1.0 dnspython==2.1.0 email-validator==1.1.3 flask==2.0.3 flask-appbuilder==4.1.3 flask-babel==1.0.0 flask-caching==1.10.1 flask-compress==1.10.1 flask-jwt-extended==4.3.1 flask-login==0.4.1 flask-migrate==3.1.0 flask-sqlalchemy==2.5.1 flask-talisman==0.8.1 flask-wtf==0.14.3 frozenlist==1.3.0 func-timeout==4.3.5 geographiclib==1.52 geopy==2.2.0 graphlib-backport==1.0.3 gunicorn==20.1.0 hashids==1.3.1 holidays==0.14.2 humanize==3.11.0 idna==3.2 isodate==0.6.0 itsdangerous==2.1.1 jinja2==3.0.3 jsonschema==3.2.0 kombu==5.2.4 korean-lunar-calendar==0.2.1 mako==1.1.4 markdown==3.3.4 markupsafe==2.0.1 marshmallow==3.13.0 marshmallow-enum==1.5.1 marshmallow-sqlalchemy==0.23.1 msgpack==1.0.2 multidict==5.1.0 numpy==1.22.1 packaging==21.3 pandas==1.3.4 parsedatetime==2.6 pgsanity==0.2.9 polyline==1.4.0 prison==0.2.1 prompt-toolkit==3.0.28 pyarrow==5.0.0 pycparser==2.20 pyjwt==2.4.0 pymeeus==0.5.11 pyparsing==3.0.6 pyrsistent==0.16.1 python-dateutil==2.8.2 python-dotenv==0.19.0 python-editor==1.0.4 python-geohash==0.8.5 pytz==2021.3 pyyaml==5.4.1 redis==3.5.3 selenium==3.141.0 simplejson==3.17.3 six==1.16.0 slackclient==2.5.0 sqlalchemy==1.3.24 sqlalchemy-utils==0.37.8 sqlparse==0.3.0 tabulate==0.8.9 typing-extensions==3.10.0.0 urllib3==1.26.6 vine==5.0.0 wcwidth==0.2.5 webencodings==0.5.1 werkzeug==2.0.3 wtforms==2.3.3 wtforms-json==0.3.3 yarl==1.6.3 --no-warn-script-location
sudo -u ubuntu pip install psycopg2-binary pillow gunicorn gevent --no-warn-script-location
sudo -u ubuntu pip install requests --upgrade --no-warn-script-location
sudo -u ubuntu pip install trino thrift pyhive --no-warn-script-location
status-set maintenance "About to pip install apache-superset $(date +"%H:%M")"
juju-log -l "WARNING" "About to pip install apache-superset"
sudo -u ubuntu pip install apache-superset --no-warn-script-location
I hope you were able to resolve this, but since this has been silent for about a year, and we no longer actively support Superset 2.x, I'm going to close this out as stale. If people are still encountering this in current versions (currently 3.x) please re-open this issue, open a new Issue with updated context, or raise a PR to address the problem. Thanks!
