dbx
dbx copied to clipboard
ModuleNotFoundError in GitLab CI
Expected Behavior
Pass GitLab CI
Current Behavior
If I run "dbx execute --cluster-id xxxx dbx_poc_sample_etl --task main" command locally, it works fine.
If I push to gitlab and run through CI/CD, I got error: ModuleNotFoundError: No module named 'xxxxx'
Steps to Reproduce (for bugs)
push to gitlab repo and run through CI/CI
Context
Part of my .gitlab-ci.yml file:
.job_template: tags: - xxxxx retry: max: 0 image: name: python:3.8 entrypoint: [""]
.before_script: &before_script
- python -V
- pip install virtualenv
- virtualenv venv
- export PYTHONUNBUFFERED=TRUE
- pip install dbx
stages: - release-dev
release-dev: stage: release-dev extends: .job_template before_script: - echo "Start dev running..." - *stg_variable_template # stg account info script: - echo "Install dependencies" - pip install -e ".[local,test]" - echo "Deploying Job" - dbx execute --cluster-id xxxxx dbx_poc_sample_etl --task main only: refs: - main
Your Environment
python 3.8
- dbx version used: dbx, version ~> 0.7.6
- Databricks Runtime version: 10.4