dbx icon indicating copy to clipboard operation
dbx copied to clipboard

ModuleNotFoundError in GitLab CI

Open ncheng8773 opened this issue 2 years ago • 0 comments
trafficstars

Expected Behavior

Pass GitLab CI

Current Behavior

If I run "dbx execute --cluster-id xxxx dbx_poc_sample_etl --task main" command locally, it works fine.

If I push to gitlab and run through CI/CD, I got error: ModuleNotFoundError: No module named 'xxxxx'

Steps to Reproduce (for bugs)

push to gitlab repo and run through CI/CI

Context

Part of my .gitlab-ci.yml file:

.job_template: tags: - xxxxx retry: max: 0 image: name: python:3.8 entrypoint: [""]

.before_script: &before_script

  • python -V
  • pip install virtualenv
  • virtualenv venv
  • export PYTHONUNBUFFERED=TRUE
  • pip install dbx

stages: - release-dev

release-dev: stage: release-dev extends: .job_template before_script: - echo "Start dev running..." - *stg_variable_template # stg account info script: - echo "Install dependencies" - pip install -e ".[local,test]" - echo "Deploying Job" - dbx execute --cluster-id xxxxx dbx_poc_sample_etl --task main only: refs: - main

Your Environment

python 3.8

  • dbx version used: dbx, version ~> 0.7.6
  • Databricks Runtime version: 10.4

ncheng8773 avatar Dec 30 '22 19:12 ncheng8773