datahub icon indicating copy to clipboard operation
datahub copied to clipboard

M1 quickstart for developer not working

Open qidian99 opened this issue 1 year ago • 2 comments

I'm using macos m2 and have spent 20+ hours on dev set up using gradle script, e.g., quickStart and quickStartPg.

The mysql and postgresql containers ALWAYS fail.

I noticed the mariadb compose file but I could not tell gradle to use mariadb plus dev containers at the same time.

Anyone please help with dev setup (I need to extends the forked modules and build locally).


after another 3 hours, I customized a m1 profile but still the docker compose failed:

View build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/hdribttrxhccz99oarainvdl4

> Task :docker:quickstartM1ComposeUp
 Network datahub_network  Creating
 Network datahub_network  Created
 Volume "datahub_osdata"  Creating
 Volume "datahub_osdata"  Created
time="2024-01-02T23:06:57+08:00" level=warning msg="Found orphan containers ([datahub-frontend-react datahub-actions datahub-upgrade schema-registry broker zookeeper elasticsearch-setup]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up."
 Container opensearch  Creating
 Container mysql  Creating
 Container kafka-broker  Creating
 Container mysql  Created
 Container opensearch  Created
 Container opensearch-setup  Creating
 Container mysql-setup  Creating
 Container kafka-broker  Created
 Container kafka-setup  Creating
 Container mysql-setup  Created
 Container opensearch-setup  Created
 Container kafka-setup  Created
 Container system-update  Creating
 Container system-update  Created
 Container datahub-gms  Creating
 Container frontend  Creating
 Container frontend  Created
 Container datahub-gms  Created
 Container datahub-mae-consumer  Creating
 Container actions  Creating
 Container datahub-mce-consumer  Creating
 Container datahub-mce-consumer  Created
 Container datahub-mae-consumer  Created
 Container actions  Created
 Container opensearch  Starting
 Container kafka-broker  Starting
 Container mysql  Starting
 Container kafka-broker  Started
 Container kafka-broker  Waiting
 Container mysql  Started
 Container mysql  Waiting
 Container opensearch  Started
 Container opensearch  Waiting
 Container mysql  Healthy
 Container mysql-setup  Starting
 Container opensearch  Healthy
 Container opensearch-setup  Starting
 Container opensearch-setup  Started
 Container mysql-setup  Started
 Container kafka-broker  Healthy
 Container kafka-setup  Starting
 Container kafka-setup  Started
 Container mysql-setup  Waiting
 Container opensearch-setup  Waiting
 Container kafka-setup  Waiting
 Container kafka-setup  Exited
 Container mysql-setup  Exited
 Container opensearch-setup  Exited
 Container system-update  Starting
 Container system-update  Started
 Container system-update  Waiting
 Container system-update  Waiting
 Container system-update  service "system-update-quickstart" didn't complete successfully: exit 1
 Container system-update  service "system-update-quickstart" didn't complete successfully: exit 1
service "system-update-quickstart" didn't complete successfully: exit 1

> Task :docker:quickstartM1ComposeUp FAILED

qidian99 avatar Jan 02 '24 13:01 qidian99

Please share the mysql container log after first running ./gradlew quickstartNuke to reset the state and then ./gradlew quickstart to re-create the mysql container. Additionally reaching out to our slack community might also help to result this issue.

david-leifker avatar Jan 03 '24 20:01 david-leifker

This issue is stale because it has been open for 30 days with no activity. If you believe this is still an issue on the latest DataHub release please leave a comment with the version that you tested it with. If this is a question/discussion please head to https://slack.datahubproject.io. For feature requests please use https://feature-requests.datahubproject.io

github-actions[bot] avatar Feb 03 '24 01:02 github-actions[bot]

This issue was closed because it has been inactive for 30 days since being marked as stale.

github-actions[bot] avatar Mar 04 '24 01:03 github-actions[bot]