conversational-datasets icon indicating copy to clipboard operation
conversational-datasets copied to clipboard

Published 20 hours ago • verified publisher icon PolyAI-LDN

Get more workers with Google Cloud's free trial

Open drunkinlove opened this issue 2 years ago • 2 comments

In case this helps anyone: my dataflow job on Google Cloud was restricted to 1 worker, so I added the following argument when launching create_data.py: --num_workers 8 Now the job was restricted to 4 workers instead due to the quota on external IP addresses. So I turned them off with: --no_use_public_ips and enabling Private Google Access for the used region's subnet (us-central1 for me) in the VPC networks section.

drunkinlove avatar Mar 09 '22 12:03 drunkinlove

Thanks!

Clovin avatar Nov 23 '22 10:11 Clovin

The max worker num is 20.

Clovin avatar Dec 07 '22 04:12 Clovin