Deployment stops at `Rendering job templates...`

[jhiemer]

Hi, currently trying to deploy bosh director via bosh-init. The process steps during Rendering job templates... and nothing happens.

Here is the log:

 cd /workspace/deployments && bosh-init deploy ./bosh.yml
Deployment manifest: '/workspace/deployments/bosh.yml'
Deployment state: '/workspace/deployments/bosh-state.json'

Started validating
  Downloading release 'bosh'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh'... Finished (00:00:05)
  Downloading release 'bosh-openstack-cpi'... Skipped [Found in local cache] (00:00:00)
  Validating release 'bosh-openstack-cpi'... Finished (00:00:01)
  Validating cpi release... Finished (00:00:00)
  Validating deployment manifest... Finished (00:00:00)
  Downloading stemcell... Skipped [Found in local cache] (00:00:00)
  Validating stemcell... Finished (00:00:11)
Finished validating (00:00:17)

Started installing CPI
  Compiling package 'ruby_openstack_cpi/7bb6f6bfb6014a9630ebb5686fd2f1ff4e0289ae'... Finished (00:00:00)
  Compiling package 'bosh_openstack_cpi/3a41d45536a57cea65bf8a114cfcd1f0a035639e'... Finished (00:00:00)
  Installing packages... Finished (00:00:08)
  Rendering job templates... Finished (00:00:00)
  Installing job 'openstack_cpi'... Finished (00:00:00)
Finished installing CPI (00:00:09)

Starting registry... Finished (00:00:00)
Uploading stemcell 'bosh-openstack-kvm-ubuntu-trusty-go_agent-raw/3232.8'... Skipped [Stemcell already uploaded] (00:00:00)

Started deploying
  Waiting for the agent on VM '44d3994e-5d18-4deb-82ea-46574557fa81'... Finished (00:00:00)
  Stopping jobs on instance 'unknown/0'... Finished (00:00:00)
  Unmounting disk 'ade4a2d3-04c3-4038-9d81-5e1ddae727f1'... Finished (00:00:01)
  Deleting VM '44d3994e-5d18-4deb-82ea-46574557fa81'... Finished (00:00:08)
  Creating VM for instance 'bosh/0' from stemcell 'f98f2308-b44d-4f97-b44c-afbb08a0c76e'... Finished (00:00:19)
  Waiting for the agent on VM '94d90385-1f64-4e22-8200-47ed4f1d8202' to be ready... Finished (00:00:41)
  Attaching disk 'ade4a2d3-04c3-4038-9d81-5e1ddae727f1' to VM '94d90385-1f64-4e22-8200-47ed4f1d8202'... Finished (00:00:10)
  Rendering job templates...

Any idea what is going on there?

[dpb587-pivotal]

Certainly strange. Does BOSH_INIT_LOG_LEVEL=debug provide any more details on where exactly it gets stuck? (logging link).

[jhiemer]

Yes interestingly it stops at Uploading blob a66bd4bc-7992-4221-6743-991a3969a8a9 from /root/.bosh_init/installations/88f387db-6488-494d-62be-1caef6df75c6/tmp/bosh-platform-disk-TarballCompressor-CompressFilesInDir955618712

Here are the full logs:

redacted

[dpb587-pivotal]

One thing you can double check is that you're using the correct IP address for the jobs[0].properties.agent.mbus - it should be your private IP address, not the floating IP.

I have edited your comment to remove your gist link - it included sensitive information. You should consider rotating those credentials and removing the source gist.