Configurable wait_interval

[GLStephen]

Environments

• fluentd version: 14
• plugin version: 1.0.0

I'm considering making wait_interval configurable in the version of fluent-plugin-bigquery that I am using. The current wait time for jobs is too short and my debug view is very very chatty. Would you like a PR for this?

[joker1007]

I see. It's reasonable!! Welcome PR 👍

[GLStephen]

@joker1007 I am seeing instances where even with the default 10 second sleep this code will be called every 1 second.

until _response.status.state == "DONE"
          log.debug "wait for load job finish", state: _response.status.state, job_id: _response.job_reference.job_id
          sleep wait_interval
          _response = client.get_job(project, _response.job_reference.job_id)
        end

I was exploring extending the time, but there seems to be something else waking up the thread constantly.