infra.aap_configuration collection in Automation Controller Version 4.6.6 (AAP 2.5c) intermittently buggy

[ericcames]

Summary

I am experiencing intermittent buggy behavior when running my F5 Setup playbook in AAP 2.5c Automation Controller Version 4.6.6. I can run the same playbook in Automation Controller Version 4.6.2 also on AAP 2.5c and things are working as expected.

When I run the job the outcome is always different and never successful.

I have also opened a ticket with the platform team. https://issues.redhat.com/browse/AAP-39349

Issue Type

• Bug Report

Ansible, Collection, Controller details

ansible [core 2.15.13]

---
collections:
  - name: f5networks.f5_modules
    version: 1.31.0
  - name: f5networks.f5_bigip
    version: 3.7.0
  - name: ansible.netcommon
    version: 7.1.0
  - name: ansible.posix
    version: 1.6.2
  - name: ansible.utils
    version: 5.1.2
  - name: ansible.platform
    version: 2.5.3
  - name: ansible.hub
    version: 1.0.0
  - name: ansible.controller
    version: 4.6.2
  - name: ansible.eda
    version: 2.2.0
  - name: infra.aap_configuration
    version: 3.1.0


Automation Controller Version 4.6.6

• ansible installation method: one of source

OS / ENVIRONMENT

Red Hat Enterprise Linux release 9.5 (Plow) running at AWS. The URL is aap.kona.services. Happy to screen share and show you what is happening.

Desired Behavior

My F5 daily demo should run successfully and be ready to demo to my customers. https://github.com/ericcames/aap.dailydemo.F5

Actual Behavior

Intermittent buggy behavior. No two runs ever turn out the same.

Please give some details of what is actually happening. Include a [minimum complete verifiable example] with:

Set this playbook up and run it. https://github.com/ericcames/aap.dailydemo.F5/blob/main/playbooks/setup_demo.yml

This is the playbook I am using to setup the playbook above. https://github.com/ericcames/aap.as.code/blob/main/playbooks/main.yml

218
failed: [localhost] (item=Create/Update Workflow workflow - 0 - Deploy web app on F5 in AWS | Wait for finish the workflow creation) => {"__workflows_job_async_results_item": {"__workflow_loop_item": {"name": "workflow - 0 - Deploy web app on F5 in AWS", "organization": "AmesCO", "related": {"workflow_nodes": [{"identifier": "workflow - F5-0-AWS Add custom profiles", "related": {"success_nodes": [{"identifier": "F5 -3- AWS -Add pool and members"}]}, "unified_job_template": {"name": "workflow - F5-0-AWS Add custom profiles", "organization": {"name": "AmesCO"}, "type": "workflow_job_template"}}, {"identifier": "F5 -3- AWS -Add pool and members", "related": {"success_nodes": [{"identifier": "F5 -4- AWS -Create VIP"}]}, "unified_job_template": {"name": "F5 -3- AWS -Add pool and members", "organization": {"name": "AmesCO"}, "type": "job_template"}}, {"identifier": "F5 -4- AWS -Create VIP", "unified_job_template": {"name": "F5 -4- AWS -Create VIP", "organization": {"name": "AmesCO"}, "type": "job_template"}…
219
failed: [localhost] (item=Create/Update Workflow workflow - F5-6-AWS delete custom profiles | Wait for finish the workflow creation) => {"__workflows_job_async_results_item": {"__workflow_loop_item": {"name": "workflow - F5-6-AWS delete custom profiles", "organization": "AmesCO", "related": {"workflow_nodes": [{"identifier": "F5 -6- AWS -Delete custom clientssl", "related": {"success_nodes": [{"identifier": "F5 -6- AWS -Delete custom HTTP profile"}]}, "unified_job_template": {"name": "F5 -6- AWS -Delete custom clientssl", "organization": {"name": "AmesCO"}, "type": "job_template"}}, {"identifier": "F5 -6- AWS -Delete custom HTTP profile", "related": {"success_nodes": [{"identifier": "F5 -6- AWS -Delete custom TCP profile"}]}, "unified_job_template": {"name": "F5 -6- AWS -Delete custom HTTP profile", "organization": {"name": "AmesCO"}, "type": "job_template"}}, {"identifier": "F5 -6- AWS -Delete custom TCP profile", "related": {"success_nodes": [{"identifier": "F5 -6- AWS -Delete certificate and key"}]…
220
ok: [localhost] => (item=Create/Update Workflow workflow - 6 - Remove web app from F5 on AWS | Wait for finish the workflow creation)




TASK [infra.aap_configuration.controller_credentials : Managing Controller Credentials | Wait for finish the credential management] ***  
8:46:41 AM
111
Friday 24 January 2025  15:46:41 +0000 (0:00:00.028)       0:00:02.363 ******** 
112
FAILED - RETRYING: [localhost]: Managing Controller Credentials | Wait for finish the credential management (60 retries left).
113
failed: [localhost] (item=None) => {"attempts": 2, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
114
changed: [localhost] => (item=None)
115
fatal: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true}
116


192
ok: [localhost] => (item=Create/Update Job Template {'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j748656454850.451', 'results_file': '/home/runner/.ansible_async/j748656454850.451', 'changed': False, '__controller_template_item': {'name': 'F5 -6- AWS -Delete custom clientssl', 'job_type': 'run', 'inventory': 'AAP Managed Inventory', 'organization': 'AmesCO', 'execution_environment': 'F5_ee', 'project': 'mlowcher_F5_examples', 'playbook': '2_client_ssl_profile.yml', 'credentials': ['Daily Demo F5 Network'], 'survey_enabled': True, 'survey': {'name': 'F5-6-AWS-Delete_custom_clientssl', 'description': 'Basic Survey', 'spec': [{'question_description': '', 'min': 0, 'default': 'cool_clientssl', 'max': 1024, 'required': True, 'choices': '', 'new_question': True, 'variable': 'profile_name', 'question_name': 'Provide a name for the clientssl profile', 'type': 'text'}, {'question_description': '', 'min': 0, 'default': 'absent', 'max': 0, 'required': True, 'choices': 'present\nabsent', 'new_que…
193
ok: [localhost] => (item=Create/Update Job Template {'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j845592274668.468', 'results_file': '/home/runner/.ansible_async/j845592274668.468', 'changed': False, '__controller_template_item': {'name': 'F5 -6- AWS -Delete custom HTTP profile', 'job_type': 'run', 'inventory': 'AAP Managed Inventory', 'organization': 'AmesCO', 'execution_environment': 'F5_ee', 'project': 'mlowcher_F5_examples', 'playbook': '2_create_http_profile.yml', 'credentials': ['Daily Demo F5 Network'], 'survey_enabled': True, 'survey': {'name': 'F5-6-AWS-Delete_custom_HTTP_profile', 'description': 'Basic Survey', 'spec': [{'question_description': '', 'min': 0, 'default': 'cool_http', 'max': 1024, 'required': True, 'choices': '', 'new_question': True, 'variable': 'profile_name', 'question_name': 'Provide a name for the HTTP profile', 'type': 'text'}, {'question_description': '', 'min': 0, 'default': 'absent', 'max': 0, 'required': True, 'choices': 'present\nabsent', 'new_questi…
194
ok: [localhost] => (item=Create/Update Job Template {'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j479158126066.485', 'results_file': '/home/runner/.ansible_async/j479158126066.485', 'changed': False, '__controller_template_item': {'name': 'F5 -7- AWS -Change admin password', 'job_type': 'run', 'inventory': 'AAP Managed Inventory', 'organization': 'AmesCO', 'execution_environment': 'F5_ee', 'project': 'mlowcher_F5_examples', 'playbook': 'change_admin_passwd.yml', 'credentials': ['Daily Demo F5 Network'], 'survey_enabled': True, 'survey': {'name': 'F5-7-Change_admin_password', 'description': 'Basic Survey', 'spec': [{'question_description': '', 'min': 0, 'default': '', 'max': 1024, 'required': True, 'choices': '', 'new_question': True, 'variable': 'new_pass', 'question_name': 'Enter new password', 'type': 'password'}]}}, 'ansible_loop_var': '__controller_template_item'} | Wait for finish the Job Template creation)
195
changed: [localhost] => (item=Create/Update Job Template {'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j79914166126.502', 'results_file': '/home/runner/.ansible_async/j79914166126.502', 'changed': False, '__controller_template_item': {'name': 'Daily Demo F5 Create/Remove', 'job_type': 'run', 'inventory': 'AAP Managed Inventory', 'organization': 'AmesCO', 'execution_environment': 'Default execution environment', 'project': 'aap.dailydemo.F5', 'playbook': 'playbooks/main.yml', 'ask_tags_on_launch': True, 'job_tags': 'create,remove', 'credentials': ['Daily Demo F5', 'AWS Blank Open Environment pvwk8', 'aap.kona.services'], 'survey_enabled': True, 'survey': {'name': 'Basic Survey', 'description': 'Basic Survey', 'spec': [{'question_description': 'Setting the admin password', 'min': 0, 'default': 'PASSWORD', 'max': 1024, 'required': True, 'choices': '', 'new_question': True, 'variable': 'password', 'question_name': 'What is your admin password?', 'type': 'password'}]}}, 'ansible_loop_var':…
196

STEPS TO REPRODUCE

Set this playbook up and run it. https://github.com/ericcames/aap.dailydemo.F5/blob/main/playbooks/setup_demo.yml

This is the playbook I am using to setup the playbook above. https://github.com/ericcames/aap.as.code/blob/main/playbooks/main.yml