Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect sudo password when running [singleplatform-eng.users : Per-user group creation] on the seed VM #65

Open
Banshee1221 opened this issue Oct 7, 2020 · 13 comments

Comments

@Banshee1221
Copy link

Banshee1221 commented Oct 7, 2020

Hello,

This seems to apply to stable/train and stable/rocky.

I have a bare-metal server that I'm trying to run UFN on. I have a stock CentOS 7.8 install and have created a centos user with NOPASSWD set for sudo access and the centos user does have a password set.

Everything seems to run fine up to the point where the seed VM is accessed in ./dev/seed-deploy.sh. I originally struggled with "Timeout (12s) waiting for privilege escalation prompt:", but after adjusting the timeout I'm now faced with "Incorrect sudo password." I can't access the VM via ssh from the centos user either. I've also tried this with ANSIBLE_BECOME_ASK_PASS=1.

Any ideas?

Here's a dump of that last action with ANSIBLE_DEBUG=1:

PLAY [Ensure the Kayobe Ansible user account exists] **************************************************************************************************************************************************************
 12775 1602069361.70388: Loading StrategyModule 'linear' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/strategy/linear.py (found_in_cache=True, class_only=False)
 12775 1602069361.70439: getting the remaining hosts for this loop
 12775 1602069361.70451: done getting the remaining hosts for this loop
 12775 1602069361.70464: building list of next tasks for hosts
 12775 1602069361.70473: getting the next task for host seed
 12775 1602069361.70483: done getting next task for host seed
 12775 1602069361.70491:  ^ task is: TASK: Gathering Facts
 12775 1602069361.70499:  ^ state is: HOST STATE: block=0, task=0, rescue=0, always=0, run_state=ITERATING_SETUP, fail_state=FAILED_NONE, pending_setup=True, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602069361.70507: done building task lists
 12775 1602069361.70512: counting tasks in each state of execution
 12775 1602069361.70519: done counting tasks in each state of execution:
        num_setups: 1
        num_tasks: 0
        num_rescue: 0
        num_always: 0
 12775 1602069361.70532: advancing hosts in ITERATING_SETUP
12775 1602069361.70538: starting to advance hosts
 12775 1602069361.70545: getting the next task for host seed
 12775 1602069361.70554: done getting next task for host seed
 12775 1602069361.70562:  ^ task is: TASK: Gathering Facts
 12775 1602069361.70570:  ^ state is: HOST STATE: block=0, task=0, rescue=0, always=0, run_state=ITERATING_SETUP, fail_state=FAILED_NONE, pending_setup=True, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602069361.70578: done advancing hosts to next task
 12775 1602069361.70633: Loading ActionModule 'gather_facts' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/action/gather_facts.py (found_in_cache=False, class_only=True)
 12775 1602069361.70642: getting variables
 12775 1602069361.70649: in VariableManager get_vars()
 12775 1602069361.70701: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 12775 1602069361.70710: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 12775 1602069361.70720: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 12775 1602069361.70729: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 12775 1602069361.70824: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 12775 1602069361.70834: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 12775 1602069361.70843: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 12775 1602069361.70852: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 12775 1602069361.70860: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 12775 1602069361.70869: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 12775 1602069361.70878: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 12775 1602069361.70887: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 12775 1602069361.70896: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 12775 1602069361.70904: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 12775 1602069361.70912: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 12775 1602069361.71027: Calling all_inventory to load vars for seed
 12775 1602069361.71037: Calling groups_inventory to load vars for seed
 12775 1602069361.71051: Calling all_plugins_inventory to load vars for seed
 12775 1602069361.71080: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602069361.71109: Calling all_plugins_play to load vars for seed
 12775 1602069361.71133: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602069361.71159: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/bifrost
 12775 1602069361.71172: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/bmc
 12775 1602069361.71186: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ceph
 12775 1602069361.71199: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/compute
 12775 1602069361.71212: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/controllers
 12775 1602069361.71225: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dell-switch-bmp
 12775 1602069361.71238: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dnf
 12775 1602069361.71251: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dns
 12775 1602069361.71264: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/docker
 12775 1602069361.71277: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/docker-registry
 12775 1602069361.71290: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/globals
 12775 1602069361.71303: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/grafana
 12775 1602069361.71316: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/idrac
 12775 1602069361.71329: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/inspector
 12775 1602069361.71342: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ipa
 12775 1602069361.71357: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ironic
 12775 1602069361.71371: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/kolla
 12775 1602069361.71389: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/monasca
 12775 1602069361.71404: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/monitoring
 12775 1602069361.71419: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/network
 12775 1602069361.71434: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/neutron
 12775 1602069361.71449: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/nova
 12775 1602069361.71464: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ntp
 12775 1602069361.71479: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/opensm
 12775 1602069361.71494: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/openstack
 12775 1602069361.71509: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/overcloud
 12775 1602069361.71524: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/pip
 12775 1602069361.71538: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed
 12775 1602069361.71553: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed-hypervisor
 12775 1602069361.71568: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed-vm
 12775 1602069361.71584: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ssh
 12775 1602069361.71599: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/storage
 12775 1602069361.71614: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/swift
 12775 1602069361.71630: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/arista
 12775 1602069361.71647: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/config
 12775 1602069361.71663: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/dell
 12775 1602069361.71680: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/dell-powerconnect
 12775 1602069361.71696: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/junos
 12775 1602069361.71712: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/mellanox
 12775 1602069361.71727: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/users
 12775 1602069361.71743: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/yum
 12775 1602069361.71759: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/yum-cron
 12775 1602069361.71780: Calling groups_plugins_inventory to load vars for seed
 12775 1602069361.71806: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602069361.71878: Loading data from /home/centos/kayobe/config/src/kayobe-config/etc/kayobe/inventory/group_vars/seed/ansible-python-interpreter
 12775 1602069361.71891: Loading data from /home/centos/kayobe/config/src/kayobe-config/etc/kayobe/inventory/group_vars/seed/network-interfaces
 12775 1602069361.71907: Calling groups_plugins_play to load vars for seed
 12775 1602069361.71933: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602069361.71989: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/ansible-host
 12775 1602069361.72001: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/ansible-user
 12775 1602069361.72013: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/lvm
 12775 1602069361.72024: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/mdadm
 12775 1602069361.72036: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/network
 12775 1602069361.72047: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/sysctl
 12775 1602069361.72059: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/users
 12775 1602069361.72097: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602069361.72141: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602069361.72280: done with get_vars()
 12775 1602069361.72303: done getting variables
 12775 1602069361.72313: sending task start callback, copying the task so we can template it temporarily
 12775 1602069361.72321: done copying, going to template now
 12775 1602069361.72329: done templating
 12775 1602069361.72335: here goes the callback...

TASK [Gathering Facts] ********************************************************************************************************************************************************************************************
 12775 1602069361.72352: sending task start callback
 12775 1602069361.72360: entering _queue_task() for seed/gather_facts
 12775 1602069361.72367: Creating lock for gather_facts
 12775 1602069361.72524: worker is 1 (out of 1 available)
 12775 1602069361.72573: exiting _queue_task() for seed/gather_facts
 12775 1602069361.72705: done queuing things up, now waiting for results queue to drain
 12775 1602069361.72716: waiting for pending results...
 13543 1602069361.72889: running TaskExecutor() for seed/TASK: Gathering Facts
 13543 1602069361.73049: in run() - task 848f69fe-4727-ca6b-d252-00000000005d
 13543 1602069361.73179: calling self._execute()
 13543 1602069361.73727: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 13543 1602069361.73746: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 13543 1602069361.73766: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 13543 1602069361.73787: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 13543 1602069361.74149: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 13543 1602069361.74165: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 13543 1602069361.74182: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 13543 1602069361.74199: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 13543 1602069361.74217: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 13543 1602069361.74232: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 13543 1602069361.74247: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 13543 1602069361.74263: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 13543 1602069361.74281: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 13543 1602069361.74296: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 13543 1602069361.74309: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 13543 1602069361.75287: trying /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/connection
 13543 1602069361.75458: Loading Connection 'ssh' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/connection/ssh.py (found_in_cache=True, class_only=False)
 13543 1602069361.75493: trying /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/shell
 13543 1602069361.75544: Loading ShellModule 'sh' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/shell/sh.py (found_in_cache=True, class_only=False)
 13543 1602069361.75567: Loading ShellModule 'sh' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/shell/sh.py (found_in_cache=True, class_only=False)
 13543 1602069361.75887: Loading ActionModule 'gather_facts' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/action/gather_facts.py (found_in_cache=True, class_only=False)
 13543 1602069361.75912: starting attempt loop
 13543 1602069361.75922: running the handler
 13543 1602069361.75973: _low_level_execute_command(): starting
 13543 1602069361.75994: _low_level_execute_command(): executing: /bin/sh -c 'echo ~centos && sleep 0'
 13543 1602069547.30998: stdout chunk (state=2):
>>>/home/centos
<<<

 13543 1602069547.40082: stdout chunk (state=3):
>>><<<

 13543 1602069547.40100: stderr chunk (state=3):
>>><<<

 13543 1602069547.40129: _low_level_execute_command() done: rc=0, stdout=/home/centos
, stderr=
 13543 1602069547.40151: _low_level_execute_command(): starting
 13543 1602069547.40161: _low_level_execute_command(): executing: /bin/sh -c '( umask 77 && mkdir -p "` echo /home/centos/.ansible/tmp `"&& mkdir /home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421 && echo ansible-tmp-1602069547.4-13543-134158360891421="` echo 
/home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421 `" ) && sleep 0'
 13543 1602069628.76756: stdout chunk (state=2):
>>>ansible-tmp-1602069547.4-13543-134158360891421=/home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421
<<<

 13543 1602069628.86428: stdout chunk (state=3):
>>><<<

 13543 1602069628.86445: stderr chunk (state=3):
>>><<<

 13543 1602069547.40129: _low_level_execute_command() done: rc=0, stdout=/home/centos
, stderr=
 13543 1602069547.40151: _low_level_execute_command(): starting
 13543 1602069547.40161: _low_level_execute_command(): executing: /bin/sh -c '( umask 77 && mkdir -p "` echo /home/centos/.ansible/tmp `"&& mkdir /home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421 && echo ansible-tmp-1602069547.4-13543-134158360891421="` echo 
/home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421 `" ) && sleep 0'
 13543 1602069628.76756: stdout chunk (state=2):
>>>ansible-tmp-1602069547.4-13543-134158360891421=/home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421
<<<

 13543 1602069628.86428: stdout chunk (state=3):
>>><<<

 13543 1602069628.86445: stderr chunk (state=3):
>>><<<

 13543 1602069628.86474: _low_level_execute_command() done: rc=0, stdout=ansible-tmp-1602069547.4-13543-134158360891421=/home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421
, stderr=
 13543 1602069628.86551: ANSIBALLZ: Using lock for setup
 13543 1602069628.86556: ANSIBALLZ: Acquiring lock
 13543 1602069628.86563: ANSIBALLZ: Lock acquired: 139957566327056
 13543 1602069628.86569: ANSIBALLZ: Creating module
 13543 1602069629.23639: ANSIBALLZ: Writing module
 13543 1602069629.23678: ANSIBALLZ: Renaming module
 13543 1602069629.23689: ANSIBALLZ: Done creating module
 13543 1602069629.23901: transferring module to remote /home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421/AnsiballZ_setup.py
 13543 1602069629.24745: Sending initial data
 13543 1602069629.24760: Sent initial data (158 bytes)
 13543 1602069710.04786: stdout chunk (state=3):
>>>sftp> put /home/centos/.ansible/tmp/ansible-local-12775RrbMvE/tmpVZfMp3 /home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421/AnsiballZ_setup.py
<<<

 13543 1602069710.11764: stdout chunk (state=3):
>>><<<

 13543 1602069710.11783: stderr chunk (state=3):
>>><<<

 13543 1602069710.11817: done transferring module to remote
 13543 1602069710.11842: _low_level_execute_command(): starting
 13543 1602069710.11853: _low_level_execute_command(): executing: /bin/sh -c 'chmod u+x /home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421/ /home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421/AnsiballZ_setup.py && sleep 0'
 13543 1602069791.44725: stdout chunk (state=2):
>>><<<

 13543 1602069791.44749: stderr chunk (state=2):
>>><<<

 13543 1602069791.44781: _low_level_execute_command() done: rc=0, stdout=, stderr=
 13543 1602069791.44788: _low_level_execute_command(): starting
 13543 1602069791.44802: _low_level_execute_command(): executing: /bin/sh -c '/usr/libexec/platform-python /home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421/AnsiballZ_setup.py && sleep 0'
 13543 1602069921.74700: stdout chunk (state=2):
>>>
{"invocation": {"module_args": {"filter": "*", "gather_subset": ["all"], "fact_path": "/etc/ansible/facts.d", "gather_timeout": 10}}, "ansible_facts": {"ansible_product_serial": "NA", "ansible_form_factor": "Other", "ansible_product_version": "pc-i440fx-2.0", "ansible_fips": false, "ansible_service_mgr": "systemd", "ansible_fibre_channel_wwn": [], "ansible_selinux_python_present": true, "ansible_userspace_bits": "64", "gather_subset": ["all"], "ansible_system_capabilities_enforced": "True", "ansible_domain": "", "ansible_distribution_version": "7.8", "ansible_local": {}, "ansible_distribution_file_path": "/etc/redhat-release", "ansible_user_shell": "/bin/bash", "ansible_virtualization_type": "kvm", "ansible_real_user_id": 1000, "ansible_processor_cores": 1, "ansible_virtualization_role": "guest", "ansible_distribution_file_variety": "RedHat", "ansible_dns": {"nameservers": ["8.8.8.8", "8.8.4.4"]}, "ansible_effective_group_id": 1000, "ansible_bios_version": "0.5.1", "ansible_processor": ["0", "GenuineIntel", "Intel Xeon E312xx (Sandy Bridge)"], "ansible_date_time": {"weekday_number": "3", "iso8601_basic_short": "20201007T112520", "tz": "UTC", "weeknumber": "40", "hour": "11", "year": "2020", "minute": "25", "tz_offset": "+0000", "month": "10", "epoch": "1602069920", "iso8601_micro": "2020-10-07T11:25:21.002766Z", "weekday": "Wednesday", "time": "11:25:20", "date": "2020-10-07", "iso8601": "2020-10-07T11:25:21Z", "day": "07", "iso8601_basic": "20201007T112520996458", "second": "20"}, "ansible_lo": {"features": {"tx_checksum_ipv4": "off [fixed]", "generic_receive_offload": "on", "tx_checksum_ipv6": "off [fixed]", "tx_scatter_gather_fraglist": "on [fixed]", "rx_all": "off [fixed]", "highdma": "on [fixed]", "rx_fcs": "off [fixed]", "tx_lockless": "on [fixed]", "tx_tcp_ecn_segmentation": "on", "rx_udp_tunnel_port_offload": "off [fixed]", "tx_tcp6_segmentation": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "on", "tx_checksumming": "on", "vlan_challenged": <<<

 13543 1602069921.76095: stdout chunk (state=3):
>>>"on [fixed]", "loopback": "on [fixed]", "fcoe_mtu": "off [fixed]", "scatter_gather": "on", "tx_checksum_sctp": "on [fixed]", "tx_vlan_stag_hw_insert": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "tx_gso_partial": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_vlan_stag_filter": "off [fixed]", "large_receive_offload": "off [fixed]", "tx_scatter_gather": "on [fixed]", "rx_checksumming": "on [fixed]", "tx_tcp_segmentation": "on", "netns_local": "on [fixed]", "busy_poll": "off [fixed]", "generic_segmentation_offload": "on", "tx_udp_tnl_segmentation": "off [fixed]", "tcp_segmentation_offload": "on", "l2_fwd_offload": "off [fixed]", "rx_vlan_offload": "off [fixed]", "ntuple_filters": "off [fixed]", "tx_gre_csum_segmentation": "off [fixed]", "tx_nocache_copy": "off [fixed]", "tx_udp_tnl_csum_segmentation": "off [fixed]", "udp_fragmentation_offload": "on", "tx_sctp_segmentation": "on", "tx_sit_segmentation": "off [fixed]", "tx_checksum_fcoe_crc": "off [fixed]", "hw_tc_offload": "off [fixed]", "tx_checksum_ip_generic": "on [fixed]", "tx_fcoe_segmentation": "off [fixed]", "rx_vlan_filter": "off [fixed]", "tx_vlan_offload": "off [fixed]", "receive_hashing": "off [fixed]", "tx_gre_segmentation": "off [fixed]"}, "hw_timestamp_filters": [], "mtu": 65536, "device": "lo", "promisc": false, "timestamping": ["rx_software", "software"], "ipv4": {"broadcast": "host", "netmask": "255.0.0.0", "network": "127.0.0.0", "address": "127.0.0.1"}, "ipv6": [{"scope": "host", "prefix": "128", "address": "::1"}], "active": true, "type": "loopback"}, "ansible_memtotal_mb": 3789, "ansible_architecture": "x86_64", "ansible_device_links": {"masters": {}, "labels": {"sr0": ["config-2"]}, "ids": {"sr0": ["ata-QEMU_DVD-ROM_QM00009"]}, "uuids": {"sr0": ["2020-10-07-08-12-39-00"], "vda1": ["6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02"]}}, "ansible_default_ipv4": {"macaddress": "52:54:00:c9:8b:6b", "network": "192.168.33.0", "mtu": 1450, "broadcast": "192.168.33.255", "alias": "eth0", "netmask": "255.255.255.0", "address": "192.168.33.5", "interface": "eth0", "type": "ether", "gateway": "192.168.33.4"}, "ansible_swapfree_mb": 0, "ansible_default_ipv6": {}, "ansible_mounts": [{"block_used": 217498, "uuid": "6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02", "size_total": 53675536384, "block_total": 13104379, "mount": "/", "block_available": 12886881, "size_available": 52784664576, "fstype": "xfs", "inode_total": 26213872, "options": "rw,seclabel,relatime,attr2,inode64,noquota", "device": "/dev/vda1", "inode_used": 25687, "block_size": 4096, "inode_available": 26188185}], "ansible_system_vendor": "QEMU", "ansible_apparmor": {"status": "disabled"}, "ansible_cmdline": {"LANG": "en_US.UTF-8", "console": "ttyS0", "net.ifnames": "0", "crashkernel": "auto", "BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1127.el7.x86_64", "ro": true, "root": "UUID=6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02"}, "ansible_effective_user_id": 1000, "ansible_distribution_release": "Core", "ansible_user_gid": 1000, "ansible_selinux": {"status": "enabled", "policyvers": 31, "type": "targeted", "mode": "enforcing", "config_mode": "enforcing"}, "ansible_distribution_file_parsed": true, "ansible_os_family": "RedHat", "ansible_userspace_architecture": "x86_64", "ansible_bios_date": "01/01/2011", "ansible_product_uuid": "NA", "ansible_fqdn": "seed", "ansible_system": "Linux", "ansible_pkg_mgr": "yum", "ansible_memfree_mb": 3465, "ansible_devices": {"vda": {"scheduler_mode": "mq-deadline", "rotational": "1", "vendor": "0x1af4", "sectors": "104857600", "links": {"masters": [], "labels": [], "ids": [], "uuids": []}, "sas_device_handle": null, "sas_address": null, "virtual": 1, "host": "", "sectorsize": "512", "removable": "0", "support_discard": "0", "model": null, "partitions": {"vda1": {"sectorsize": 512, "uuid": "6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02", "links": {"masters": [], "labels": [], "ids": [], "uuids": ["6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02"]}, "sectors": "104855519", "start": "2048", "holders": [], "size": "50.00 GB"}}, "holders": [], "size": "50.00 GB"}, "sr0": {"scheduler_mode": "deadline", "rotational": "1", "ven<<<

 13543 1602069921.76300: stdout chunk (state=3):
>>>dor": "QEMU", "sectors": "752", "links": {"masters": [], "labels": ["config-2"], "ids": ["ata-QEMU_DVD-ROM_QM00009"], "uuids": ["2020-10-07-08-12-39-00"]}, "sas_device_handle": null, "sas_address": null, "virtual": 1, "host": "", "sectorsize": "2048", "removable": "1", "support_discard": "0", "model": "QEMU DVD-ROM", "partitions": {}, "holders": [], "size": "376.00 KB"}, "vdb": {"scheduler_mode": "mq-deadline", "rotational": "1", "vendor": "0x1af4", "sectors": "209715200", "links": {"masters": [], "labels": [], "ids": [], "uuids": []}, "sas_device_handle": null, "sas_address": null, "virtual": 1, "host": "", "sectorsize": "512", "removable": "0", "support_discard": "0", "model": null, "partitions": {}, "holders": [], "size": "100.00 GB"}}, "ansible_user_uid": 1000, "ansible_user_id": "centos", "ansible_distribution": "CentOS", "ansible_user_dir": "/home/centos", "ansible_env": {"LANG": "en_ZA.UTF-8", "TERM": "screen", "SHELL": "/bin/bash", "XDG_RUNTIME_DIR": "/run/user/1000", "SHLVL": "2", "SSH_TTY": "/dev/pts/0", "_": "/usr/libexec/platform-python", "LESSOPEN": "||/usr/bin/lesspipe.sh %s", "PWD": "/home/centos", "SELINUX_LEVEL_REQUESTED": "", "PATH": "/usr/local/bin:/usr/bin", "SELINUX_ROLE_REQUESTED": "", "SELINUX_USE_CURRENT_RANGE": "", "LOGNAME": "centos", "USER": "centos", "HOME": "/home/centos", "MAIL": "/var/mail/centos", "LS_COLORS": "rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:", "XDG_SESSION_ID": "8", "SSH_CLIENT": "192.168.33.4 38808 22", "SSH_CONNECTION": "192.168.33.4 38808 192.168.33.5 22"}, "ansible_distribution_major_version": "7", "module_setup": true, "ansible_iscsi_iqn": "", "ansible_hostname": "seed", "ansible_processor_vcpus": 1, "ansible_processor_count": 1, "ansible_swaptotal_mb": 0, "ansible_lsb": {}, "ansible_real_group_id": 1000, "ansible_proc_cmdline": {"LANG": "en_US.UTF-8", "console": ["tty0", "ttyS0,115200n8", "ttyS0"], "net.ifnames": "0", "crashkernel": "auto", "BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1127.el7.x86_64", "ro": true, "root": "UUID=6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02"}, "ansible_all_ipv6_addresses": ["fe80::5054:ff:fec9:8b6b"], "ansible_interfaces": ["lo", "eth0"], "ansible_uptime_seconds": 11299, "ansible_machine_id": "cab9605edaa5484da7c2f02b8fd10762", "ansible_ssh_host_key_rsa_public": "AAAAB3NzaC1yc2EAAAADAQABAAABAQC/JjBoJX1i3lc4VyqatVa7wkLNJisem0bv13Ufr0rxNgIgOEIiS2keX3FMGylMsgAc4Ni5vODDGKzn60EYnMmttnyAxpi+TjeGob1z9e0DjKcx3QHPNhpGTYjjX2QfyLWaJpBQ7TI4x0AZx3KkSebI9fjEgk/xCd6Dh91b/o0yPQ/7DVIUILmL+4AECgxs8ZCFoGZk4cXf4im0U01hQ2lKYsMqdlSZIlBLzvYnhme/t9sWCmhL2hLW6xbsKKJlOuqrQONtAA2pEhU3vpK0lYsydlHPUqY4D3Mso+fk7QcHO3rAaPNAvoLxTbX6vUHc3bKe9IYar9+4jI52IyjG1Q7R", "ansible_memory_mb": {"real": {"total": 3789, "used": 324, "free": 346<<<

 13543 1602069921.76436: stdout chunk (state=3):
>>>5}, "swap": {"cached": 0, "total": 0, "free": 0, "used": 0}, "nocache": {"used": 146, "free": 3643}}, "ansible_user_gecos": "Cloud User", "ansible_system_capabilities": [""], "ansible_python": {"executable": "/usr/libexec/platform-python", "version": {"micro": 5, "major": 2, "releaselevel": "final", "serial": 0, "minor": 7}, "type": "CPython", "has_sslcontext": true, "version_info": [2, 7, 5, "final", 0]}, "ansible_kernel": "3.10.0-1127.el7.x86_64", "ansible_processor_threads_per_core": 1, "ansible_is_chroot": true, "ansible_hostnqn": "", "ansible_eth0": {"macaddress": "52:54:00:c9:8b:6b", "features": {"tx_checksum_ipv4": "off [fixed]", "generic_receive_offload": "on", "tx_checksum_ipv6": "off [fixed]", "tx_scatter_gather_fraglist": "off [fixed]", "rx_all": "off [fixed]", "highdma": "on [fixed]", "rx_fcs": "off [fixed]", "tx_lockless": "off [fixed]", "tx_tcp_ecn_segmentation": "on", "rx_udp_tunnel_port_offload": "off [fixed]", "tx_tcp6_segmentation": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_checksumming": "on", "vlan_challenged": "off [fixed]", "loopback": "off [fixed]", "fcoe_mtu": "off [fixed]", "scatter_gather": "on", "tx_checksum_sctp": "off [fixed]", "tx_vlan_stag_hw_insert": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "tx_gso_partial": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_vlan_stag_filter": "off [fixed]", "large_receive_offload": "off [fixed]", "tx_scatter_gather": "on", "rx_checksumming": "on [fixed]", "tx_tcp_segmentation": "on", "netns_local": "off [fixed]", "busy_poll": "off [fixed]", "generic_segmentation_offload": "on", "tx_udp_tnl_segmentation": "off [fixed]", "tcp_segmentation_offload": "on", "l2_fwd_offload": "off [fixed]", "rx_vlan_offload": "off [fixed]", "ntuple_filters": "off [fixed]", "tx_gre_csum_segmentation": "off [fixed]", "tx_nocache_copy": "off", "tx_udp_tnl_csum_segmentation": "off [fixed]", "udp_fragmentation_offload": "on", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "off [fixed]", "tx_checksum_fcoe_crc": "off [fixed]", "hw_tc_offload": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_fcoe_segmentation": "off [fixed]", "rx_vlan_filter": "on [fixed]", "tx_vlan_offload": "off [fixed]", "receive_hashing": "off [fixed]", "tx_gre_segmentation": "off [fixed]"}, "pciid": "virtio0", "module": "virtio_net", "mtu": 1450, "device": "eth0", "promisc": false, "timestamping": ["rx_software", "software"], "ipv4": {"broadcast": "192.168.33.255", "netmask": "255.255.255.0", "network": "192.168.33.0", "address": "192.168.33.5"}, "ipv6": [{"scope": "link", "prefix": "64", "address": "fe80::5054:ff:fec9:8b6b"}], "active": true, "type": "ether", "hw_timestamp_filters": []}, "ansible_python_version": "2.7.5", "ansible_product_name": "Standard PC (i440FX + PIIX, 1996)", "ansible_machine": "x86_64", "ansible_all_ipv4_addresses": ["192.168.33.5"], "ansible_nodename": "seed"}}
<<<

 13543 1602069922.02614: stderr chunk (state=3):
>>>Shared connection to 192.168.33.5 closed.
<<<

 13543 1602069922.02654: stdout chunk (state=3):
>>><<<

 13543 1602069922.02663: stderr chunk (state=3):
>>><<<

 13543 1602069922.02703: _low_level_execute_command() done: rc=0, stdout=
{"invocation": {"module_args": {"filter": "*", "gather_subset": ["all"], "fact_path": "/etc/ansible/facts.d", "gather_timeout": 10}}, "ansible_facts": {"ansible_product_serial": "NA", "ansible_form_factor": "Other", "ansible_product_version": "pc-i440fx-2.0", "ansible_fips": false, "ansible_service_mgr": "systemd", "ansible_fibre_channel_wwn": [], "ansible_selinux_python_present": true, "ansible_userspace_bits": "64", "gather_subset": ["all"], "ansible_system_capabilities_enforced": "True", "ansible_domain": "", "ansible_distribution_version": "7.8", "ansible_local": {}, "ansible_distribution_file_path": "/etc/redhat-release", "ansible_user_shell": "/bin/bash", "ansible_virtualization_type": "kvm", "ansible_real_user_id": 1000, "ansible_processor_cores": 1, "ansible_virtualization_role": "guest", "ansible_distribution_file_variety": "RedHat", "ansible_dns": {"nameservers": ["8.8.8.8", "8.8.4.4"]}, "ansible_effective_group_id": 1000, "ansible_bios_version": "0.5.1", "ansible_processor": ["0", "GenuineIntel", "Intel Xeon E312xx (Sandy Bridge)"], "ansible_date_time": {"weekday_number": "3", "iso8601_basic_short": "20201007T112520", "tz": "UTC", "weeknumber": "40", "hour": "11", "year": "2020", "minute": "25", "tz_offset": "+0000", "month": "10", "epoch": "1602069920", "iso8601_micro": "2020-10-07T11:25:21.002766Z", "weekday": "Wednesday", "time": "11:25:20", "date": "2020-10-07", "iso8601": "2020-10-07T11:25:21Z", "day": "07", "iso8601_basic": "20201007T112520996458", "second": "20"}, "ansible_lo": {"features": {"tx_checksum_ipv4": "off [fixed]", "generic_receive_offload": "on", "tx_checksum_ipv6": "off [fixed]", "tx_scatter_gather_fraglist": "on [fixed]", "rx_all": "off [fixed]", "highdma": "on [fixed]", "rx_fcs": "off [fixed]", "tx_lockless": "on [fixed]", "tx_tcp_ecn_segmentation": "on", "rx_udp_tunnel_port_offload": "off [fixed]", "tx_tcp6_segmentation": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "on", "tx_checksumming": "on", "vlan_challenged": "on [fixed]", "loopback": "on [fixed]", "fcoe_mtu": "off [fixed]", "scatter_gather": "on", "tx_checksum_sctp": "on [fixed]", "tx_vlan_stag_hw_insert": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "tx_gso_partial": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_vlan_stag_filter": "off [fixed]", "large_receive_offload": "off [fixed]", "tx_scatter_gather": "on [fixed]", "rx_checksumming": "on [fixed]", "tx_tcp_segmentation": "on", "netns_local": "on [fixed]", "busy_poll": "off [fixed]", "generic_segmentation_offload": "on", "tx_udp_tnl_segmentation": "off [fixed]", "tcp_segmentation_offload": "on", "l2_fwd_offload": "off [fixed]", "rx_vlan_offload": "off [fixed]", "ntuple_filters": "off [fixed]", "tx_gre_csum_segmentation": "off [fixed]", "tx_nocache_copy": "off [fixed]", "tx_udp_tnl_csum_segmentation": "off [fixed]", "udp_fragmentation_offload": "on", "tx_sctp_segmentation": "on", "tx_sit_segmentation": "off [fixed]", "tx_checksum_fcoe_crc": "off [fixed]", "hw_tc_offload": "off [fixed]", "tx_checksum_ip_generic": "on [fixed]", "tx_fcoe_segmentation": "off [fixed]", "rx_vlan_filter": "off [fixed]", "tx_vlan_offload": "off [fixed]", "receive_hashing": "off [fixed]", "tx_gre_segmentation": "off [fixed]"}, "hw_timestamp_filters": [], "mtu": 65536, "device": "lo", "promisc": false, "timestamping": ["rx_software", "software"], "ipv4": {"broadcast": "host", "netmask": "255.0.0.0", "network": "127.0.0.0", "address": "127.0.0.1"}, "ipv6": [{"scope": "host", "prefix": "128", "address": "::1"}], "active": true, "type": "loopback"}, "ansible_memtotal_mb": 3789, "ansible_architecture": "x86_64", "ansible_device_links": {"masters": {}, "labels": {"sr0": ["config-2"]}, "ids": {"sr0": ["ata-QEMU_DVD-ROM_QM00009"]}, "uuids": {"sr0": ["2020-10-07-08-12-39-00"], "vda1": ["6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02"]}}, "ansible_default_ipv4": {"macaddress": "52:54:00:c9:8b:6b", "network": "192.168.33.0", "mtu": 1450, "broadcast": "192.168.33.255", "alias": "eth0", "netmask": "255.255.255.0", "address": "192.168.33.5", "interface": "eth0", "type": "ether", "gateway": "192.168.33.4"}, "ansible_swapfree_mb": 0, "ansible_default_ipv6": {}, "ansible_mounts": [{"block_used": 217498, "uuid": "6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02", "size_total": 53675536384, "block_total": 13104379, "mount": "/", "block_available": 12886881, "size_available": 52784664576, "fstype": "xfs", "inode_total": 26213872, "options": "rw,seclabel,relatime,attr2,inode64,noquota", "device": "/dev/vda1", "inode_used": 25687, "block_size": 4096, "inode_available": 26188185}], "ansible_system_vendor": "QEMU", "ansible_apparmor": {"status": "disabled"}, "ansible_cmdline": {"LANG": "en_US.UTF-8", "console": "ttyS0", "net.ifnames": "0", "crashkernel": "auto", "BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1127.el7.x86_64", "ro": true, "root": "UUID=6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02"}, "ansible_effective_user_id": 1000, "ansible_distribution_release": "Core", "ansible_user_gid": 1000, "ansible_selinux": {"status": "enabled", "policyvers": 31, "type": "targeted", "mode": "enforcing", "config_mode": "enforcing"}, "ansible_distribution_file_parsed": true, "ansible_os_family": "RedHat", "ansible_userspace_architecture": "x86_64", "ansible_bios_date": "01/01/2011", "ansible_product_uuid": "NA", "ansible_fqdn": "seed", "ansible_system": "Linux", "ansible_pkg_mgr": "yum", "ansible_memfree_mb": 3465, "ansible_devices": {"vda": {"scheduler_mode": "mq-deadline", "rotational": "1", "vendor": "0x1af4", "sectors": "104857600", "links": {"masters": [], "labels": [], "ids": [], "uuids": []}, "sas_device_handle": null, "sas_address": null, "virtual": 1, "host": "", "sectorsize": "512", "removable": "0", "support_discard": "0", "model": null, "partitions": {"vda1": {"sectorsize": 512, "uuid": "6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02", "links": {"masters": [], "labels": [], "ids": [], "uuids": ["6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02"]}, "sectors": "104855519", "start": "2048", "holders": [], "size": "50.00 GB"}}, "holders": [], "size": "50.00 GB"}, "sr0": {"scheduler_mode": "deadline", "rotational": "1", "vendor": "QEMU", "sectors": "752", "links": {"masters": [], "labels": ["config-2"], "ids": ["ata-QEMU_DVD-ROM_QM00009"], "uuids": ["2020-10-07-08-12-39-00"]}, "sas_device_handle": null, "sas_address": null, "virtual": 1, "host": "", "sectorsize": "2048", "removable": "1", "support_discard": "0", "model": "QEMU DVD-ROM", "partitions": {}, "holders": [], "size": "376.00 KB"}, "vdb": {"scheduler_mode": "mq-deadline", "rotational": "1", "vendor": "0x1af4", "sectors": "209715200", "links": {"masters": [], "labels": [], "ids": [], "uuids": []}, "sas_device_handle": null, "sas_address": null, "virtual": 1, "host": "", "sectorsize": "512", "removable": "0", "support_discard": "0", "model": null, "partitions": {}, "holders": [], "size": "100.00 GB"}}, "ansible_user_uid": 1000, "ansible_user_id": "centos", "ansible_distribution": "CentOS", "ansible_user_dir": "/home/centos", "ansible_env": {"LANG": "en_ZA.UTF-8", "TERM": "screen", "SHELL": "/bin/bash", "XDG_RUNTIME_DIR": "/run/user/1000", "SHLVL": "2", "SSH_TTY": "/dev/pts/0", "_": "/usr/libexec/platform-python", "LESSOPEN": "||/usr/bin/lesspipe.sh %s", "PWD": "/home/centos", "SELINUX_LEVEL_REQUESTED": "", "PATH": "/usr/local/bin:/usr/bin", "SELINUX_ROLE_REQUESTED": "", "SELINUX_USE_CURRENT_RANGE": "", "LOGNAME": "centos", "USER": "centos", "HOME": "/home/centos", "MAIL": "/var/mail/centos", "LS_COLORS": "rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:", "XDG_SESSION_ID": "8", "SSH_CLIENT": "192.168.33.4 38808 22", "SSH_CONNECTION": "192.168.33.4 38808 192.168.33.5 22"}, "ansible_distribution_major_version": "7", "module_setup": true, "ansible_iscsi_iqn": "", "ansible_hostname": "seed", "ansible_processor_vcpus": 1, "ansible_processor_count": 1, "ansible_swaptotal_mb": 0, "ansible_lsb": {}, "ansible_real_group_id": 1000, "ansible_proc_cmdline": {"LANG": "en_US.UTF-8", "console": ["tty0", "ttyS0,115200n8", "ttyS0"], "net.ifnames": "0", "crashkernel": "auto", "BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1127.el7.x86_64", "ro": true, "root": "UUID=6cd50e51-cfc6-40b9-9ec5-f32fa2e4ff02"}, "ansible_all_ipv6_addresses": ["fe80::5054:ff:fec9:8b6b"], "ansible_interfaces": ["lo", "eth0"], "ansible_uptime_seconds": 11299, "ansible_machine_id": "cab9605edaa5484da7c2f02b8fd10762", "ansible_ssh_host_key_rsa_public": "AAAAB3NzaC1yc2EAAAADAQABAAABAQC/JjBoJX1i3lc4VyqatVa7wkLNJisem0bv13Ufr0rxNgIgOEIiS2keX3FMGylMsgAc4Ni5vODDGKzn60EYnMmttnyAxpi+TjeGob1z9e0DjKcx3QHPNhpGTYjjX2QfyLWaJpBQ7TI4x0AZx3KkSebI9fjEgk/xCd6Dh91b/o0yPQ/7DVIUILmL+4AECgxs8ZCFoGZk4cXf4im0U01hQ2lKYsMqdlSZIlBLzvYnhme/t9sWCmhL2hLW6xbsKKJlOuqrQONtAA2pEhU3vpK0lYsydlHPUqY4D3Mso+fk7QcHO3rAaPNAvoLxTbX6vUHc3bKe9IYar9+4jI52IyjG1Q7R", "ansible_memory_mb": {"real": {"total": 3789, "used": 324, "free": 3465}, "swap": {"cached": 0, "total": 0, "free": 0, "used": 0}, "nocache": {"used": 146, "free": 3643}}, "ansible_user_gecos": "Cloud User", "ansible_system_capabilities": [""], "ansible_python": {"executable": "/usr/libexec/platform-python", "version": {"micro": 5, "major": 2, "releaselevel": "final", "serial": 0, "minor": 7}, "type": "CPython", "has_sslcontext": true, "version_info": [2, 7, 5, "final", 0]}, "ansible_kernel": "3.10.0-1127.el7.x86_64", "ansible_processor_threads_per_core": 1, "ansible_is_chroot": true, "ansible_hostnqn": "", "ansible_eth0": {"macaddress": "52:54:00:c9:8b:6b", "features": {"tx_checksum_ipv4": "off [fixed]", "generic_receive_offload": "on", "tx_checksum_ipv6": "off [fixed]", "tx_scatter_gather_fraglist": "off [fixed]", "rx_all": "off [fixed]", "highdma": "on [fixed]", "rx_fcs": "off [fixed]", "tx_lockless": "off [fixed]", "tx_tcp_ecn_segmentation": "on", "rx_udp_tunnel_port_offload": "off [fixed]", "tx_tcp6_segmentation": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_checksumming": "on", "vlan_challenged": "off [fixed]", "loopback": "off [fixed]", "fcoe_mtu": "off [fixed]", "scatter_gather": "on", "tx_checksum_sctp": "off [fixed]", "tx_vlan_stag_hw_insert": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "tx_gso_partial": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_vlan_stag_filter": "off [fixed]", "large_receive_offload": "off [fixed]", "tx_scatter_gather": "on", "rx_checksumming": "on [fixed]", "tx_tcp_segmentation": "on", "netns_local": "off [fixed]", "busy_poll": "off [fixed]", "generic_segmentation_offload": "on", "tx_udp_tnl_segmentation": "off [fixed]", "tcp_segmentation_offload": "on", "l2_fwd_offload": "off [fixed]", "rx_vlan_offload": "off [fixed]", "ntuple_filters": "off [fixed]", "tx_gre_csum_segmentation": "off [fixed]", "tx_nocache_copy": "off", "tx_udp_tnl_csum_segmentation": "off [fixed]", "udp_fragmentation_offload": "on", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "off [fixed]", "tx_checksum_fcoe_crc": "off [fixed]", "hw_tc_offload": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_fcoe_segmentation": "off [fixed]", "rx_vlan_filter": "on [fixed]", "tx_vlan_offload": "off [fixed]", "receive_hashing": "off [fixed]", "tx_gre_segmentation": "off [fixed]"}, "pciid": "virtio0", "module": "virtio_net", "mtu": 1450, "device": "eth0", "promisc": false, "timestamping": ["rx_software", "software"], "ipv4": {"broadcast": "192.168.33.255", "netmask": "255.255.255.0", "network": "192.168.33.0", "address": "192.168.33.5"}, "ipv6": [{"scope": "link", "prefix": "64", "address": "fe80::5054:ff:fec9:8b6b"}], "active": true, "type": "ether", "hw_timestamp_filters": []}, "ansible_python_version": "2.7.5", "ansible_product_name": "Standard PC (i440FX + PIIX, 1996)", "ansible_machine": "x86_64", "ansible_all_ipv4_addresses": ["192.168.33.5"], "ansible_nodename": "seed"}}
, stderr=Shared connection to 192.168.33.5 closed.

 13543 1602069922.03618: done with _execute_module (setup, {'_ansible_version': '2.8.16', '_ansible_selinux_special_fs': ['fuse', 'nfs', 'vboxsf', 'ramfs', '9p'], '_ansible_no_log': False, 'gather_timeout': 10, '_ansible_module_name': 'setup', '_ansible_remote_tmp': u'~/.ansible/tmp', '_ansible_verbosity': 0, '_ansible_keep_remote_files': False, '_ansible_syslog_facility': u'LOG_USER', '_ansible_socket': None, '_ansible_string_conversion_action': u'warn', 'gather_subset': ['all'], '_ansible_diff': False, '_ansible_debug': True, '_ansible_shell_executable': u'/bin/sh', '_ansible_check_mode': False, '_ansible_tmpdir': u'/home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421/'})
 13543 1602069922.03637: _low_level_execute_command(): starting
 13543 1602069922.03648: _low_level_execute_command(): executing: /bin/sh -c 'rm -f -r /home/centos/.ansible/tmp/ansible-tmp-1602069547.4-13543-134158360891421/ > /dev/null 2>&1 && sleep 0'
 13543 1602069963.43839: stdout chunk (state=2):
>>><<<

 13543 1602069963.43864: stderr chunk (state=2):
>>><<<

 13543 1602069963.43896: _low_level_execute_command() done: rc=0, stdout=, stderr=
 13543 1602069963.43908: handler run complete
 13543 1602069963.46185: attempt loop complete, returning result
 13543 1602069963.46204: _execute() done
 13543 1602069963.46210: dumping result to json
 13543 1602069963.46274: done dumping result, returning
 13543 1602069963.46291: done running TaskExecutor() for seed/TASK: Gathering Facts [848f69fe-4727-ca6b-d252-00000000005d]
 13543 1602069963.46309: sending task result for task 848f69fe-4727-ca6b-d252-00000000005d
 13543 1602069963.46376: done sending task result for task 848f69fe-4727-ca6b-d252-00000000005d
 13543 1602069963.46381: WORKER PROCESS EXITING
ok: [seed]
 12775 1602069963.48039: no more pending results, returning what we have
 12775 1602069963.48055: results queue empty
 12775 1602069963.48065: checking for any_errors_fatal
 12775 1602069963.48077: done checking for any_errors_fatal
 12775 1602069963.48086: checking for max_fail_percentage
 12775 1602069963.48095: done checking for max_fail_percentage
 12775 1602069963.48104: checking to see if all hosts have failed and the running result is not ok
 12775 1602069963.48112: done checking to see if all hosts have failed
 12775 1602069963.48120: getting the remaining hosts for this loop
 12775 1602069963.48141: done getting the remaining hosts for this loop
 12775 1602069963.48159: building list of next tasks for hosts
 12775 1602069963.48169: getting the next task for host seed
 12775 1602069963.48185: done getting next task for host seed
 12775 1602069963.48200:  ^ task is: TASK: meta (flush_handlers)
 12775 1602069963.48212:  ^ state is: HOST STATE: block=1, task=1, rescue=0, always=0, run_state=ITERATING_TASKS, fail_state=FAILED_NONE, pending_setup=False, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602069963.48221: done building task lists
 12775 1602069963.48229: counting tasks in each state of execution
 12775 1602069963.48238: done counting tasks in each state of execution:
        num_setups: 0
        num_tasks: 1
        num_rescue: 0
        num_always: 0
 12775 1602069963.48252: advancing hosts in ITERATING_TASKS
 12775 1602069963.48260: starting to advance hosts
 12775 1602069963.48268: getting the next task for host seed
 12775 1602069963.48279: done getting next task for host seed
 12775 1602069963.48291:  ^ task is: TASK: meta (flush_handlers)
 12775 1602069963.48300:  ^ state is: HOST STATE: block=1, task=1, rescue=0, always=0, run_state=ITERATING_TASKS, fail_state=FAILED_NONE, pending_setup=False, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602069963.48308: done advancing hosts to next task
 12775 1602069963.48356: done queuing things up, now waiting for results queue to drain
 12775 1602069963.48366: results queue empty
 12775 1602069963.48373: checking for any_errors_fatal
 12775 1602069963.48385: done checking for any_errors_fatal
 12775 1602069963.48393: checking for max_fail_percentage
 12775 1602069963.48400: done checking for max_fail_percentage
 12775 1602069963.48407: checking to see if all hosts have failed and the running result is not ok
 12775 1602069963.48414: done checking to see if all hosts have failed
 12775 1602069963.48421: getting the remaining hosts for this loop
 12775 1602069963.48433: done getting the remaining hosts for this loop
 12775 1602069963.48448: building list of next tasks for hosts
 12775 1602069963.48456: getting the next task for host seed
 12775 1602069963.48467: done getting next task for host seed
 12775 1602069963.48481:  ^ task is: TASK: singleplatform-eng.users : Creating groups
 12775 1602069963.48491:  ^ state is: HOST STATE: block=2, task=1, rescue=0, always=0, run_state=ITERATING_TASKS, fail_state=FAILED_NONE, pending_setup=False, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602069963.48499: done building task lists
 12775 1602069963.48506: counting tasks in each state of execution
 12775 1602069963.48514: done counting tasks in each state of execution:
        num_setups: 0
        num_tasks: 1
        num_rescue: 0
        num_always: 0
12775 1602069963.48526: advancing hosts in ITERATING_TASKS
 12775 1602069963.48534: starting to advance hosts
 12775 1602069963.48541: getting the next task for host seed
 12775 1602069963.48552: done getting next task for host seed
 12775 1602069963.48563:  ^ task is: TASK: singleplatform-eng.users : Creating groups
 12775 1602069963.48572:  ^ state is: HOST STATE: block=2, task=1, rescue=0, always=0, run_state=ITERATING_TASKS, fail_state=FAILED_NONE, pending_setup=False, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602069963.48581: done advancing hosts to next task
 12775 1602069963.48601: getting variables
 12775 1602069963.48611: in VariableManager get_vars()
 12775 1602069963.48708: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 12775 1602069963.48720: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 12775 1602069963.48733: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 12775 1602069963.48743: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 12775 1602069963.48879: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 12775 1602069963.48890: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 12775 1602069963.48901: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 12775 1602069963.48912: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 12775 1602069963.48922: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 12775 1602069963.48932: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 12775 1602069963.48942: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 12775 1602069963.48952: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 12775 1602069963.48963: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 12775 1602069963.48973: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 12775 1602069963.48983: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 12775 1602069963.49215: Calling all_inventory to load vars for seed
 12775 1602069963.49227: Calling groups_inventory to load vars for seed
 12775 1602069963.49243: Calling all_plugins_inventory to load vars for seed
 12775 1602069963.49279: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602069963.49316: Calling all_plugins_play to load vars for seed
 12775 1602069963.49345: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602069963.49381: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/bifrost
 12775 1602069963.49397: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/bmc
 12775 1602069963.49412: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ceph
 12775 1602069963.49427: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/compute
 12775 1602069963.49443: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/controllers
 12775 1602070024.10999: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dell-switch-bmp
 12775 1602070024.11028: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dnf
 12775 1602070024.11052: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dns
 12775 1602070024.11074: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/docker
 12775 1602070024.11099: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/docker-registry
 12775 1602070024.11121: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/globals
 12775 1602070024.11143: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/grafana
 12775 1602070024.11165: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/idrac
 12775 1602070024.11191: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/inspector
 12775 1602070024.11215: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ipa
 12775 1602070024.11240: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ironic
 12775 1602070024.11264: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/kolla
 12775 1602070024.11297: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/monasca
 12775 1602070024.11324: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/monitoring
 12775 1602070024.11350: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/network
 12775 1602070024.11379: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/neutron
 12775 1602070024.11408: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/nova
 12775 1602070024.11434: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ntp
 12775 1602070024.11458: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/opensm
 12775 1602070024.11486: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/openstack
 12775 1602070024.11512: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/overcloud
 12775 1602070024.11538: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/pip
 12775 1602070024.11563: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed
 12775 1602070024.11591: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed-hypervisor
 12775 1602070024.11618: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed-vm
 12775 1602070024.11644: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ssh
 12775 1602070024.11671: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/storage
 12775 1602070024.11702: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/swift
 12775 1602070024.11733: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/arista
 12775 1602070024.11763: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/config
 12775 1602070024.11793: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/dell
 12775 1602070024.11822: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/dell-powerconnect
 12775 1602070024.11851: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/junos
 12775 1602070024.11881: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/mellanox
 12775 1602070024.11906: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/users
 12775 1602070024.11931: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/yum
 12775 1602070024.11957: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/yum-cron
 12775 1602070024.11996: Calling groups_plugins_inventory to load vars for seed
 12775 1602070024.12047: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.12180: Loading data from /home/centos/kayobe/config/src/kayobe-config/etc/kayobe/inventory/group_vars/seed/ansible-python-interpreter
 12775 1602070024.12205: Loading data from /home/centos/kayobe/config/src/kayobe-config/etc/kayobe/inventory/group_vars/seed/network-interfaces
 12775 1602070024.12228: Calling groups_plugins_play to load vars for seed
 12775 1602070024.12273: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.12379: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/ansible-host
 12775 1602070024.12400: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/ansible-user
 12775 1602070024.12421: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/lvm
 12775 1602070024.12442: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/mdadm
 12775 1602070024.12462: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/network
 12775 1602070024.12484: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/sysctl
 12775 1602070024.12505: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/users
 12775 1602070024.12574: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.12661: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.16437: done with get_vars()
 12775 1602070024.16475: done getting variables
 12775 1602070024.16492: sending task start callback, copying the task so we can template it temporarily
 12775 1602070024.16502: done copying, going to template now
 12775 1602070024.16513: done templating
 12775 1602070024.16521: here goes the callback...

TASK [singleplatform-eng.users : Creating groups] *****************************************************************************************************************************************************************
 12775 1602070024.16553: sending task start callback
 12775 1602070024.16565: entering _queue_task() for seed/group
 12775 1602070024.16577: Creating lock for group
 12775 1602070024.16830: worker is 1 (out of 1 available)
 12775 1602070024.16899: exiting _queue_task() for seed/group
 12775 1602070024.17086: done queuing things up, now waiting for results queue to drain
 12775 1602070024.17102: waiting for pending results...
 23216 1602070024.17330: running TaskExecutor() for seed/TASK: singleplatform-eng.users : Creating groups
 23216 1602070024.17562: in run() - task 848f69fe-4727-ca6b-d252-000000000038
 23216 1602070024.18010: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 23216 1602070024.18034: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 23216 1602070024.18060: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 23216 1602070024.18083: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 23216 1602070024.18325: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 23216 1602070024.18345: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 23216 1602070024.18366: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 23216 1602070024.18391: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 23216 1602070024.18412: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 23216 1602070024.18430: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 23216 1602070024.18448: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 23216 1602070024.18467: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 23216 1602070024.18490: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 23216 1602070024.18509: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 23216 1602070024.18526: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 23216 1602070024.19095: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 23216 1602070024.19112: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 23216 1602070024.19130: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 23216 1602070024.19147: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 23216 1602070024.19161: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 23216 1602070024.19177: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 23216 1602070024.19191: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 23216 1602070024.19207: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 23216 1602070024.19222: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 23216 1602070024.19237: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 23216 1602070024.19250: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 23216 1602070024.19319: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 23216 1602070024.19334: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 23216 1602070024.19348: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 23216 1602070024.19363: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 23216 1602070024.19445: Loading LookupModule 'items' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/lookup/items.py (found_in_cache=True, class_only=False)
 23216 1602070024.19475: dumping result to json
 23216 1602070024.19495: done dumping result, returning
 23216 1602070024.19513: done running TaskExecutor() for seed/TASK: singleplatform-eng.users : Creating groups [848f69fe-4727-ca6b-d252-000000000038]
 23216 1602070024.19549: sending task result for task 848f69fe-4727-ca6b-d252-000000000038
 23216 1602070024.19657: done sending task result for task 848f69fe-4727-ca6b-d252-000000000038
 23216 1602070024.19739: WORKER PROCESS EXITING
 12775 1602070024.19913: no more pending results, returning what we have
 12775 1602070024.19928: results queue empty
 12775 1602070024.19937: checking for any_errors_fatal
 12775 1602070024.19948: done checking for any_errors_fatal
 12775 1602070024.19957: checking for max_fail_percentage
 12775 1602070024.19966: done checking for max_fail_percentage
 12775 1602070024.19975: checking to see if all hosts have failed and the running result is not ok
 12775 1602070024.19982: done checking to see if all hosts have failed
 12775 1602070024.19990: getting the remaining hosts for this loop
 12775 1602070024.20007: done getting the remaining hosts for this loop
 12775 1602070024.20023: building list of next tasks for hosts
 12775 1602070024.20033: getting the next task for host seed
 12775 1602070024.20046: done getting next task for host seed
 12775 1602070024.20061:  ^ task is: TASK: singleplatform-eng.users : Per-user group creation
 12775 1602070024.20072:  ^ state is: HOST STATE: block=2, task=2, rescue=0, always=0, run_state=ITERATING_TASKS, fail_state=FAILED_NONE, pending_setup=False, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602070024.20082: done building task lists
 12775 1602070024.20090: counting tasks in each state of execution
 12775 1602070024.20098: done counting tasks in each state of execution:
       num_setups: 0
        num_tasks: 1
        num_rescue: 0
        num_always: 0
 12775 1602070024.20112: advancing hosts in ITERATING_TASKS
 12775 1602070024.20120: starting to advance hosts
 12775 1602070024.20128: getting the next task for host seed
 12775 1602070024.20138: done getting next task for host seed
 12775 1602070024.20149:  ^ task is: TASK: singleplatform-eng.users : Per-user group creation
 12775 1602070024.20158:  ^ state is: HOST STATE: block=2, task=2, rescue=0, always=0, run_state=ITERATING_TASKS, fail_state=FAILED_NONE, pending_setup=False, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602070024.20166: done advancing hosts to next task
 12775 1602070024.20194: getting variables
 12775 1602070024.20203: in VariableManager get_vars()
 12775 1602070024.20290: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 12775 1602070024.20302: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 12775 1602070024.20314: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 12775 1602070024.20326: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 12775 1602070024.20557: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 12775 1602070024.20569: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 12775 1602070024.20581: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 12775 1602070024.20592: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 12775 1602070024.20602: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 12775 1602070024.20612: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 12775 1602070024.20623: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 12775 1602070024.20635: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 12775 1602070024.20645: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 12775 1602070024.20655: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 12775 1602070024.20666: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 12775 1602070024.20863: Calling all_inventory to load vars for seed
 12775 1602070024.20876: Calling groups_inventory to load vars for seed
 12775 1602070024.20893: Calling all_plugins_inventory to load vars for seed
 12775 1602070024.20927: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.20962: Calling all_plugins_play to load vars for seed
 12775 1602070024.20992: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.21025: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/bifrost
 12775 1602070024.21040: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/bmc
 12775 1602070024.21057: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ceph
 12775 1602070024.21072: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/compute
 12775 1602070024.21089: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/controllers
 12775 1602070024.21106: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dell-switch-bmp
 12775 1602070024.21121: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dnf
 12775 1602070024.21136: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/dns
 12775 1602070024.21153: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/docker
 12775 1602070024.21168: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/docker-registry
 12775 1602070024.21186: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/globals
 12775 1602070024.21202: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/grafana
 12775 1602070024.21214: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/idrac
 12775 1602070024.21226: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/inspector
 12775 1602070024.21239: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ipa
 12775 1602070024.21253: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ironic
 12775 1602070024.21266: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/kolla
 12775 1602070024.21283: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/monasca
 12775 1602070024.21298: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/monitoring
 12775 1602070024.21312: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/network
 12775 1602070024.21327: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/neutron
 12775 1602070024.21341: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/nova
 12775 1602070024.21355: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ntp
 12775 1602070024.21369: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/opensm
 12775 1602070024.21384: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/openstack
 12775 1602070024.21398: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/overcloud
 12775 1602070024.21412: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/pip
 12775 1602070024.21426: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed
 12775 1602070024.21440: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed-hypervisor
 12775 1602070024.21454: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/seed-vm
 12775 1602070024.21468: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/ssh
 12775 1602070024.21483: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/storage
 12775 1602070024.21498: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/swift
 12775 1602070024.21515: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/arista
 12775 1602070024.21531: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/config
 12775 1602070024.21545: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/dell
 12775 1602070024.21560: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/dell-powerconnect
 12775 1602070024.21576: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/junos
 12775 1602070024.21591: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/switches/mellanox
 12775 1602070024.21607: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/users
 12775 1602070024.21622: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/yum
12775 1602070024.21636: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/all/yum-cron
 12775 1602070024.21656: Calling groups_plugins_inventory to load vars for seed
 12775 1602070024.21682: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.21750: Loading data from /home/centos/kayobe/config/src/kayobe-config/etc/kayobe/inventory/group_vars/seed/ansible-python-interpreter
 12775 1602070024.21762: Loading data from /home/centos/kayobe/config/src/kayobe-config/etc/kayobe/inventory/group_vars/seed/network-interfaces
 12775 1602070024.21778: Calling groups_plugins_play to load vars for seed
 12775 1602070024.21801: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.21856: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/ansible-host
 12775 1602070024.21867: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/ansible-user
 12775 1602070024.21882: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/lvm
 12775 1602070024.21893: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/mdadm
 12775 1602070024.21903: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/network
 12775 1602070024.21914: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/sysctl
 12775 1602070024.21925: Loading data from /home/centos/kayobe-venv/share/kayobe/ansible/group_vars/seed/users
 12775 1602070024.21963: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.22009: Loading VarsModule 'host_group_vars' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/vars/host_group_vars.py (found_in_cache=True, class_only=False)
 12775 1602070024.24275: done with get_vars()
 12775 1602070024.24299: done getting variables
 12775 1602070024.24310: sending task start callback, copying the task so we can template it temporarily
 12775 1602070024.24317: done copying, going to template now
 12775 1602070024.24324: done templating
 12775 1602070024.24330: here goes the callback...

TASK [singleplatform-eng.users : Per-user group creation] *********************************************************************************************************************************************************
 12775 1602070024.24346: sending task start callback
 12775 1602070024.24353: entering _queue_task() for seed/group
 12775 1602070024.24475: worker is 1 (out of 1 available)
 12775 1602070024.24521: exiting _queue_task() for seed/group
 12775 1602070024.24624: done queuing things up, now waiting for results queue to drain
 12775 1602070024.24634: waiting for pending results...
 23218 1602070024.24925: running TaskExecutor() for seed/TASK: singleplatform-eng.users : Per-user group creation
 23218 1602070024.25108: in run() - task 848f69fe-4727-ca6b-d252-000000000039
 23218 1602070024.25467: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 23218 1602070024.25489: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 23218 1602070024.25507: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 23218 1602070024.25522: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 23218 1602070024.25696: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 23218 1602070024.25710: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 23218 1602070024.25724: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 23218 1602070024.25740: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 23218 1602070024.25754: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 23218 1602070024.25768: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 23218 1602070024.25784: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 23218 1602070024.25799: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 23218 1602070024.25815: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 23218 1602070024.25829: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 23218 1602070024.25840: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 23218 1602070024.27968: Loaded config def from plugin (lookup/env)
 23218 1602070024.27987: Loading LookupModule 'env' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/lookup/env.py
 23218 1602070024.28907: Loaded config def from plugin (lookup/file)
 23218 1602070024.28920: Loading LookupModule 'file' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/lookup/file.py
 23218 1602070024.28933: File lookup term: /home/centos/.ssh/id_rsa.pub
 23218 1602070024.29043: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 23218 1602070024.29053: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 23218 1602070024.29063: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 23218 1602070024.29073: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 23218 1602070024.29085: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 23218 1602070024.29095: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 23218 1602070024.29104: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 23218 1602070024.29115: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 23218 1602070024.29125: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 23218 1602070024.29135: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 23218 1602070024.29144: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 23218 1602070024.29191: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 23218 1602070024.29201: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 23218 1602070024.29211: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 23218 1602070024.29220: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 23218 1602070024.29294: Loading LookupModule 'items' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/lookup/items.py (found_in_cache=True, class_only=False)
 23218 1602070024.29639: Loading TestModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/core.py (found_in_cache=True, class_only=False)
 23218 1602070024.29650: Loading TestModule 'files' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/files.py (found_in_cache=True, class_only=False)
 23218 1602070024.29660: Loading TestModule 'functional' from /home/centos/kayobe-venv/share/kayobe/ansible/test_plugins/functional.py (found_in_cache=True, class_only=False)
 23218 1602070024.29670: Loading TestModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/test/mathstuff.py (found_in_cache=True, class_only=False)
 23218 1602070024.29773: Loading FilterModule 'bmc_type' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/bmc_type.py (found_in_cache=True, class_only=False)
 23218 1602070024.29784: Loading FilterModule 'core' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/core.py (found_in_cache=True, class_only=False)
 23218 1602070024.29793: Loading FilterModule 'ipaddr' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/ipaddr.py (found_in_cache=True, class_only=False)
 23218 1602070024.29803: Loading FilterModule 'json_query' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/json_query.py (found_in_cache=True, class_only=False)
 23218 1602070024.29813: Loading FilterModule 'k8s' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/k8s.py (found_in_cache=True, class_only=False)
 23218 1602070024.29823: Loading FilterModule 'mathstuff' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/mathstuff.py (found_in_cache=True, class_only=False)
 23218 1602070024.29831: Loading FilterModule 'network' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/network.py (found_in_cache=True, class_only=False)
 23218 1602070024.29842: Loading FilterModule 'networks' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/networks.py (found_in_cache=True, class_only=False)
 23218 1602070024.29852: Loading FilterModule 'switches' from /home/centos/kayobe-venv/share/kayobe/ansible/filter_plugins/switches.py (found_in_cache=True, class_only=False)
 23218 1602070024.29860: Loading FilterModule 'urls' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urls.py (found_in_cache=True, class_only=False)
 23218 1602070024.29870: Loading FilterModule 'urlsplit' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/filter/urlsplit.py (found_in_cache=True, class_only=False)
 23218 1602070024.31399: trying /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/connection
 23218 1602070024.31519: Loading Connection 'ssh' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/connection/ssh.py (found_in_cache=True, class_only=False)
 23218 1602070024.31544: trying /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/shell
 23218 1602070024.31582: Loading ShellModule 'sh' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/shell/sh.py (found_in_cache=True, class_only=False)
 23218 1602070024.31598: Loading ShellModule 'sh' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/shell/sh.py (found_in_cache=True, class_only=False)
 23218 1602070024.31624: trying /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/become
 23218 1602070024.31682: Loading BecomeModule 'sudo' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/become/sudo.py (found_in_cache=True, class_only=False)
 23218 1602070024.32337: Loading ActionModule 'normal' from /home/centos/kayobe-venv/lib/python2.7/site-packages/ansible/plugins/action/normal.py
 23218 1602070024.32355: starting attempt loop
 23218 1602070024.32363: running the handler
 23218 1602070024.32416: _low_level_execute_command(): starting
 23218 1602070024.32428: _low_level_execute_command(): executing: /bin/sh -c 'echo ~centos && sleep 0'
 23218 1602070209.93723: stdout chunk (state=2):
>>>/home/centos
<<<

 23218 1602070210.04945: stdout chunk (state=3):
>>><<<

 23218 1602070210.04971: stderr chunk (state=3):
>>><<<

 23218 1602070210.05024: _low_level_execute_command() done: rc=0, stdout=/home/centos
, stderr=
 23218 1602070210.05084: _low_level_execute_command(): starting
 23218 1602070210.05105: _low_level_execute_command(): executing: /bin/sh -c '( umask 77 && mkdir -p "` echo /home/centos/.ansible/tmp `"&& mkdir /home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975 && echo ansible-tmp-1602070210.05-23218-34422041703975="` echo /home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975 `" ) && sleep 0'
 23218 1602070291.58973: stdout chunk (state=2):
>>>ansible-tmp-1602070210.05-23218-34422041703975=/home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975
<<<

 23218 1602070291.69613: stdout chunk (state=3):
>>><<<

 23218 1602070291.69636: stderr chunk (state=3):
>>><<<

 23218 1602070291.69685: _low_level_execute_command() done: rc=0, stdout=ansible-tmp-1602070210.05-23218-34422041703975=/home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975
, stderr=
 23218 1602070291.69840: ANSIBALLZ: Using lock for group
 23218 1602070291.69853: ANSIBALLZ: Acquiring lock
 23218 1602070291.69869: ANSIBALLZ: Lock acquired: 139957479612560
 23218 1602070291.69886: ANSIBALLZ: Creating module
 23218 1602070291.97066: ANSIBALLZ: Writing module
 23218 1602070291.97097: ANSIBALLZ: Renaming module
 23218 1602070291.97107: ANSIBALLZ: Done creating module
 23218 1602070291.97215: transferring module to remote /home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975/AnsiballZ_group.py
 23218 1602070291.98090: Sending initial data
 23218 1602070291.98107: Sent initial data (158 bytes)
 23218 1602070372.99129: stdout chunk (state=3):
>>>sftp> put /home/centos/.ansible/tmp/ansible-local-12775RrbMvE/tmpNmNSfx /home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975/AnsiballZ_group.py
<<<

 23218 1602070373.04339: stdout chunk (state=3):
>>><<<

 23218 1602070373.04364: stderr chunk (state=3):
>>><<<

 23218 1602070373.04428: done transferring module to remote
 23218 1602070373.04496: _low_level_execute_command(): starting
 23218 1602070373.04520: _low_level_execute_command(): executing: /bin/sh -c 'chmod u+x /home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975/ /home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975/AnsiballZ_group.py && sleep 0'
 23218 1602070454.58436: stdout chunk (state=2):
>>><<<

 23218 1602070454.58484: stderr chunk (state=2):
>>><<<

 23218 1602070454.58540: _low_level_execute_command() done: rc=0, stdout=, stderr=
 23218 1602070454.58559: _low_level_execute_command(): starting
 23218 1602070454.58581: _low_level_execute_command(): using become for this command
 23218 1602070454.58638: _low_level_execute_command(): executing: /bin/sh -c 'sudo -H -S -n  -u root /bin/sh -c '"'"'echo BECOME-SUCCESS-ehsrdsrqcdlqiorlvgpvnvtiybeszcod ; /usr/libexec/platform-python /home/centos/.ansible/tmp/ansible-tmp-1602070210.05-23218-34422041703975/AnsiballZ_group.py'"'"' && sleep 0'
 23218 1602070454.59678: Initial state: awaiting_escalation: BECOME-SUCCESS-ehsrdsrqcdlqiorlvgpvnvtiybeszcod
 23218 1602070536.97097: stdout chunk (state=1):
>>>sudo: a password is required
<<<

 23218 1602070536.97244: become_nopasswd_error: (source=stdout, state=awaiting_escalation): 'sudo: a password is required'
 23218 1602070536.97419: done running TaskExecutor() for seed/TASK: singleplatform-eng.users : Per-user group creation [848f69fe-4727-ca6b-d252-000000000039]
 23218 1602070536.97463: sending task result for task 848f69fe-4727-ca6b-d252-000000000039
 23218 1602070536.97565: done sending task result for task 848f69fe-4727-ca6b-d252-000000000039
 23218 1602070536.97627: WORKER PROCESS EXITING
 12775 1602070536.97779: marking seed as failed
 12775 1602070536.97807: marking host seed failed, current state: HOST STATE: block=2, task=2, rescue=0, always=0, run_state=ITERATING_TASKS, fail_state=FAILED_NONE, pending_setup=False, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602070536.97825: ^ failed state is now: HOST STATE: block=2, task=2, rescue=0, always=0, run_state=ITERATING_COMPLETE, fail_state=FAILED_TASKS, pending_setup=False, tasks child state? (None), rescue child state? (None), always child state? (None), did rescue? False, did start at task? False
 12775 1602070536.97838: getting the next task for host seed
 12775 1602070536.97850: host seed is done iterating, returning
fatal: [seed]: FAILED! => {"msg": "Missing sudo password"}
 12775 1602070536.97917: no more pending results, returning what we have
 12775 1602070536.97933: results queue empty
 12775 1602070536.97942: checking for any_errors_fatal
 12775 1602070536.97957: done checking for any_errors_fatal
 12775 1602070536.97967: checking for max_fail_percentage
 12775 1602070536.97979: done checking for max_fail_percentage
 12775 1602070536.97989: checking to see if all hosts have failed and the running result is not ok
 12775 1602070536.97998: done checking to see if all hosts have failed
 12775 1602070536.98007: getting the remaining hosts for this loop
 12775 1602070536.98025: done getting the remaining hosts for this loop
 12775 1602070536.98045: building list of next tasks for hosts
 12775 1602070536.98055: getting the next task for host seed
 12775 1602070536.98066: host seed is done iterating, returning
 12775 1602070536.98077: done building task lists
 12775 1602070536.98086: counting tasks in each state of execution
 12775 1602070536.98096: done counting tasks in each state of execution:
        num_setups: 0
        num_tasks: 0
        num_rescue: 0
        num_always: 0
 12775 1602070536.98114: all hosts are done, so returning None's for all hosts
 12775 1602070536.98125: done queuing things up, now waiting for results queue to drain
 12775 1602070536.98134: results queue empty
 12775 1602070536.98143: checking for any_errors_fatal
 12775 1602070536.98152: done checking for any_errors_fatal
 12775 1602070536.98161: checking for max_fail_percentage
 12775 1602070536.98169: done checking for max_fail_percentage
 12775 1602070536.98181: checking to see if all hosts have failed and the running result is not ok
 12775 1602070536.98189: done checking to see if all hosts have failed
 12775 1602070536.98203: getting the next task for host seed
 12775 1602070536.98214: host seed is done iterating, returning
 12775 1602070536.98224: running handlers

PLAY RECAP ********************************************************************************************************************************************************************************************************
seed                       : ok=6    changed=0    unreachable=0    failed=1    skipped=2    rescued=0    ignored=0

@markgoddard
Copy link
Member

Hi @Banshee1221. The Gathering facts task completed successfully, so Ansible was able to SSH to the seed. It is later on when sudo is required that it fails, with Missing sudo password.

Can you ssh to [email protected]?

@Banshee1221
Copy link
Author

Hi @markgoddard, yes I seem to be able to connect. It does, however, take around 3 minutes to get to prompt.

@markgoddard
Copy link
Member

Often long timeouts with SSH indicates a problem with DNS resolution inside the server you are connecting to. Can you check that?

@Banshee1221
Copy link
Author

I had a look at the DNS and it wouldn't appear to be an issue there.. I can eventually get to the prompt, though. The timeout extension does help me get past that anyway. Any other suggestions there?

@oneswig
Copy link
Member

oneswig commented Oct 8, 2020

Hi @Banshee1221 the pattern of taking ages to connect, but eventually getting there really does sound like you have UseDNS yes in /etc/ssh/sshd_config on the seed VM 192.168.33.5 and DNS is not working on the seed VM (the UseDNS setting is actually the default in CentOS 7).

If it is not that we'll need to think of other ways the machine is working, but extremely slowly. Can you check if hardware virtualisation support is enabled in your bare metal host (eg, use lscpu). I doubt that would make it as slow as this though...

@Banshee1221
Copy link
Author

Hi @oneswig thanks for the response. I had a brain-fart and didn't think to actually check the seed vm. I only verified that the DNS settings on the host were correct (not sshd).

I went ahead and looked through the Ansible and found that the seed vm root volume is at /var/lib/libvirt/images/seed-root, so I used guestfish to modify the sshd_config and explicitly turn off UseDNS there. It does make the login much faster, but I still have the same issue with:

TASK [singleplatform-eng.users : Per-user group creation] *********************************************************************************************************************************************************
fatal: [seed]: FAILED! => {"msg": "Missing sudo password"}

PLAY RECAP ********************************************************************************************************************************************************************************************************
seed                       : ok=6    changed=0    unreachable=0    failed=1    skipped=2    rescued=0    ignored=0

I've also verified that the vmx flag is on for hardware virtualisation and VT-x is set in BIOS.

@priteau
Copy link
Member

priteau commented Oct 8, 2020

If you SSH to the seed ssh [email protected] and try running any command with sudo, does it work without a password?

@Banshee1221
Copy link
Author

No, I'm prompted for a password. I assumed that this was normal.

image

@priteau
Copy link
Member

priteau commented Oct 8, 2020

This is the cause of your issues. Kayobe is trying to use sudo without a password when logged in as centos.

Normally the centos user should have been given passwordless sudo privileges. Do you have a file called /etc/sudoers.d/90-cloud-init-users on the seed VM?

@Banshee1221
Copy link
Author

Banshee1221 commented Oct 8, 2020

There is no file called /etc/sudoers.d/90-cloud-init-users on the seed VM. Is this supposed to be pulled in from the host? Because as mentioned this is a bare-metal machine with a stock CentOS image installed so I personally just added NOPASSWD to the root /etc/sudoers file.

Do the Ansible scripts copy /etc/sudoers.d/90-cloud-init-users from the host to the VM?

EDIT: Manually setting centos ALL=(ALL) NOPASSWD:ALL in the seed VM /etc/sudoers has, as expected, fixed the issue. I just want to know what is required for this to be automated?

I wonder if there's some cloud-init step that's not running correctly?

@Banshee1221
Copy link
Author

Banshee1221 commented Oct 9, 2020

So this may be off topic and please let me know if I should open a new ticket around this, but the reason I'm posting it here is because it's possible that it's all related to the seed VM.

After manual adding the centos user NOPASSWD to the VM, I'm able to continue until this step:

TASK [Ensure kayobe virtualenv has the latest version of pip installed] *******************************************************************************************************************************************
fatal: [seed]: FAILED! => {"changed": false, "cmd": ["/opt/kayobe/venvs/kayobe/bin/pip2", "install", "-U", "pip"], "msg": "stdout: Could not fetch URL https://pypi.python.org/simple/pip/: There was a problem confirming the ssl certificate: [SSL] unknown error (_ssl.c:618) - skipping\nRequirement already up-to-date: pip in /opt/kayobe/venvs/kayobe/lib/python2.7/site-packages\n\n:stderr: fips.c(145): OpenSSL internal error, assertion failed: FATAL FIPS SELFTEST FAILURE\n"}

This kind of leads me to believe that perhaps there's some issue with the creation of the seed VM? This could also be a totally unrelated bug, though, and I haven't gotten past it yet. Perhaps I'm missing something here, but I haven't had the time to dig through all of the Ansible.

EDIT: This doesn't seem to be network related, as I can reach https://pypi.python.org via curl just fine.

@markgoddard
Copy link
Member

It does sound like something has gone wrong during the creation of the VM. I would expect cloud-init to create the /etc/sudoers.d/90-cloud-init-users file but it appears not to have done. Is there anything in the cloud-init logs to suggest what might have gone wrong? Also, do you know why DNS was not working in the seed VM?

@Banshee1221
Copy link
Author

Hi @markgoddard. Sorry for the delay in response. I poked around and found this:

2020-10-07 08:19:33,496 - __init__.py[DEBUG]: Adding user centos
2020-10-07 08:19:33,498 - util.py[DEBUG]: Running hidden command to protect sensitive input/output logstring: ['useradd', 'centos', '--comment', 'Cloud User', '--groups', 'adm,systemd-journal,wheel', '--shell', '/bin/bash', '-m']
2020-10-07 08:19:34,666 - util.py[DEBUG]: Running command ['passwd', '-l', 'centos'] with allowed return codes [0] (shell=False, capture=True)
2020-10-07 08:19:35,198 - util.py[WARNING]: Failed to disable password for user centos
2020-10-07 08:19:35,205 - util.py[DEBUG]: Failed to disable password for user centos
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cloudinit/distros/__init__.py", line 584, in lock_passwd
    util.subp(['passwd', '-l', name])
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 2091, in subp
    cmd=args)
ProcessExecutionError: Unexpected error while running command.
Command: ['passwd', '-l', 'centos']
Exit code: 255
Reason: -
Stdout: Locking password for user centos.
        passwd: Error (password not set?)
Stderr: passwd: Libuser error at line: 124 - data not found in file.
2020-10-07 08:19:35,250 - handlers.py[DEBUG]: finish: init-network/config-users-groups: FAIL: running config-users-groups with frequency once-per-instance
2020-10-07 08:19:35,252 - util.py[WARNING]: Running module users-groups (<module 'cloudinit.config.cc_users_groups' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_users_groups.pyc'>) failed
2020-10-07 08:19:35,254 - util.py[DEBUG]: Running module users-groups (<module 'cloudinit.config.cc_users_groups' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_users_groups.pyc'>) failed
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cloudinit/stages.py", line 813, in _run_modules
    freq=freq)
  File "/usr/lib/python2.7/site-packages/cloudinit/cloud.py", line 54, in run
    return self._runners.run(name, functor, args, freq, clear_on_fail)
  File "/usr/lib/python2.7/site-packages/cloudinit/helpers.py", line 187, in run
    results = functor(*args)
  File "/usr/lib/python2.7/site-packages/cloudinit/config/cc_users_groups.py", line 165, in handle
    cloud.distro.create_user(user, **config)
  File "/usr/lib/python2.7/site-packages/cloudinit/distros/__init__.py", line 537, in create_user
    self.lock_passwd(name)
  File "/usr/lib/python2.7/site-packages/cloudinit/distros/__init__.py", line 587, in lock_passwd
    raise e
ProcessExecutionError: Unexpected error while running command.
Command: ['passwd', '-l', 'centos']
Exit code: 255
Reason: -
Stdout: Locking password for user centos.
        passwd: Error (password not set?)
Stderr: passwd: Libuser error at line: 124 - data not found in file.

As for DNS, I'm not 100% sure yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants