Some tests providing errors while running on frontend

[ghost]

Hi all There are some tests which are performing well but some tests are messed up. Like when i run synctest the data I receive is as follows---

And the Job debug is as follows--- Job debug log 08/19 09:21:11 INFO | autoserv:0205| Results placed in /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com 08/19 09:21:11 DEBUG| base_job:0348| Persistent state global_properties.tag now set to '11-debug_user/autotestcl.happiestminds.com' 08/19 09:21:11 DEBUG| base_job:0348| Persistent state global_properties.last_boot_tag now set to None 08/19 09:21:11 DEBUG| version_0:0021| {'drone': 'autotestserver.happiestminds.com', 'job_queued': 1376904057, 'job_started': 1376904071, 'user': 'debug_user', 'hostname': 'autotestcl.happiestminds.com', 'status_version': 1, 'label': 'syncTest'} 08/19 09:21:11 DEBUG| version_0:0060| MACHINE NAME: autotestcl.happiestminds.com 08/19 09:21:11 DEBUG| version_0:0076| MACHINE GROUP: None 08/19 09:21:12 INFO |server_job:0535| Processing control file 08/19 09:21:12 DEBUG|base_utils:0252| Detected OS vendor: Fedora 08/19 09:21:12 DEBUG| ssh_host:0114| Running (ssh) 'test -f /var/log/messages' 08/19 09:21:12 INFO |abstract_s:0615| Starting master ssh connection '/usr/bin/ssh -a -x -N -o ControlMaster=yes -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22 autotestcl.happiestminds.com' 08/19 09:21:12 DEBUG|base_utils:0077| Running '/usr/bin/ssh -a -x -N -o ControlMaster=yes -o ControlPath=/tmp/autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22 autotestcl.happiestminds.com' 08/19 09:21:14 DEBUG| remote:0182| Found remote path /var/log/messages 08/19 09:21:14 DEBUG| ssh_host:0114| Running (ssh) 'rm -f /var/tmp/messages.autotest_start' 08/19 09:21:14 DEBUG| ssh_host:0114| Running (ssh) 'cp /var/log/messages /var/tmp/messages.autotest_start' 08/19 09:21:14 DEBUG| ssh_host:0114| Running (ssh) '/bin/uname -r' 08/19 09:21:14 DEBUG|base_utils:0114| [stdout] 3.9.5-301.fc19.x86_64 08/19 09:21:14 INFO |server_job:0118| INFO ---- ---- kernel=3.9.5-301.fc19.x86_64 localtime=Aug 19 09:21:14 timestamp=1376904074
08/19 09:21:14 INFO | models:0138| parsing partial test ---- SERVER_JOB 08/19 09:21:14 DEBUG| version_1:0229| STATUS: INFO ---- ---- kernel=3.9.5-301.fc19.x86_64 localtime=Aug 19 09:21:14 timestamp=1376904074 08/19 09:21:14 DEBUG|base_utils:0077| Running 'tools/make_clean' 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning iosched_bugs test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning rtc test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning aio_dio_bugs test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning hackbench test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning tsc test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning monotonic_time test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning signaltest test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning synctest test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning tracing_microbenchmark test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning ipv6connect test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning rmaptest test dir 08/19 09:21:25 DEBUG|base_utils:0114| [stdout] Cleaning cyclictest test dir 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'true' 08/19 09:21:25 DEBUG|abstract_s:0455| Host autotestcl.happiestminds.com is now up 08/19 09:21:25 INFO |autotest_r:0263| Installing autotest on autotestcl.happiestminds.com 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'test -x /usr/local/autotest/autotest' 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'test -w /usr/local/autotest' 08/19 09:21:25 DEBUG|autotest_r:0109| Found existing autodir at /usr/local/autotest 08/19 09:21:25 INFO |autotest_r:0292| Using installation dir /usr/local/autotest 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p /usr/local/autotest' 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'rm -rf /usr/local/autotest/results/*' 08/19 09:21:25 INFO |autotest_r:0312| Could not install autotest using the packaging system: No repos to install an autotest client from. Trying other methods 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'rsync --version' 08/19 09:21:25 DEBUG|base_utils:0077| Running 'rsync -L --delete --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/client/profiler.py /usr/local/autotest/client/job.pyc /usr/local/autotest/client/setup_modules.pyc /usr/local/autotest/client/shared /usr/local/autotest/client/kernel.pyc /usr/local/autotest/client/samples /usr/local/autotest/client/kernelexpand_unittest.py /usr/local/autotest/client/autotest-local-streamhandler /usr/local/autotest/client/harness_simple.py /usr/local/autotest/client/setup.py /usr/local/autotest/client/autotest-daemon-monitor /usr/local/autotest/client/kernel_unittest.py /usr/local/autotest/client/parallel.py /usr/local/autotest/client/cmdparser.py /usr/local/autotest/client/base_sysinfo.py /usr/local/autotest/client/TODO /usr/local/autotest/client/harness_beaker.py /usr/local/autotest/client/autotest_local.py /usr/local/autotest/client/config.py /usr/local/autotest/client/partition_unittest.py /usr/local/autotest/client/client_logging_config.pyc /usr/local/autotest/client/net /usr/local/autotest/client/fsinfo_unittest.py /usr/local/autotest/client/config /usr/local/autotest/client/autotest_client /usr/local/autotest/client/local_host_unittest.py /usr/local/autotest/client/client_logging_config.py /usr/local/autotest/client/partition.pyc /usr/local/autotest/client/cpuset.py /usr/local/autotest/client/kernel_config.pyc /usr/local/autotest/client/autotest-daemon /usr/local/autotest/client/common.py /usr/local/autotest/client/job.py /usr/local/autotest/client/init.pyc /usr/local/autotest/client/bkr_xml.py /usr/local/autotest/client/base_utils.pyc /usr/local/autotest/client/job_unittest.py /usr/local/autotest/client/test.py /usr/local/autotest/client/optparser.py /usr/local/autotest/client/init.py /usr/local/autotest/client/bkr_proxy.py /usr/local/autotest/client/fsinfo.py /usr/local/autotest/client/rhts-reboot /usr/local/autotest/client/fsdev_mgr.py /usr/local/autotest/client/lv_utils.py /usr/local/autotest/client/harness_ABAT.py /usr/local/autotest/client/kvm_control_unittest.py /usr/local/autotest/client/local_host.pyc /usr/local/autotest/client/kernel_config.py /usr/local/autotest/client/autotest-local /usr/local/autotest/client/kernelexpand.py /usr/local/autotest/client/setup_modules.py /usr/local/autotest/client/partition.py /usr/local/autotest/client/harness_standalone.py /usr/local/autotest/client/rhts_submit_log /usr/local/autotest/client/autotestd /usr/local/autotest/client/tools /usr/local/autotest/client/base_sysinfo.pyc /usr/local/autotest/client/autotest /usr/local/autotest/client/xen.py /usr/local/autotest/client/kernel_versions.py /usr/local/autotest/client/harness.pyc /usr/local/autotest/client/os_dep.py /usr/local/autotest/client/kvm_control.py /usr/local/autotest/client/setup_job_unittest.py /usr/local/autotest/client/local_host.py /usr/local/autotest/client/config.pyc /usr/local/autotest/client/sysinfo.pyc /usr/local/autotest/client/xen.pyc /usr/local/autotest/client/parallel.pyc /usr/local/autotest/client/fsdev_disks.py /usr/local/autotest/client/harness.py /usr/local/autotest/client/harness_unittest.py /usr/local/autotest/client/utils.py /usr/local/autotest/client/kernel_config_unittest.py /usr/local/autotest/client/sysinfo.py /usr/local/autotest/client/test.pyc /usr/local/autotest/client/test_config.py /usr/local/autotest/client/rhts-submit-log /usr/local/autotest/client/kernel.py /usr/local/autotest/client/harness_autoserv.py /usr/local/autotest/client/fsdev_disks_unittest.py /usr/local/autotest/client/kernelexpand.pyc /usr/local/autotest/client/setup_job.pyc /usr/local/autotest/client/os_dep.pyc /usr/local/autotest/client/setup_job.py /usr/local/autotest/client/autotestd_monitor /usr/local/autotest/client/utils.pyc /usr/local/autotest/client/kernel_versions_unittest.py /usr/local/autotest/client/rhts-report-result /usr/local/autotest/client/LICENSE /usr/local/autotest/client/base_utils.py /usr/local/autotest/client/deps/grubby/grubby-8.15.tar.bz2 [email protected]:"/usr/local/autotest"' 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p /usr/local/autotest/profilers' 08/19 09:21:25 DEBUG|base_utils:0077| Running 'rsync -L --delete --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/client/profilers/init.py [email protected]:"/usr/local/autotest/profilers"' 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p '/usr/local/autotest/site_tests';touch '/usr/local/autotest/site_tests'/init.py;mkdir -p '/usr/local/autotest/tests';touch '/usr/local/autotest/tests'/init.py;mkdir -p '/usr/local/autotest/deps';touch '/usr/local/autotest/deps'/init.py' 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p /usr/local/autotest/tmp' 08/19 09:21:25 INFO |autotest_r:0325| Installation of autotest completed 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'true' 08/19 09:21:25 DEBUG|abstract_s:0455| Host autotestcl.happiestminds.com is now up 08/19 09:21:25 DEBUG|autotest_r:0100| Using existing host autodir: /usr/local/autotest 08/19 09:21:25 DEBUG|autotest_r:0562| Remote control file: /usr/local/autotest/control.autoserv 08/19 09:21:25 DEBUG|autotest_r:0563| Remote control init state: /usr/local/autotest/tmp/control.autoserv.init.state 08/19 09:21:25 DEBUG|autotest_r:0564| Remote control state: /usr/local/autotest/tmp/control.autoserv.state 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'test -x /usr/local/autotest/autotest' 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'umount /usr/local/autotest/tmp' 08/19 09:21:25 DEBUG|base_utils:0114| [stderr] umount: /usr/local/autotest/tmp: not mounted 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'umount /usr/local/autotest/tests/download' 08/19 09:21:25 DEBUG|base_utils:0114| [stderr] umount: /usr/local/autotest/tests/download: not found 08/19 09:21:25 DEBUG| ssh_host:0114| Running (ssh) 'test -x /usr/local/autotest/autotest' 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'umount /usr/local/autotest/tmp' 08/19 09:21:26 DEBUG|base_utils:0114| [stderr] umount: /usr/local/autotest/tmp: not mounted 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'umount /usr/local/autotest/tests/download' 08/19 09:21:26 DEBUG|base_utils:0114| [stderr] umount: /usr/local/autotest/tests/download: not found 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'rm -f /usr/local/autotest/control.autoserv;rm -f /usr/local/autotest/tmp/control.autoserv.state;rm -f /usr/local/autotest/control;rm -f /usr/local/autotest/tmp/control.state' 08/19 09:21:26 DEBUG| base_job:0348| Persistent state client.sysinfo now set to {'test': set([sysinfo.command('dmesg -c', 'dmesg', False), sysinfo.command('df -mP', 'df', False)]), 'boot': set([sysinfo.command('gcc --version', 'gcc--version', False), sysinfo.command('ld --version', 'ld--version', False), sysinfo.logfile('/proc/partitions', 'partitions', False), sysinfo.logfile('/proc/interrupts', 'interrupts', False), sysinfo.command('hostname', 'hostname', False), sysinfo.command('lspci -vvnn', 'lspci-vvnn', False), sysinfo.command('mount', 'mount', False), sysinfo.logfile('/proc/cmdline', 'cmdline', True), sysinfo.logfile('/proc/version', 'version', False), sysinfo.logfile('/proc/slabinfo', 'slabinfo', False), sysinfo.logfile('/proc/modules', 'modules', False), sysinfo.logfile('/proc/mounts', 'proc_mounts', False), sysinfo.logfile('/proc/cpuinfo', 'cpuinfo', False), sysinfo.command('uptime', 'uptime', False), sysinfo.logfile('/proc/pci', 'pci', False), sysinfo.logfile('/proc/meminfo', 'meminfo', False), sysinfo.command('dmidecode', 'dmidecode', False), sysinfo.command('uname -a', 'uname', True)])} 08/19 09:21:26 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/tmp/tmp/tmpbMEkJz [email protected]:"/usr/local/autotest/tmp/control.autoserv.init.state"' 08/19 09:21:26 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /tmp/autoserv-yMApq9/tmp7EkObc [email protected]:"/usr/local/autotest/control.autoserv"' 08/19 09:21:26 DEBUG|autotest_r:0957| Log collector initialized 08/19 09:21:26 DEBUG|autotest_r:0958| Client results dir: /usr/local/autotest/results/default 08/19 09:21:26 DEBUG|autotest_r:0959| Server results dir: /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com 08/19 09:21:26 DEBUG|autotest_r:0957| Log collector initialized 08/19 09:21:26 DEBUG|autotest_r:0958| Client results dir: /usr/local/autotest/results/default 08/19 09:21:26 DEBUG|autotest_r:0959| Server results dir: /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'if [ -f '/proc/sys/kernel/random/boot_id' ]; then cat '/proc/sys/kernel/random/boot_id'; else echo 'no boot_id available'; fi' 08/19 09:21:26 DEBUG|base_utils:0114| [stdout] f68628d7-750a-4d9f-b22f-93be2b458883 08/19 09:21:26 INFO |autotest_r:0822| Executing /usr/local/autotest/autotest /usr/local/autotest/control.autoserv phase 0 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p /tmp' 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'mktemp -d /tmp/autoserv-XXXXXX' 08/19 09:21:26 DEBUG|base_utils:0114| [stdout] /tmp/autoserv-WLhUQa 08/19 09:21:26 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/tmp/tmp/tmp_CxXA3 [email protected]:"/usr/local/autotest/global_config.ini"' 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'nohup /usr/local/autotest/autotestd /tmp/autoserv-WLhUQa -H autoserv --verbose --hostname=autotestcl.happiestminds.com --user=debug_user /usr/local/autotest/control.autoserv >/dev/null 2>/dev/null &' 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) '/usr/local/autotest/autotestd_monitor /tmp/autoserv-WLhUQa 0 0' 08/19 09:21:26 INFO |server_job:0118| START ---- ---- timestamp=1376904090 localtime=Aug 19 09:21:30
08/19 09:21:26 DEBUG| version_1:0229| STATUS: START ---- ---- timestamp=1376904090 localtime=Aug 19 09:21:30 08/19 09:21:26 INFO | models:0138| parsing partial test None CLIENT_JOB.0 08/19 09:21:26 DEBUG| version_1:0265| RUNNING: RUNNING 08/19 09:21:26 DEBUG| version_1:0266| Testname: CLIENT_JOB.0 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'echo B > /var/lib/autotest/tmp/_autotmp_Jq4UDUharness-fifo/autoserv.fifo' 08/19 09:21:26 INFO |server_job:0118| START synctest synctest timestamp=1376904090 localtime=Aug 19 09:21:30
08/19 09:21:26 DEBUG| version_1:0229| STATUS: START synctest synctest timestamp=1376904090 localtime=Aug 19 09:21:30 08/19 09:21:26 INFO | models:0138| parsing partial test synctest synctest 08/19 09:21:26 DEBUG| version_1:0279| RUNNING: RUNNING 08/19 09:21:26 DEBUG| version_1:0280| Subdir: synctest 08/19 09:21:26 DEBUG| version_1:0281| Testname: synctest 08/19 09:21:26 DEBUG| version_1:0282| Reason: 08/19 09:21:26 INFO |autotest_r:1162| Bundling /usr/local/autotest/client/tests/synctest into test-synctest.tar.bz2 08/19 09:21:26 DEBUG|base_utils:0077| Running 'tar -cf /usr/local/autotest/tmp/tmp/_autotmp_ljEm31autoserv-packager/test-synctest.tar.bz2.tmp -C /usr/local/autotest/client/tests/synctest -j .' 08/19 09:21:26 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/tmp/tmp/_autotmp_ljEm31autoserv-packager/test-synctest.tar.bz2 [email protected]:"/var/lib/autotest/packages/test-synctest.tar.bz2"' 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'echo B > /var/lib/autotest/tmp/_autotmp_4DJNMgharness-fifo/autoserv.fifo' 08/19 09:21:26 DEBUG| ssh_host:0114| Running (ssh) 'echo B > /var/lib/autotest/tmp/_autotmp_z1tNqsharness-fifo/autoserv.fifo' 08/19 09:21:27 INFO |server_job:0118| ERROR synctest synctest timestamp=1376904091 localtime=Aug 19 09:21:31 Command failed, rc=2, Command returned non-zero exit status 08/19 09:21:27 DEBUG| version_1:0229| STATUS: ERROR synctest synctest timestamp=1376904091 localtime=Aug 19 09:21:31 Command failed, rc=2, Command returned non-zero exit status 08/19 09:21:27 DEBUG| version_1:0316| update RUNNING reason: Command failed, rc=2, Command returned non-zero exit status 08/19 09:21:27 INFO |server_job:0118| END ERROR synctest synctest timestamp=1376904091 localtime=Aug 19 09:21:31
08/19 09:21:27 DEBUG| version_1:0229| STATUS: END ERROR synctest synctest timestamp=1376904091 localtime=Aug 19 09:21:31 08/19 09:21:27 INFO | models:0100| parsing test synctest synctest 08/19 09:21:27 DEBUG| version_1:0386| ADD: ERROR 08/19 09:21:27 DEBUG| version_1:0387| Subdir: synctest 08/19 09:21:27 DEBUG| version_1:0388| Testname: synctest 08/19 09:21:27 DEBUG| version_1:0389| Command failed, rc=2, Command returned non-zero exit status 08/19 09:21:27 DEBUG| ssh_host:0114| Running (ssh) 'true' 08/19 09:21:27 DEBUG|abstract_s:0455| Host autotestcl.happiestminds.com is now up 08/19 09:21:27 DEBUG|base_utils:0077| Running 'rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com' 08/19 09:21:27 WARNI|abstract_s:0285| trying scp, rsync failed: Command <rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com> failed, rc=23, Command returned non-zero exit status

• Command: rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp /_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com Exit status: 23 Duration: 0.138426065445

stderr: rsync: change_dir "/usr/local/autotest/results/default" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1518) [Receiver=3.0.9] 08/19 09:21:27 DEBUG| ssh_host:0114| Running (ssh) 'ls "/usr/local/autotest/results/default/"' 08/19 09:21:27 DEBUG|base_utils:0114| [stderr] ls: cannot access /usr/local/autotest/results/default/: No such file or directory 08/19 09:21:27 DEBUG| ssh_host:0114| Running (ssh) 'ls "/usr/local/autotest/results/default/".[!.]' 08/19 09:21:27 DEBUG|base_utils:0114| [stderr] ls: cannot access /usr/local/autotest/results/default/.[!.]: No such file or directory 08/19 09:21:27 DEBUG| ssh_host:0114| Running (ssh) 'echo A > /var/lib/autotest/tmp/_autotmp_MDW0JIharness-fifo/autoserv.fifo' 08/19 09:21:27 INFO |server_job:0118| END GOOD ---- ---- timestamp=1376904091 localtime=Aug 19 09:21:31
08/19 09:21:27 DEBUG| version_1:0229| STATUS: END GOOD ---- ---- timestamp=1376904091 localtime=Aug 19 09:21:31 08/19 09:21:27 INFO | models:0100| parsing test None CLIENT_JOB.0 08/19 09:21:27 DEBUG| version_1:0386| ADD: GOOD 08/19 09:21:27 DEBUG| version_1:0387| Subdir: None 08/19 09:21:27 DEBUG| version_1:0388| Testname: CLIENT_JOB.0 08/19 09:21:27 DEBUG| version_1:0389| 08/19 09:21:29 INFO |autotest_r:0907| Client complete 08/19 09:21:29 DEBUG| ssh_host:0114| Running (ssh) 'true' 08/19 09:21:29 DEBUG|abstract_s:0455| Host autotestcl.happiestminds.com is now up 08/19 09:21:29 DEBUG|base_utils:0077| Running 'rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com' 08/19 09:21:29 WARNI|abstract_s:0285| trying scp, rsync failed: Command <rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com> failed, rc=23, Command returned non-zero exit status

• Command: rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp /_autotmp__5Wq7qssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmptJvgfa -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com Exit status: 23 Duration: 0.119127035141

stderr: rsync: change_dir "/usr/local/autotest/results/default" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1518) [Receiver=3.0.9] 08/19 09:21:29 DEBUG| ssh_host:0114| Running (ssh) 'ls "/usr/local/autotest/results/default/"' 08/19 09:21:29 DEBUG|base_utils:0114| [stderr] ls: cannot access /usr/local/autotest/results/default/: No such file or directory 08/19 09:21:29 DEBUG| ssh_host:0114| Running (ssh) 'ls "/usr/local/autotest/results/default/".[!.]' 08/19 09:21:29 DEBUG|base_utils:0114| [stderr] ls: cannot access /usr/local/autotest/results/default/.[!.]: No such file or directory 08/19 09:21:29 DEBUG|server_job:1089| Client state file /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com/control.autoserv.state not found 08/19 09:21:29 DEBUG| base_job:0390| Persistent state client.* deleted 08/19 09:21:29 INFO |server_job:0537| Finished processing control file 08/19 09:21:29 DEBUG| ssh_host:0114| Running (ssh) 'rm -rf "/tmp/autoserv-WLhUQa"' 08/19 09:21:30 INFO | models:0100| parsing test ---- SERVER_JOB 08/19 09:21:52 INFO | autoserv:0205| Results placed in /usr/local/autotest/results/11-debug_user/autotestcl.happiestminds.com 08/19 09:21:52 DEBUG| base_job:0348| Persistent state global_properties.tag now set to '' 08/19 09:21:52 DEBUG| base_job:0348| Persistent state global_properties.last_boot_tag now set to None 08/19 09:21:52 INFO |server_job:0535| Processing control file 08/19 09:21:52 INFO |server_job:0537| Finished processing control file

Similarly in other tests also like in aiostress its job status is as follows---

and job debug log is as follows---- Job debug log 08/19 06:56:27 INFO | autoserv:0205| Results placed in /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com 08/19 06:56:27 DEBUG| base_job:0348| Persistent state global_properties.tag now set to '5-debug_user/autotestcl.happiestminds.com' 08/19 06:56:27 DEBUG| base_job:0348| Persistent state global_properties.last_boot_tag now set to None 08/19 06:56:27 DEBUG| version_0:0021| {'drone': 'autotestserver.happiestminds.com', 'job_queued': 1376895368, 'job_started': 1376895387, 'user': 'debug_user', 'hostname': 'autotestcl.happiestminds.com', 'status_version': 1, 'label': 'aioJob3_1'} 08/19 06:56:27 DEBUG| version_0:0060| MACHINE NAME: autotestcl.happiestminds.com 08/19 06:56:27 DEBUG| version_0:0076| MACHINE GROUP: None 08/19 06:56:29 INFO |server_job:0535| Processing control file 08/19 06:56:29 DEBUG|base_utils:0252| Detected OS vendor: Fedora 08/19 06:56:29 DEBUG| ssh_host:0114| Running (ssh) 'test -f /var/log/messages' 08/19 06:56:29 INFO |abstract_s:0615| Starting master ssh connection '/usr/bin/ssh -a -x -N -o ControlMaster=yes -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22 autotestcl.happiestminds.com' 08/19 06:56:29 DEBUG|base_utils:0077| Running '/usr/bin/ssh -a -x -N -o ControlMaster=yes -o ControlPath=/tmp/autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22 autotestcl.happiestminds.com' 08/19 06:56:29 ERROR|base_utils:0114| [stderr] Warning: Permanently added 'autotestcl.happiestminds.com,10.18.26.78' (RSA) to the list of known hosts. 08/19 06:56:30 DEBUG| remote:0182| Found remote path /var/log/messages 08/19 06:56:30 DEBUG| ssh_host:0114| Running (ssh) 'rm -f /var/tmp/messages.autotest_start' 08/19 06:56:30 DEBUG| ssh_host:0114| Running (ssh) 'cp /var/log/messages /var/tmp/messages.autotest_start' 08/19 06:56:30 DEBUG| ssh_host:0114| Running (ssh) '/bin/uname -r' 08/19 06:56:30 DEBUG|base_utils:0114| [stdout] 3.9.5-301.fc19.x86_64 08/19 06:56:30 INFO |server_job:0118| INFO ---- ---- kernel=3.9.5-301.fc19.x86_64 localtime=Aug 19 06:56:30 timestamp=1376895390
08/19 06:56:30 INFO | models:0138| parsing partial test ---- SERVER_JOB 08/19 06:56:30 DEBUG| version_1:0229| STATUS: INFO ---- ---- kernel=3.9.5-301.fc19.x86_64 localtime=Aug 19 06:56:30 timestamp=1376895390 08/19 06:56:30 DEBUG|base_utils:0077| Running 'tools/make_clean' 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning iosched_bugs test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning rtc test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning aio_dio_bugs test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning hackbench test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning tsc test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning monotonic_time test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning signaltest test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning synctest test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning tracing_microbenchmark test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning ipv6connect test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning rmaptest test dir 08/19 06:56:33 DEBUG|base_utils:0114| [stdout] Cleaning cyclictest test dir 08/19 06:56:33 DEBUG| ssh_host:0114| Running (ssh) 'true' 08/19 06:56:33 DEBUG|abstract_s:0455| Host autotestcl.happiestminds.com is now up 08/19 06:56:33 INFO |autotest_r:0263| Installing autotest on autotestcl.happiestminds.com 08/19 06:56:33 DEBUG| ssh_host:0114| Running (ssh) 'test -x /usr/local/autotest/autotest' 08/19 06:56:33 DEBUG| ssh_host:0114| Running (ssh) 'test -w /usr/local/autotest' 08/19 06:56:33 DEBUG|autotest_r:0109| Found existing autodir at /usr/local/autotest 08/19 06:56:33 INFO |autotest_r:0292| Using installation dir /usr/local/autotest 08/19 06:56:33 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p /usr/local/autotest' 08/19 06:56:33 DEBUG| ssh_host:0114| Running (ssh) 'rm -rf /usr/local/autotest/results/*' 08/19 06:56:33 INFO |autotest_r:0312| Could not install autotest using the packaging system: No repos to install an autotest client from. Trying other methods 08/19 06:56:33 DEBUG| ssh_host:0114| Running (ssh) 'rsync --version' 08/19 06:56:33 DEBUG|base_utils:0077| Running 'rsync -L --delete --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/client/profiler.py /usr/local/autotest/client/job.pyc /usr/local/autotest/client/setup_modules.pyc /usr/local/autotest/client/shared /usr/local/autotest/client/kernel.pyc /usr/local/autotest/client/samples /usr/local/autotest/client/kernelexpand_unittest.py /usr/local/autotest/client/autotest-local-streamhandler /usr/local/autotest/client/harness_simple.py /usr/local/autotest/client/setup.py /usr/local/autotest/client/autotest-daemon-monitor /usr/local/autotest/client/kernel_unittest.py /usr/local/autotest/client/parallel.py /usr/local/autotest/client/cmdparser.py /usr/local/autotest/client/base_sysinfo.py /usr/local/autotest/client/TODO /usr/local/autotest/client/harness_beaker.py /usr/local/autotest/client/autotest_local.py /usr/local/autotest/client/config.py /usr/local/autotest/client/partition_unittest.py /usr/local/autotest/client/client_logging_config.pyc /usr/local/autotest/client/net /usr/local/autotest/client/fsinfo_unittest.py /usr/local/autotest/client/config /usr/local/autotest/client/autotest_client /usr/local/autotest/client/local_host_unittest.py /usr/local/autotest/client/client_logging_config.py /usr/local/autotest/client/partition.pyc /usr/local/autotest/client/cpuset.py /usr/local/autotest/client/kernel_config.pyc /usr/local/autotest/client/autotest-daemon /usr/local/autotest/client/common.py /usr/local/autotest/client/job.py /usr/local/autotest/client/init.pyc /usr/local/autotest/client/bkr_xml.py /usr/local/autotest/client/base_utils.pyc /usr/local/autotest/client/job_unittest.py /usr/local/autotest/client/test.py /usr/local/autotest/client/optparser.py /usr/local/autotest/client/init.py /usr/local/autotest/client/bkr_proxy.py /usr/local/autotest/client/fsinfo.py /usr/local/autotest/client/rhts-reboot /usr/local/autotest/client/fsdev_mgr.py /usr/local/autotest/client/lv_utils.py /usr/local/autotest/client/harness_ABAT.py /usr/local/autotest/client/kvm_control_unittest.py /usr/local/autotest/client/local_host.pyc /usr/local/autotest/client/kernel_config.py /usr/local/autotest/client/autotest-local /usr/local/autotest/client/kernelexpand.py /usr/local/autotest/client/setup_modules.py /usr/local/autotest/client/partition.py /usr/local/autotest/client/harness_standalone.py /usr/local/autotest/client/rhts_submit_log /usr/local/autotest/client/autotestd /usr/local/autotest/client/tools /usr/local/autotest/client/base_sysinfo.pyc /usr/local/autotest/client/autotest /usr/local/autotest/client/xen.py /usr/local/autotest/client/kernel_versions.py /usr/local/autotest/client/harness.pyc /usr/local/autotest/client/os_dep.py /usr/local/autotest/client/kvm_control.py /usr/local/autotest/client/setup_job_unittest.py /usr/local/autotest/client/local_host.py /usr/local/autotest/client/config.pyc /usr/local/autotest/client/sysinfo.pyc /usr/local/autotest/client/xen.pyc /usr/local/autotest/client/parallel.pyc /usr/local/autotest/client/fsdev_disks.py /usr/local/autotest/client/harness.py /usr/local/autotest/client/harness_unittest.py /usr/local/autotest/client/utils.py /usr/local/autotest/client/kernel_config_unittest.py /usr/local/autotest/client/sysinfo.py /usr/local/autotest/client/test.pyc /usr/local/autotest/client/test_config.py /usr/local/autotest/client/rhts-submit-log /usr/local/autotest/client/kernel.py /usr/local/autotest/client/harness_autoserv.py /usr/local/autotest/client/fsdev_disks_unittest.py /usr/local/autotest/client/kernelexpand.pyc /usr/local/autotest/client/setup_job.pyc /usr/local/autotest/client/os_dep.pyc /usr/local/autotest/client/setup_job.py /usr/local/autotest/client/autotestd_monitor /usr/local/autotest/client/utils.pyc /usr/local/autotest/client/kernel_versions_unittest.py /usr/local/autotest/client/rhts-report-result /usr/local/autotest/client/LICENSE /usr/local/autotest/client/base_utils.py /usr/local/autotest/client/deps/grubby/grubby-8.15.tar.bz2 [email protected]:"/usr/local/autotest"' 08/19 06:56:33 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p /usr/local/autotest/profilers' 08/19 06:56:34 DEBUG|base_utils:0077| Running 'rsync -L --delete --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/client/profilers/init.py [email protected]:"/usr/local/autotest/profilers"' 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p '/usr/local/autotest/site_tests';touch '/usr/local/autotest/site_tests'/init.py;mkdir -p '/usr/local/autotest/tests';touch '/usr/local/autotest/tests'/init.py;mkdir -p '/usr/local/autotest/deps';touch '/usr/local/autotest/deps'/init.py' 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p /usr/local/autotest/tmp' 08/19 06:56:34 INFO |autotest_r:0325| Installation of autotest completed 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'true' 08/19 06:56:34 DEBUG|abstract_s:0455| Host autotestcl.happiestminds.com is now up 08/19 06:56:34 DEBUG|autotest_r:0100| Using existing host autodir: /usr/local/autotest 08/19 06:56:34 DEBUG|autotest_r:0562| Remote control file: /usr/local/autotest/control.autoserv 08/19 06:56:34 DEBUG|autotest_r:0563| Remote control init state: /usr/local/autotest/tmp/control.autoserv.init.state 08/19 06:56:34 DEBUG|autotest_r:0564| Remote control state: /usr/local/autotest/tmp/control.autoserv.state 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'test -x /usr/local/autotest/autotest' 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'umount /usr/local/autotest/tmp' 08/19 06:56:34 DEBUG|base_utils:0114| [stderr] umount: /usr/local/autotest/tmp: not mounted 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'umount /usr/local/autotest/tests/download' 08/19 06:56:34 DEBUG|base_utils:0114| [stderr] umount: /usr/local/autotest/tests/download: not found 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'test -x /usr/local/autotest/autotest' 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'umount /usr/local/autotest/tmp' 08/19 06:56:34 DEBUG|base_utils:0114| [stderr] umount: /usr/local/autotest/tmp: not mounted 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'umount /usr/local/autotest/tests/download' 08/19 06:56:34 DEBUG|base_utils:0114| [stderr] umount: /usr/local/autotest/tests/download: not found 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'rm -f /usr/local/autotest/control.autoserv;rm -f /usr/local/autotest/tmp/control.autoserv.state;rm -f /usr/local/autotest/control;rm -f /usr/local/autotest/tmp/control.state' 08/19 06:56:34 DEBUG| base_job:0348| Persistent state client.sysinfo now set to {'test': set([sysinfo.command('dmesg -c', 'dmesg', False), sysinfo.command('df -mP', 'df', False)]), 'boot': set([sysinfo.command('gcc --version', 'gcc--version', False), sysinfo.command('ld --version', 'ld--version', False), sysinfo.logfile('/proc/partitions', 'partitions', False), sysinfo.logfile('/proc/interrupts', 'interrupts', False), sysinfo.command('hostname', 'hostname', False), sysinfo.command('lspci -vvnn', 'lspci-vvnn', False), sysinfo.command('mount', 'mount', False), sysinfo.logfile('/proc/cmdline', 'cmdline', True), sysinfo.logfile('/proc/version', 'version', False), sysinfo.logfile('/proc/slabinfo', 'slabinfo', False), sysinfo.logfile('/proc/modules', 'modules', False), sysinfo.logfile('/proc/mounts', 'proc_mounts', False), sysinfo.logfile('/proc/cpuinfo', 'cpuinfo', False), sysinfo.command('uptime', 'uptime', False), sysinfo.logfile('/proc/pci', 'pci', False), sysinfo.logfile('/proc/meminfo', 'meminfo', False), sysinfo.command('dmidecode', 'dmidecode', False), sysinfo.command('uname -a', 'uname', True)])} 08/19 06:56:34 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/tmp/tmp/tmpf0tOXb [email protected]:"/usr/local/autotest/tmp/control.autoserv.init.state"' 08/19 06:56:34 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /tmp/autoserv-AfWqlA/tmpFHlXiK [email protected]:"/usr/local/autotest/control.autoserv"' 08/19 06:56:34 DEBUG|autotest_r:0957| Log collector initialized 08/19 06:56:34 DEBUG|autotest_r:0958| Client results dir: /usr/local/autotest/results/default 08/19 06:56:34 DEBUG|autotest_r:0959| Server results dir: /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com 08/19 06:56:34 DEBUG|autotest_r:0957| Log collector initialized 08/19 06:56:34 DEBUG|autotest_r:0958| Client results dir: /usr/local/autotest/results/default 08/19 06:56:34 DEBUG|autotest_r:0959| Server results dir: /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'if [ -f '/proc/sys/kernel/random/boot_id' ]; then cat '/proc/sys/kernel/random/boot_id'; else echo 'no boot_id available'; fi' 08/19 06:56:34 DEBUG|base_utils:0114| [stdout] f68628d7-750a-4d9f-b22f-93be2b458883 08/19 06:56:34 INFO |autotest_r:0822| Executing /usr/local/autotest/autotest /usr/local/autotest/control.autoserv phase 0 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'mkdir -p /tmp' 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'mktemp -d /tmp/autoserv-XXXXXX' 08/19 06:56:34 DEBUG|base_utils:0114| [stdout] /tmp/autoserv-ex7lAu 08/19 06:56:34 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/tmp/tmp/tmpVJKTRF [email protected]:"/usr/local/autotest/global_config.ini"' 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'nohup /usr/local/autotest/autotestd /tmp/autoserv-ex7lAu -H autoserv --verbose --hostname=autotestcl.happiestminds.com --user=debug_user /usr/local/autotest/control.autoserv >/dev/null 2>/dev/null &' 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) '/usr/local/autotest/autotestd_monitor /tmp/autoserv-ex7lAu 0 0' 08/19 06:56:34 INFO |server_job:0118| START ---- ---- timestamp=1376895398 localtime=Aug 19 06:56:38
08/19 06:56:34 DEBUG| version_1:0229| STATUS: START ---- ---- timestamp=1376895398 localtime=Aug 19 06:56:38 08/19 06:56:34 INFO | models:0138| parsing partial test None CLIENT_JOB.0 08/19 06:56:34 DEBUG| version_1:0265| RUNNING: RUNNING 08/19 06:56:34 DEBUG| version_1:0266| Testname: CLIENT_JOB.0 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'echo B > /var/lib/autotest/tmp/_autotmp_LbuSf7harness-fifo/autoserv.fifo' 08/19 06:56:34 INFO |server_job:0118| START aiostress aiostress timestamp=1376895398 localtime=Aug 19 06:56:38
08/19 06:56:34 DEBUG| version_1:0229| STATUS: START aiostress aiostress timestamp=1376895398 localtime=Aug 19 06:56:38 08/19 06:56:34 INFO | models:0138| parsing partial test aiostress aiostress 08/19 06:56:34 DEBUG| version_1:0279| RUNNING: RUNNING 08/19 06:56:34 DEBUG| version_1:0280| Subdir: aiostress 08/19 06:56:34 DEBUG| version_1:0281| Testname: aiostress 08/19 06:56:34 DEBUG| version_1:0282| Reason: 08/19 06:56:34 DEBUG| ssh_host:0114| Running (ssh) 'echo B > /var/lib/autotest/tmp/_autotmp_lV9BY4harness-fifo/autoserv.fifo' 08/19 06:56:34 INFO |autotest_r:1162| Bundling /usr/local/autotest/client/tests/aiostress into test-aiostress.tar.bz2 08/19 06:56:34 DEBUG|base_utils:0077| Running 'tar -cf /usr/local/autotest/tmp/tmp/_autotmp_VXn75zautoserv-packager/test-aiostress.tar.bz2.tmp -C /usr/local/autotest/client/tests/aiostress -j .' 08/19 06:56:35 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/tmp/tmp/_autotmp_VXn75zautoserv-packager/test-aiostress.tar.bz2 [email protected]:"/var/lib/autotest/packages/test-aiostress.tar.bz2"' 08/19 06:56:35 DEBUG| ssh_host:0114| Running (ssh) 'echo B > /var/lib/autotest/tmp/_autotmp_6LizTEharness-fifo/autoserv.fifo' 08/19 06:56:35 DEBUG| ssh_host:0114| Running (ssh) 'echo B > /var/lib/autotest/tmp/_autotmp_tPONVKharness-fifo/autoserv.fifo' 08/19 06:56:35 INFO |autotest_r:1162| Bundling /usr/local/autotest/client/deps/libaio into dep-libaio.tar.bz2 08/19 06:56:35 DEBUG|base_utils:0077| Running 'tar -cf /usr/local/autotest/tmp/tmp/_autotmp_Kh12cyautoserv-packager/dep-libaio.tar.bz2.tmp -C /usr/local/autotest/client/deps/libaio -j .' 08/19 06:56:35 DEBUG|base_utils:0077| Running 'rsync -L --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az /usr/local/autotest/tmp/tmp/_autotmp_Kh12cyautoserv-packager/dep-libaio.tar.bz2 [email protected]:"/var/lib/autotest/packages/dep-libaio.tar.bz2"' 08/19 06:56:35 DEBUG| ssh_host:0114| Running (ssh) 'echo B > /var/lib/autotest/tmp/_autotmp_sGjoejharness-fifo/autoserv.fifo' 08/19 06:56:35 INFO |server_job:0118| ERROR aiostress aiostress timestamp=1376895399 localtime=Aug 19 06:56:39 Command <patch -p1 < ../00_arches.patch> failed, rc=127, Command returned non-zero exit status 08/19 06:56:35 DEBUG| version_1:0229| STATUS: ERROR aiostress aiostress timestamp=1376895399 localtime=Aug 19 06:56:39 Command <patch -p1 < ../00_arches.patch> failed, rc=127, Command returned non-zero exit status 08/19 06:56:35 DEBUG| version_1:0316| update RUNNING reason: Command <patch -p1 < ../00_arches.patch> failed, rc=127, Command returned non-zero exit status 08/19 06:56:35 INFO |server_job:0118| END ERROR aiostress aiostress timestamp=1376895399 localtime=Aug 19 06:56:39
08/19 06:56:35 DEBUG| version_1:0229| STATUS: END ERROR aiostress aiostress timestamp=1376895399 localtime=Aug 19 06:56:39 08/19 06:56:35 INFO | models:0100| parsing test aiostress aiostress 08/19 06:56:35 DEBUG| version_1:0386| ADD: ERROR 08/19 06:56:35 DEBUG| version_1:0387| Subdir: aiostress 08/19 06:56:35 DEBUG| version_1:0388| Testname: aiostress 08/19 06:56:35 DEBUG| version_1:0389| Command <patch -p1 < ../00_arches.patch> failed, rc=127, Command returned non-zero exit status 08/19 06:56:35 DEBUG| ssh_host:0114| Running (ssh) 'true' 08/19 06:56:35 DEBUG|abstract_s:0455| Host autotestcl.happiestminds.com is now up 08/19 06:56:35 DEBUG|base_utils:0077| Running 'rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com' 08/19 06:56:35 WARNI|abstract_s:0285| trying scp, rsync failed: Command <rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com> failed, rc=23, Command returned non-zero exit status

• Command: rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp /_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com Exit status: 23 Duration: 0.137843132019

stderr: rsync: change_dir "/usr/local/autotest/results/default" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1518) [Receiver=3.0.9] 08/19 06:56:35 DEBUG| ssh_host:0114| Running (ssh) 'ls "/usr/local/autotest/results/default/"' 08/19 06:56:35 DEBUG|base_utils:0114| [stderr] ls: cannot access /usr/local/autotest/results/default/: No such file or directory 08/19 06:56:35 DEBUG| ssh_host:0114| Running (ssh) 'ls "/usr/local/autotest/results/default/".[!.]' 08/19 06:56:35 DEBUG|base_utils:0114| [stderr] ls: cannot access /usr/local/autotest/results/default/.[!.]: No such file or directory 08/19 06:56:35 DEBUG| ssh_host:0114| Running (ssh) 'echo A > /var/lib/autotest/tmp/_autotmp_ynPybWharness-fifo/autoserv.fifo' 08/19 06:56:35 INFO |server_job:0118| END GOOD ---- ---- timestamp=1376895399 localtime=Aug 19 06:56:39
08/19 06:56:35 DEBUG| version_1:0229| STATUS: END GOOD ---- ---- timestamp=1376895399 localtime=Aug 19 06:56:39 08/19 06:56:35 INFO | models:0100| parsing test None CLIENT_JOB.0 08/19 06:56:35 DEBUG| version_1:0386| ADD: GOOD 08/19 06:56:35 DEBUG| version_1:0387| Subdir: None 08/19 06:56:35 DEBUG| version_1:0388| Testname: CLIENT_JOB.0 08/19 06:56:35 DEBUG| version_1:0389| 08/19 06:56:37 INFO |autotest_r:0907| Client complete 08/19 06:56:37 DEBUG| ssh_host:0114| Running (ssh) 'true' 08/19 06:56:38 DEBUG|abstract_s:0455| Host autotestcl.happiestminds.com is now up 08/19 06:56:38 DEBUG|base_utils:0077| Running 'rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com' 08/19 06:56:38 WARNI|abstract_s:0285| trying scp, rsync failed: Command <rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp/_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com> failed, rc=23, Command returned non-zero exit status

• Command: rsync --timeout=1800 --rsh='/usr/bin/ssh -a -x -o ControlPath=/tmp /_autotmp_6uvMRXssh-master/socket -o StrictHostKeyChecking=no -o UserKnownHostsFile=/tmp/tmpPc3A9Y -o BatchMode=yes -o ConnectTimeout=30 -o ServerAliveInterval=300 -l root -p 22' -az [email protected]:"/usr/local/autotest/results/default/" /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com Exit status: 23 Duration: 0.136088132858

stderr: rsync: change_dir "/usr/local/autotest/results/default" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1518) [Receiver=3.0.9] 08/19 06:56:38 DEBUG| ssh_host:0114| Running (ssh) 'ls "/usr/local/autotest/results/default/"' 08/19 06:56:38 DEBUG|base_utils:0114| [stderr] ls: cannot access /usr/local/autotest/results/default/: No such file or directory 08/19 06:56:38 DEBUG| ssh_host:0114| Running (ssh) 'ls "/usr/local/autotest/results/default/".[!.]' 08/19 06:56:38 DEBUG|base_utils:0114| [stderr] ls: cannot access /usr/local/autotest/results/default/.[!.]: No such file or directory 08/19 06:56:38 DEBUG|server_job:1089| Client state file /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com/control.autoserv.state not found 08/19 06:56:38 DEBUG| base_job:0390| Persistent state client.* deleted 08/19 06:56:38 INFO |server_job:0537| Finished processing control file 08/19 06:56:38 DEBUG| ssh_host:0114| Running (ssh) 'rm -rf "/tmp/autoserv-ex7lAu"' 08/19 06:56:39 INFO | models:0100| parsing test ---- SERVER_JOB 08/19 06:57:03 INFO | autoserv:0205| Results placed in /usr/local/autotest/results/5-debug_user/autotestcl.happiestminds.com 08/19 06:57:03 DEBUG| base_job:0348| Persistent state global_properties.tag now set to '' 08/19 06:57:03 DEBUG| base_job:0348| Persistent state global_properties.last_boot_tag now set to None 08/19 06:57:03 INFO |server_job:0535| Processing control file 08/19 06:57:03 INFO |server_job:0537| Finished processing control file

One thing i dont get is why in every run its installing autotest on client machine? how to skip that also? Also its unable to create a results dir also in autotest. Kindly help please.

[lmr]

It seems clear that the failures you are seeing are due to no development packages installed on your test system (no make, no patch installed). You have to install development packages if you want to run tests that involve compiling test suites.

About the autotest client being "installed" every time, in fact, only an rsync is made as an atttempt to update the client with new code (if any). Autotest is working as designed here, therefore no need to fix it.

[ghost]

What kind of development packages? Can you please guide with some? Thanks for replying

[lmr]

GCC, make, autoconf... On Fedora and Ubuntu/Debian, most of them can be installed with:

yum groupinstall "Development Tools"
apt-get install build-essential

This won't install each and every package that some of the test modules require, but it is a good start. It seems that you don't have experience with development on the linux platform. That is likely to be the source of the many problems you are facing with autotest. Our development team has limited time to answer issues, so please take some time to study and get used to the platform. This certainly is not meant to be rude, but we'd like to optimize resources as much as possible.