run_docker.bash failed, No module named 'yaml'

[Nathaniel100]

we meet a problem that it turned out lack the package of 'yaml', we also tried to change the Pipfile adding the PyYAML module, but it failed as well, with errors of lacking other packages e.g. 'google-cloud'.

The setup was conducted in following steps:

1. we built all the images in script of build.sh (15 images in total )
2. The metadata server has been started up.
3. we try to start run with run_docker.sh under dir of /local

Could any one provide any clue on this issue? or anywhere we didn't put it correct?

LOCAL_SRC=1 CONFIG_DIR_OVERRIDE=/home/XXX/.config/ ./run_docker.bash fe9e6632819f

Bash Outputs:

• source /data/setup_common.sh ++ source /data/setup_mock_metadata.sh +++ [[ -n 172.17.0.1 ]] +++ ip addr add 169.254.169.254/32 dev lo +++ echo '127.0.0.1 metadata metadata.google.internal' +++ socat TCP-LISTEN:80,fork,reuseaddr TCP:172.17.0.1:8080 ++ [[ clusterfuzz != \r\o\o\t ]] ++ export HOST_UID=1000 ++ HOST_UID=1000 ++ useradd -mU -G nopwsudo -u 1000 clusterfuzz ++ mkdir -p /mnt/scratch0/tmp ++ chmod 777 /mnt/scratch0/tmp ++ export HOSTNAME=test-bot-deep2 ++ HOSTNAME=test-bot-deep2 ++ [[ test-bot-deep2 =~ -pre- ]] ++ mount /mnt/scratch0 -o remount,exec,suid,dev ++ [[ -z '' ]] ++ rm /dev/random ++ ln -s /dev/urandom /dev/random ++ [[ -z 1 ]] ++ mkdir -p /home/clusterfuzz/Downloads ++ chmod 111 /home/clusterfuzz/Downloads ++ ulimit -n 65535
• source /data/setup_clusterfuzz.sh ++ '[' -z '' ']' +++ curl -H 'Metadata-Flavor: Google' http://metadata.google.internal/computeMetadata/v1/project/attributes/deployment-bucket % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- 0:02:10 --:--:-- 02021/03/25 06:58:12 socat[23] E connect(5, AF=2 172.17.0.1:8080, 16): Connection timed out 0 0 0 0 0 0 0 0 --:--:-- 0:02:11 --:--:-- 0 curl: (52) Empty reply from server ++ export DEPLOYMENT_BUCKET= ++ DEPLOYMENT_BUCKET= ++ [[ -z 1 ]] ++ [[ -z '' ]] ++ mount -t tmpfs -o size=250M,mode=777 tmpfs /mnt/scratch0/clusterfuzz/bot/inputs/fuzzer-testcases/ ++ mount -t tmpfs -o size=10M,mode=777 tmpfs /mnt/scratch0/clusterfuzz/bot/logs/ ++ mount -t tmpfs -o size=90M,mode=777 tmpfs /mnt/scratch0/tmp ++ FUZZER_TESTCASES_DISK_FILE=/mnt/scratch0/fuzzer-testcases.mnt ++ fallocate -l 8GiB /mnt/scratch0/fuzzer-testcases.mnt ++ mkfs.ext4 -F /mnt/scratch0/fuzzer-testcases.mnt mke2fs 1.42.13 (17-May-2015) Discarding device blocks: done
  Creating filesystem with 2097152 4k blocks and 524288 inodes Filesystem UUID: 157ece96-f146-4558-adfa-629d51c7072c Superblock backups stored on blocks: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632

Allocating group tables: done
Writing inode tables: done
Creating journal (32768 blocks): done Writing superblocks and filesystem accounting information: done

++ fallocate -l 8GiB /mnt/scratch0/fuzzer-testcases.mnt ++ mount -o loop /mnt/scratch0/fuzzer-testcases.mnt /mnt/scratch0/clusterfuzz/bot/inputs/fuzzer-testcases-disk ++ chown -R clusterfuzz:clusterfuzz /mnt/scratch0

• bash -ex /data/start_clusterfuzz.sh
• export DISPLAY=:1
• DISPLAY=:1
• export LANG=en_US.UTF-8
• LANG=en_US.UTF-8
• export LC_ALL=en_US.UTF-8
• LC_ALL=en_US.UTF-8
• export PATH=:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/jvm/java-15-openjdk-amd64/bin
• PATH=:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/jvm/java-15-openjdk-amd64/bin
• export TZ=America/Los_Angeles
• TZ=America/Los_Angeles
• sudo -E -H -u clusterfuzz bash -c 'PATH=''':/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/jvm/java-15-openjdk-amd64/bin''' PYTHONPATH='''/mnt/scratch0/clusterfuzz/src''' LD_LIBRARY_PATH='''''' python3.7 /mnt/scratch0/clusterfuzz/src/python/bot/startup/run.py' Traceback (most recent call last): File "/mnt/scratch0/clusterfuzz/src/python/bot/startup/run.py", line 27, in from base import persistent_cache File "/mnt/scratch0/clusterfuzz/src/python/base/persistent_cache.py", line 22, in from system import environment File "/mnt/scratch0/clusterfuzz/src/python/system/environment.py", line 24, in import yaml ModuleNotFoundError: No module named 'yaml'