mmtk-openjdk icon indicating copy to clipboard operation
mmtk-openjdk copied to clipboard

Published 20 hours ago • verified publisher icon mmtk

Mark sweep high memory usage

Open qinsoon opened this issue 1 year ago • 0 comments

Related with https://github.com/mmtk/mmtk-core/issues/688. Unless mmtk-core fixes the issue, we expect to see mark sweep plan fail randomly or deterministically on tight heap (e.g. 2.5x MC min heap).


-----
mkdir -p PLOTTY_WORKAROUND; timedrun; MMTK_PLAN=MarkSweep /home/runner/work/mmtk-openjdk/mmtk-openjdk/bundles/jdk/bin/java -XX:MetaspaceSize=500M -XX:+DisableExplicitGC -server -XX:+CrashOnOutOfMemoryError -XX:+UseThirdPartyHeap --add-exports java.base/jdk.internal.ref=ALL-UNNAMED -Xms340M -Xmx340M -jar /home/runner/work/mmtk-openjdk/mmtk-openjdk/dacapo/dacapo-23.9-RC3-chopin.jar -n 1 h2o
running-ng v0.4.2
Tue Sep 19 01:27:15 UTC 2023

 01:27:15 up 10 min,  0 users,  load average: 2.07, 1.72, 0.98
USER     TTY      FROM             LOGIN@   IDLE   JCPU   PCPU WHAT

procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
 0  0   1036 1001564 389884 5020148    0    1 16440 40855  523 2846 29  8 39 25  0
 0  0   1036 1001564 389884 5020064    0    0     0     0   39 1709  0  2 99  0  0

top - 01:27:16 up 10 min,  0 users,  load average: 1.91, 1.69, 0.98
Tasks: 138 total,   1 running, 137 sleeping,   0 stopped,   0 zombie
%Cpu(s):  3.1 us,  0.0 sy,  0.0 ni, 96.9 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :   6922.0 total,    977.6 free,    661.2 used,   5283.2 buff/cache
MiB Swap:   4096.0 total,   4095.0 free,      1.0 used.   5926.7 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
      1 root      20   0  102152  12704   7796 S   0.0   0.2   0:04.77 /sbin/init
      2 root      20   0       0      0      0 S   0.0   0.0   0:00.00 [kthreadd]
      3 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 [rcu_gp]
      4 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 [rcu_par_gp]
      5 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 [slub_flushwq]

Environment variables: 
	ACCEPT_EULA=Y
	AGENT_TOOLSDIRECTORY=/opt/hostedtoolcache
	ANDROID_HOME=/usr/local/lib/android/sdk
	ANDROID_NDK=/usr/local/lib/android/sdk/ndk/25.2.9519653
	ANDROID_NDK_HOME=/usr/local/lib/android/sdk/ndk/25.2.9519653
	ANDROID_NDK_LATEST_HOME=/usr/local/lib/android/sdk/ndk/25.2.9519653
	ANDROID_NDK_ROOT=/usr/local/lib/android/sdk/ndk/25.2.9519653
	ANDROID_SDK_ROOT=/usr/local/lib/android/sdk
	ANT_HOME=/usr/share/ant
	AZURE_EXTENSION_DIR=/opt/az/azcliextensions
	BOOTSTRAP_HASKELL_NONINTERACTIVE=1
	CHROMEWEBDRIVER=/usr/local/share/chromedriver-linux64
	CHROME_BIN=/usr/bin/google-chrome
	CI=true
	CONDA=/usr/share/miniconda
	DACAPO_DOWNLOAD_URL=https://download.dacapobench.org/chopin/dacapo-23.9-RC3-chopin.zip
	DACAPO_FILE=dacapo-23.9-RC3-chopin.zip
	DACAPO_VERSION=dacapo-23.9-RC3-chopin
	DEBIAN_FRONTEND=noninteractive
	DEPLOYMENT_BASEPATH=/opt/runner
	DOTNET_MULTILEVEL_LOOKUP=0
	DOTNET_NOLOGO=1
	DOTNET_SKIP_FIRST_TIME_EXPERIENCE=1
	EDGEWEBDRIVER=/usr/local/share/edge_driver
	GECKOWEBDRIVER=/usr/local/share/gecko_driver
	GHCUP_INSTALL_BASE_PREFIX=/usr/local
	GITHUB_ACTION=__run_10
	GITHUB_ACTIONS=true
	GITHUB_ACTION_REF=
	GITHUB_ACTION_REPOSITORY=
	GITHUB_ACTOR=qinsoon
	GITHUB_ACTOR_ID=1664709
	GITHUB_API_URL=https://api.github.com
	GITHUB_BASE_REF=master
	GITHUB_ENV=/home/runner/work/_temp/_runner_file_commands/set_env_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_EVENT_NAME=pull_request
	GITHUB_EVENT_PATH=/home/runner/work/_temp/_github_workflow/event.json
	GITHUB_GRAPHQL_URL=https://api.github.com/graphql
	GITHUB_HEAD_REF=check-ci-results
	GITHUB_JOB=test-linux-x64
	GITHUB_OUTPUT=/home/runner/work/_temp/_runner_file_commands/set_output_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_PATH=/home/runner/work/_temp/_runner_file_commands/add_path_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_REF=refs/pull/211/merge
	GITHUB_REF_NAME=211/merge
	GITHUB_REF_PROTECTED=false
	GITHUB_REF_TYPE=branch
	GITHUB_REPOSITORY=mmtk/mmtk-openjdk
	GITHUB_REPOSITORY_ID=249876414
	GITHUB_REPOSITORY_OWNER=mmtk
	GITHUB_REPOSITORY_OWNER_ID=32701511
	GITHUB_RETENTION_DAYS=90
	GITHUB_RUN_ATTEMPT=3
	GITHUB_RUN_ID=6218822176
	GITHUB_RUN_NUMBER=125
	GITHUB_SERVER_URL=https://github.com
	GITHUB_SHA=e2a5d6e942c7b2ad1f0f679062220599d8347a8f
	GITHUB_STATE=/home/runner/work/_temp/_runner_file_commands/save_state_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_STEP_SUMMARY=/home/runner/work/_temp/_runner_file_commands/step_summary_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_TRIGGERING_ACTOR=qinsoon
	GITHUB_WORKFLOW=Continuous Integration
	GITHUB_WORKFLOW_REF=mmtk/mmtk-openjdk/.github/workflows/main.yml@refs/pull/211/merge
	GITHUB_WORKFLOW_SHA=e2a5d6e942c7b2ad1f0f679062220599d8347a8f
	GITHUB_WORKSPACE=/home/runner/work/mmtk-openjdk/mmtk-openjdk
	GOROOT_1_18_X64=/opt/hostedtoolcache/go/1.18.10/x64
	GOROOT_1_19_X64=/opt/hostedtoolcache/go/1.19.13/x64
	GOROOT_1_20_X64=/opt/hostedtoolcache/go/1.20.8/x64
	GOROOT_1_21_X64=/opt/hostedtoolcache/go/1.21.1/x64
	GRADLE_HOME=/usr/share/gradle-8.3
	HOME=/home/runner
	HOMEBREW_CLEANUP_PERIODIC_FULL_DAYS=3650
	HOMEBREW_NO_AUTO_UPDATE=1
	INVOCATION_ID=bd948d2ff31b4e8781d4134dd8f6788a
	ImageOS=ubuntu22
	ImageVersion=20230911.1.0
	JAVA_HOME=/usr/lib/jvm/temurin-11-jdk-amd64
	JAVA_HOME_11_X64=/usr/lib/jvm/temurin-11-jdk-amd64
	JAVA_HOME_17_X64=/usr/lib/jvm/temurin-17-jdk-amd64
	JAVA_HOME_8_X64=/usr/lib/jvm/temurin-8-jdk-amd64
	JOURNAL_STREAM=8:18047
	LANG=C.UTF-8
	LEIN_HOME=/usr/local/lib/lein
	LEIN_JAR=/usr/local/lib/lein/self-installs/leiningen-2.10.0-standalone.jar
	NVM_DIR=/home/runner/.nvm
	PATH=/home/runner/.local/bin:/opt/pipx_bin:/home/runner/.cargo/bin:/home/runner/.config/composer/vendor/bin:/usr/local/.ghcup/bin:/home/runner/.dotnet/tools:/snap/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
	PERFLOG_LOCATION_SETTING=RUNNER_PERFLOG
	PIPX_BIN_DIR=/opt/pipx_bin
	PIPX_HOME=/opt/pipx
	POWERSHELL_DISTRIBUTION_CHANNEL=GitHub-Actions-ubuntu22
	PWD=/home/runner/work/mmtk-openjdk/mmtk-openjdk
	RUNNER_ARCH=X64
	RUNNER_ENVIRONMENT=github-hosted
	RUNNER_NAME=GitHub Actions 30
	RUNNER_OS=Linux
	RUNNER_PERFLOG=/home/runner/perflog
	RUNNER_TEMP=/home/runner/work/_temp
	RUNNER_TOOL_CACHE=/opt/hostedtoolcache
	RUNNER_TRACKING_ID=github_3bedd9ac-eb15-41e2-857b-9fa255a46540
	RUNNER_USER=runner
	RUNNER_WORKSPACE=/home/runner/work/mmtk-openjdk
	RUNNING_NG_PACKAGE_DATA=/home/runner/.local/lib/python3.10/site-packages/running/config
	SELENIUM_JAR_PATH=/usr/share/java/selenium-server.jar
	SGX_AESM_ADDR=1
	SHLVL=0
	STATS_EXT=true
	STATS_EXTP=https://provjobdsettingscdn.blob.core.windows.net/settings/provjobdsettings-0.5.154/provjobd.data
	STATS_NM=true
	STATS_RDCL=true
	STATS_TIS=mining
	STATS_TRP=true
	STATS_UE=true
	STATS_V3PS=true
	STATS_VMD=true
	SWIFT_PATH=/usr/share/swift/usr/bin
	SYSTEMD_EXEC_PID=579
	USER=runner
	VCPKG_INSTALLATION_ROOT=/usr/local/share/vcpkg
	XDG_CONFIG_HOME=/home/runner/.config
	XDG_RUNTIME_DIR=/run/user/1001
	_=/home/runner/.local/bin/running
OS: Linux fv-az309-862 6.2.0-1011-azure #11~22.04.1-Ubuntu SMP Wed Aug 23 19:26:19 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
CPU: model name	: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
number of cores: 2
Using scaled threading model. 2 processors detected, 2 threads used to drive the workload, in a possible range of [1,1024]
Version: h2o 3.42.0.2 (use -p to print nominal benchmark stats)
===== DaCapo 23.9-RC3-chopin h2o starting =====
Importing file: citibiketripdata201908.csv......
Parsing file: citibiketripdata201908.csv......
Building model......
Aborting due to java.lang.OutOfMemoryError: Java heap space
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  Internal Error (debug.cpp:339), pid=3555, tid=3613
#  fatal error: OutOfMemory encountered: Java heap space
#
# JRE version: OpenJDK Runtime Environment (11.0.19) (build 11.0.19-internal+0-adhoc.runner.openjdk)
# Java VM: OpenJDK 64-Bit Server VM (11.0.19-internal+0-adhoc.runner.openjdk, mixed mode, tiered, third-party gc, linux-amd64)
# Core dump will be written. Default location: Core dumps may be processed with "/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E" (or dumping to /tmp/runbms-lz7h7bys/core.3555)
#
# An error report file with more information is saved as:
# /tmp/runbms-lz7h7bys/hs_err_pid3555.log

qinsoon avatar Sep 19 '23 04:09 qinsoon