pytorch [maskedtensor] add basic tests and unary/binary/reduction tests from common_method

Stack from ghstack (oldest at bottom):

-> #82841
#82839
#82837
#82836

Aug 04 '22 19:08 george-qi

:link: Helpful links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/82841
:heavy_multiplication_x: Python docs build was skipped
:heavy_multiplication_x: C++ docs build was skipped
:question:Need help or want to give feedback on the CI? Visit our office hours
:leftwards_arrow_with_hook: [fb-only] Re-run with SSH instructions

:x: 14 New Failures

As of commit 583dee1ea2 (more details on the Dr. CI page):

Expand to see more

14/14 failures introduced in this PR

:detective: 13 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages

trunk / linux-bionic-cuda10.2-py3.9-gcc7 / test (default, 3, 4, linux.4xlarge.nvidia.gpu) (1/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T16:37:22.9745138Z RuntimeError: test_maskedtensor failed!

2022-09-06T16:37:22.5018318Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906163637.xml
2022-09-06T16:37:22.5018978Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906163637.xml
2022-09-06T16:37:22.5419824Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCUDA-20220906163637.xml
2022-09-06T16:37:22.5441584Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906163637.xml
2022-09-06T16:37:22.5558613Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906163637.xml
2022-09-06T16:37:22.9739164Z Traceback (most recent call last):
2022-09-06T16:37:22.9739631Z   File "/var/lib/jenkins/workspace/test/run_test.py", line 1104, in <module>
2022-09-06T16:37:22.9742836Z     main()
2022-09-06T16:37:22.9743261Z   File "/var/lib/jenkins/workspace/test/run_test.py", line 1082, in main
2022-09-06T16:37:22.9744764Z     raise RuntimeError(err_message)
2022-09-06T16:37:22.9745138Z RuntimeError: test_maskedtensor failed!
2022-09-06T16:37:23.2509675Z 
2022-09-06T16:37:23.2510072Z real	1m37.363s
2022-09-06T16:37:23.2510379Z user	1m37.054s
2022-09-06T16:37:23.2510720Z sys	0m7.642s
2022-09-06T16:37:23.2561703Z ##[error]Process completed with exit code 1.
2022-09-06T16:37:23.2607802Z Prepare all required actions
2022-09-06T16:37:23.2608272Z Getting action download info
2022-09-06T16:37:23.4800306Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T16:37:23.4800614Z with:
2022-09-06T16:37:23.4801144Z   github-token: ***

pull / linux-focal-py3.7-clang7-asan / test (default, 4, 5, linux.2xlarge) (2/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T07:19:38.9537513Z RuntimeError: test_maskedtensor failed!

2022-09-06T07:19:38.2366246Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906071931.xml
2022-09-06T07:19:38.2372954Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906071931.xml
2022-09-06T07:19:38.2811773Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCPU-20220906071931.xml
2022-09-06T07:19:38.2829214Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906071931.xml
2022-09-06T07:19:38.2928157Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906071931.xml
2022-09-06T07:19:38.9529007Z Traceback (most recent call last):
2022-09-06T07:19:38.9529284Z   File "test/run_test.py", line 1104, in <module>
2022-09-06T07:19:38.9532773Z     main()
2022-09-06T07:19:38.9533024Z   File "test/run_test.py", line 1082, in main
2022-09-06T07:19:38.9537152Z     raise RuntimeError(err_message)
2022-09-06T07:19:38.9537513Z RuntimeError: test_maskedtensor failed!
2022-09-06T07:19:39.5459863Z 
2022-09-06T07:19:39.5460276Z real	0m18.093s
2022-09-06T07:19:39.5460585Z user	0m15.027s
2022-09-06T07:19:39.5460749Z sys	0m2.679s
2022-09-06T07:19:39.5494999Z ##[error]Process completed with exit code 1.
2022-09-06T07:19:39.5529535Z Prepare all required actions
2022-09-06T07:19:39.5529882Z Getting action download info
2022-09-06T07:19:39.7411396Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T07:19:39.7411617Z with:
2022-09-06T07:19:39.7411930Z   github-token: ***

trunk / win-vs2019-cuda11.6-py3 / test (default, 5, 5, windows.8xlarge.nvidia.gpu) (3/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T18:33:48.0424411Z RuntimeError: test_maskedtensor failed!

2022-09-06T18:33:47.2695376Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestBinary-20220906183332.xml
2022-09-06T18:33:47.2696501Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestMatMul-20220906183332.xml
2022-09-06T18:33:47.3332414Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestOperatorsCUDA-20220906183332.xml
2022-09-06T18:33:47.3378390Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestReductions-20220906183332.xml
2022-09-06T18:33:47.3630193Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestUnary-20220906183332.xml
2022-09-06T18:33:48.0411455Z Traceback (most recent call last):
2022-09-06T18:33:48.0412192Z   File "C:\actions-runner\_work\pytorch\pytorch\test\run_test.py", line 1104, in <module>
2022-09-06T18:33:48.0418591Z     main()
2022-09-06T18:33:48.0419036Z   File "C:\actions-runner\_work\pytorch\pytorch\test\run_test.py", line 1082, in main
2022-09-06T18:33:48.0424076Z     raise RuntimeError(err_message)
2022-09-06T18:33:48.0424411Z RuntimeError: test_maskedtensor failed!
2022-09-06T18:33:48.4428914Z 
2022-09-06T18:33:48.4429844Z (base) C:\actions-runner\_work\pytorch\pytorch\test>if ERRORLEVEL 1 goto fail 
2022-09-06T18:33:48.4432690Z 
2022-09-06T18:33:48.4433223Z (base) C:\actions-runner\_work\pytorch\pytorch\test>exit /b 1 
2022-09-06T18:33:48.4513708Z ##[error]Process completed with exit code 1.
2022-09-06T18:33:48.4828630Z Prepare all required actions
2022-09-06T18:33:48.4829274Z Getting action download info
2022-09-06T18:33:48.6293673Z Download action repository 'nick-fields/retry@7d4a37704547a311dbb66ebdf5b23ec19374a767' (SHA:7d4a37704547a311dbb66ebdf5b23ec19374a767)
2022-09-06T18:33:48.8974932Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T18:33:48.8975227Z with:

pull / linux-bionic-cuda11.6-py3.10-gcc7 / test (default, 3, 4, linux.4xlarge.nvidia.gpu) (4/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T07:32:59.1750253Z RuntimeError: test_maskedtensor failed!

2022-09-06T07:32:58.6398941Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906073245.xml
2022-09-06T07:32:58.6399585Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906073245.xml
2022-09-06T07:32:58.6815070Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCUDA-20220906073245.xml
2022-09-06T07:32:58.6836522Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906073245.xml
2022-09-06T07:32:58.6951262Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906073245.xml
2022-09-06T07:32:59.1747393Z Traceback (most recent call last):
2022-09-06T07:32:59.1747845Z   File "/var/lib/jenkins/workspace/test/run_test.py", line 1104, in <module>
2022-09-06T07:32:59.1748206Z     main()
2022-09-06T07:32:59.1748529Z   File "/var/lib/jenkins/workspace/test/run_test.py", line 1082, in main
2022-09-06T07:32:59.1749910Z     raise RuntimeError(err_message)
2022-09-06T07:32:59.1750253Z RuntimeError: test_maskedtensor failed!
2022-09-06T07:32:59.4405379Z 
2022-09-06T07:32:59.4405951Z real	0m20.071s
2022-09-06T07:32:59.4406288Z user	0m21.314s
2022-09-06T07:32:59.4406516Z sys	0m3.672s
2022-09-06T07:32:59.4459084Z ##[error]Process completed with exit code 1.
2022-09-06T07:32:59.4506771Z Prepare all required actions
2022-09-06T07:32:59.4507217Z Getting action download info
2022-09-06T07:32:59.6249301Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T07:32:59.6249621Z with:
2022-09-06T07:32:59.6250144Z   github-token: ***

trunk / macos-12-py3-arm64 / test (default, 1, 2, macos-m1-12) (5/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T16:31:44.9996480Z RuntimeError: test_maskedtensor failed!

2022-09-06T16:31:44.9995110Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906163143.xml
2022-09-06T16:31:44.9995300Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906163143.xml
2022-09-06T16:31:44.9995510Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCPU-20220906163143.xml
2022-09-06T16:31:44.9995710Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906163143.xml
2022-09-06T16:31:44.9995900Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906163143.xml
2022-09-06T16:31:44.9995970Z Traceback (most recent call last):
2022-09-06T16:31:44.9996140Z   File "/Users/ec2-user/runner/_work/pytorch/pytorch/test/run_test.py", line 1104, in <module>
2022-09-06T16:31:44.9996180Z     main()
2022-09-06T16:31:44.9996340Z   File "/Users/ec2-user/runner/_work/pytorch/pytorch/test/run_test.py", line 1082, in main
2022-09-06T16:31:44.9996410Z     raise RuntimeError(err_message)
2022-09-06T16:31:44.9996480Z RuntimeError: test_maskedtensor failed!
2022-09-06T16:31:44.9996480Z 
2022-09-06T16:31:44.9996680Z ERROR conda.cli.main_run:execute(49): `conda run .jenkins/pytorch/macos-test.sh` failed. (See above for error)
2022-09-06T16:31:44.9996740Z Collecting pluggy<2.0,>=0.12
2022-09-06T16:31:44.9996880Z   Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
2022-09-06T16:31:44.9997130Z Requirement already satisfied: packaging in /Users/ec2-user/runner/_work/_temp/conda_environment_3001697353/lib/python3.9/site-packages (from pytest) (21.3)
2022-09-06T16:31:44.9997180Z Collecting py>=1.8.2
2022-09-06T16:31:44.9997360Z   Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
2022-09-06T16:31:44.9997630Z Requirement already satisfied: attrs>=19.2.0 in /Users/ec2-user/runner/_work/_temp/conda_environment_3001697353/lib/python3.9/site-packages (from pytest) (22.1.0)
2022-09-06T16:31:44.9997690Z Collecting iniconfig
2022-09-06T16:31:44.9997830Z   Using cached iniconfig-1.1.1-py2.py3-none-any.whl (5.0 kB)

trunk / linux-focal-rocm5.2-py3.7 / test (default, 2, 2, linux.rocm.gpu) (6/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T16:35:22.2100984Z RuntimeError: test_maskedtensor failed!

2022-09-06T16:35:20.1671997Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906163425.xml
2022-09-06T16:35:20.1672708Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906163425.xml
2022-09-06T16:35:20.2043251Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCUDA-20220906163425.xml
2022-09-06T16:35:20.2066578Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906163425.xml
2022-09-06T16:35:20.2192129Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906163425.xml
2022-09-06T16:35:22.2086884Z Traceback (most recent call last):
2022-09-06T16:35:22.2087969Z   File "test/run_test.py", line 1104, in <module>
2022-09-06T16:35:22.2093710Z     main()
2022-09-06T16:35:22.2094659Z   File "test/run_test.py", line 1082, in main
2022-09-06T16:35:22.2099957Z     raise RuntimeError(err_message)
2022-09-06T16:35:22.2100984Z RuntimeError: test_maskedtensor failed!
2022-09-06T16:35:24.3801129Z 
2022-09-06T16:35:24.3801900Z real	1m4.483s
2022-09-06T16:35:24.3802768Z user	1m6.563s
2022-09-06T16:35:24.3804192Z sys	0m11.304s
2022-09-06T16:35:24.3904838Z ##[error]Process completed with exit code 1.
2022-09-06T16:35:24.3968764Z ##[group]Run # copy test results back to the mounted workspace, needed sudo, resulting permissions were correct
2022-09-06T16:35:24.3969782Z [36;1m# copy test results back to the mounted workspace, needed sudo, resulting permissions were correct[0m
2022-09-06T16:35:24.3970844Z [36;1mdocker exec -t "84711895bb7de812b786cc00347ad9c53eaf885155a230178babe564cda3e9b7" sh -c "cd ../pytorch && sudo cp -R test/test-reports ../workspace/test"[0m
2022-09-06T16:35:24.4028336Z shell: /bin/bash -e {0}
2022-09-06T16:35:24.4028767Z env:

trunk / parallelnative-linux-focal-py3.7-gcc7 / test (default, 1, 2, linux.2xlarge) (7/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T16:27:58.7579112Z RuntimeError: test_maskedtensor failed!

2022-09-06T16:27:58.2096976Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906162755.xml
2022-09-06T16:27:58.2097494Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906162755.xml
2022-09-06T16:27:58.2389921Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCPU-20220906162755.xml
2022-09-06T16:27:58.2406603Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906162755.xml
2022-09-06T16:27:58.2502709Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906162755.xml
2022-09-06T16:27:58.7574199Z Traceback (most recent call last):
2022-09-06T16:27:58.7574492Z   File "test/run_test.py", line 1104, in <module>
2022-09-06T16:27:58.7576682Z     main()
2022-09-06T16:27:58.7576948Z   File "test/run_test.py", line 1082, in main
2022-09-06T16:27:58.7578855Z     raise RuntimeError(err_message)
2022-09-06T16:27:58.7579112Z RuntimeError: test_maskedtensor failed!
2022-09-06T16:27:59.1090828Z 
2022-09-06T16:27:59.1091234Z real	0m37.715s
2022-09-06T16:27:59.1091502Z user	0m35.448s
2022-09-06T16:27:59.1091678Z sys	0m2.228s
2022-09-06T16:27:59.1132329Z ##[error]Process completed with exit code 1.
2022-09-06T16:27:59.1191553Z Prepare all required actions
2022-09-06T16:27:59.1191887Z Getting action download info
2022-09-06T16:27:59.2671585Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T16:27:59.2671830Z with:
2022-09-06T16:27:59.2672201Z   github-token: ***

pull / win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (8/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T08:26:20.8299193Z RuntimeError: test_maskedtensor failed!

2022-09-06T08:26:20.4980028Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestBinary-20220906082617.xml
2022-09-06T08:26:20.4980467Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestMatMul-20220906082617.xml
2022-09-06T08:26:20.5358429Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestOperatorsCPU-20220906082617.xml
2022-09-06T08:26:20.5380320Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestReductions-20220906082617.xml
2022-09-06T08:26:20.5485555Z Generated XML report: test-reports\python-unittest\test_maskedtensor\TEST-TestUnary-20220906082617.xml
2022-09-06T08:26:20.8290815Z Traceback (most recent call last):
2022-09-06T08:26:20.8291246Z   File "C:\actions-runner\_work\pytorch\pytorch\test\run_test.py", line 1104, in <module>
2022-09-06T08:26:20.8295512Z     main()
2022-09-06T08:26:20.8295816Z   File "C:\actions-runner\_work\pytorch\pytorch\test\run_test.py", line 1082, in main
2022-09-06T08:26:20.8298967Z     raise RuntimeError(err_message)
2022-09-06T08:26:20.8299193Z RuntimeError: test_maskedtensor failed!
2022-09-06T08:26:21.0412860Z 
2022-09-06T08:26:21.0413518Z (base) C:\actions-runner\_work\pytorch\pytorch\test>if ERRORLEVEL 1 goto fail 
2022-09-06T08:26:21.0415102Z 
2022-09-06T08:26:21.0415632Z (base) C:\actions-runner\_work\pytorch\pytorch\test>exit /b 1 
2022-09-06T08:26:21.0494317Z ##[error]Process completed with exit code 1.
2022-09-06T08:26:21.0747910Z Prepare all required actions
2022-09-06T08:26:21.0748435Z Getting action download info
2022-09-06T08:26:21.2284862Z Download action repository 'nick-fields/retry@7d4a37704547a311dbb66ebdf5b23ec19374a767' (SHA:7d4a37704547a311dbb66ebdf5b23ec19374a767)
2022-09-06T08:26:21.6194835Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T08:26:21.6195042Z with:

pull / linux-bionic-py3.7-clang9 / test (crossref, 2, 2, linux.2xlarge) (9/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T07:15:41.3732739Z RuntimeError: test_maskedtensor failed!

2022-09-06T07:15:40.9340439Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906071537.xml
2022-09-06T07:15:40.9340937Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906071537.xml
2022-09-06T07:15:40.9743562Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCPU-20220906071537.xml
2022-09-06T07:15:40.9759371Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906071537.xml
2022-09-06T07:15:40.9843740Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906071537.xml
2022-09-06T07:15:41.3728046Z Traceback (most recent call last):
2022-09-06T07:15:41.3728538Z   File "test/run_test.py", line 1104, in <module>
2022-09-06T07:15:41.3730236Z     main()
2022-09-06T07:15:41.3730505Z   File "test/run_test.py", line 1082, in main
2022-09-06T07:15:41.3732321Z     raise RuntimeError(err_message)
2022-09-06T07:15:41.3732739Z RuntimeError: test_maskedtensor failed!
2022-09-06T07:15:41.6341872Z 
2022-09-06T07:15:41.6342183Z real	0m8.191s
2022-09-06T07:15:41.6342470Z user	0m15.358s
2022-09-06T07:15:41.6342707Z sys	0m1.783s
2022-09-06T07:15:41.6379688Z ##[error]Process completed with exit code 1.
2022-09-06T07:15:41.6424421Z Prepare all required actions
2022-09-06T07:15:41.6424788Z Getting action download info
2022-09-06T07:15:41.8078183Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T07:15:41.8078422Z with:
2022-09-06T07:15:41.8078996Z   github-token: ***

trunk / macos-12-py3-x86-64 / test (default, 1, 2, macos-12) (10/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T17:04:02.3854470Z RuntimeError: test_maskedtensor failed!

2022-09-06T17:04:02.3852260Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906170344.xml
2022-09-06T17:04:02.3852600Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906170344.xml
2022-09-06T17:04:02.3852950Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCPU-20220906170344.xml
2022-09-06T17:04:02.3853300Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906170344.xml
2022-09-06T17:04:02.3853620Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906170344.xml
2022-09-06T17:04:02.3853720Z Traceback (most recent call last):
2022-09-06T17:04:02.3854030Z   File "test/run_test.py", line 1104, in <module>
2022-09-06T17:04:02.3854140Z     main()
2022-09-06T17:04:02.3854260Z   File "test/run_test.py", line 1082, in main
2022-09-06T17:04:02.3854360Z     raise RuntimeError(err_message)
2022-09-06T17:04:02.3854470Z RuntimeError: test_maskedtensor failed!
2022-09-06T17:04:02.3854480Z 
2022-09-06T17:04:02.3854910Z   File "/Users/runner/work/_temp/conda_environment_3001697353/lib/python3.8/site-packages/torch/masked/maskedtensor/reductions.py", line 71, in reduce_all
2022-09-06T17:04:02.3855280Z     return MaskedTensor.from_values(result_data, torch.any(mask))
2022-09-06T17:04:02.3855700Z   File "/Users/runner/work/_temp/conda_environment_3001697353/lib/python3.8/site-packages/torch/masked/maskedtensor/core.py", line 351, in from_values
2022-09-06T17:04:02.3855820Z     result = Constructor.apply(data, mask)
2022-09-06T17:04:02.3856210Z   File "/Users/runner/work/_temp/conda_environment_3001697353/lib/python3.8/site-packages/torch/masked/maskedtensor/core.py", line 345, in forward
2022-09-06T17:04:02.3856340Z     return MaskedTensor(data.clone(), mask.clone())
2022-09-06T17:04:02.3856730Z   File "/Users/runner/work/_temp/conda_environment_3001697353/lib/python3.8/site-packages/torch/masked/maskedtensor/core.py", line 336, in __init__
2022-09-06T17:04:02.3856840Z     self._preprocess_data(data, mask)
2022-09-06T17:04:02.3857240Z   File "/Users/runner/work/_temp/conda_environment_3001697353/lib/python3.8/site-packages/torch/masked/maskedtensor/core.py", line 286, in _preprocess_data

pull / linux-bionic-py3.7-clang9 / test (default, 2, 2, linux.2xlarge) (11/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T07:15:39.2304394Z RuntimeError: test_maskedtensor failed!

2022-09-06T07:15:38.8567732Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906071536.xml
2022-09-06T07:15:38.8568632Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906071536.xml
2022-09-06T07:15:38.8880649Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCPU-20220906071536.xml
2022-09-06T07:15:38.8897149Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906071536.xml
2022-09-06T07:15:38.8989799Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906071536.xml
2022-09-06T07:15:39.2300082Z Traceback (most recent call last):
2022-09-06T07:15:39.2300390Z   File "test/run_test.py", line 1104, in <module>
2022-09-06T07:15:39.2302186Z     main()
2022-09-06T07:15:39.2302387Z   File "test/run_test.py", line 1082, in main
2022-09-06T07:15:39.2304163Z     raise RuntimeError(err_message)
2022-09-06T07:15:39.2304394Z RuntimeError: test_maskedtensor failed!
2022-09-06T07:15:39.4870631Z 
2022-09-06T07:15:39.4870930Z real	0m7.377s
2022-09-06T07:15:39.4871104Z user	0m12.634s
2022-09-06T07:15:39.4871507Z sys	0m1.791s
2022-09-06T07:15:39.4907749Z ##[error]Process completed with exit code 1.
2022-09-06T07:15:39.4946535Z Prepare all required actions
2022-09-06T07:15:39.4946836Z Getting action download info
2022-09-06T07:15:39.6482012Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T07:15:39.6482239Z with:
2022-09-06T07:15:39.6482566Z   github-token: ***

pull / linux-focal-py3.7-gcc7 / test (default, 1, 2, linux.2xlarge) (12/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T07:14:38.1698365Z RuntimeError: test_maskedtensor failed!

2022-09-06T07:14:37.7635919Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestBinary-20220906071435.xml
2022-09-06T07:14:37.7636192Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestMatMul-20220906071435.xml
2022-09-06T07:14:37.7918790Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestOperatorsCPU-20220906071435.xml
2022-09-06T07:14:37.7933911Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestReductions-20220906071435.xml
2022-09-06T07:14:37.8022062Z Generated XML report: test-reports/python-unittest/test_maskedtensor/TEST-TestUnary-20220906071435.xml
2022-09-06T07:14:38.1694084Z Traceback (most recent call last):
2022-09-06T07:14:38.1694349Z   File "test/run_test.py", line 1104, in <module>
2022-09-06T07:14:38.1695952Z     main()
2022-09-06T07:14:38.1696195Z   File "test/run_test.py", line 1082, in main
2022-09-06T07:14:38.1698123Z     raise RuntimeError(err_message)
2022-09-06T07:14:38.1698365Z RuntimeError: test_maskedtensor failed!
2022-09-06T07:14:38.4646746Z 
2022-09-06T07:14:38.4647340Z real	0m7.171s
2022-09-06T07:14:38.4647676Z user	0m9.446s
2022-09-06T07:14:38.4647842Z sys	0m1.497s
2022-09-06T07:14:38.4681945Z ##[error]Process completed with exit code 1.
2022-09-06T07:14:38.4721815Z Prepare all required actions
2022-09-06T07:14:38.4722112Z Getting action download info
2022-09-06T07:14:38.6459757Z ##[group]Run ./.github/actions/get-workflow-job-id
2022-09-06T07:14:38.6459978Z with:
2022-09-06T07:14:38.6460284Z   github-token: ***

pull / linux-bionic-py3.7-clang9 / test (dynamo, 1, 2, linux.2xlarge) (13/13)

Step: "Test" (full log | diagnosis details)

2022-09-06T07:15:47.8480423Z AssertionError: layout

2022-09-06T07:15:47.7884997Z   test_reduction_all_argmin_cpu_float16 (__main__.TestOperatorsCPU) ... ok (0.007s)
2022-09-06T07:15:47.7959928Z   test_reduction_all_argmin_cpu_float32 (__main__.TestOperatorsCPU) ... ok (0.007s)
2022-09-06T07:15:47.8040118Z   test_reduction_all_argmin_cpu_float64 (__main__.TestOperatorsCPU) ... ok (0.007s)
2022-09-06T07:15:47.8238785Z   test_reduction_all_prod_cpu_float32 (__main__.TestOperatorsCPU) ... ok (0.019s)
2022-09-06T07:15:47.8447267Z   test_reduction_all_prod_cpu_float64 (__main__.TestOperatorsCPU) ... ok (0.020s)
2022-09-06T07:15:47.8477726Z   test_reduction_all_sparse_amax_cpu_float16 (__main__.TestOperatorsCPU) ... torchdynamo.convert_frame: [ERROR] WON'T CONVERT test_reduction_all_sparse test_maskedtensor.py line 913 
2022-09-06T07:15:47.8478318Z due to: 
2022-09-06T07:15:47.8478648Z Traceback (most recent call last):
2022-09-06T07:15:47.8479440Z   File "/var/lib/jenkins/.local/lib/python3.7/site-packages/torchdynamo/variables/functions.py", line 31, in wrap_bound_arg
2022-09-06T07:15:47.8480063Z     assert isinstance(val, VariableTracker), typestr(val)
2022-09-06T07:15:47.8480423Z AssertionError: layout
2022-09-06T07:15:47.8480545Z 
2022-09-06T07:15:47.8480615Z from user code:
2022-09-06T07:15:47.8480851Z    File "test_maskedtensor.py", line 915, in test_reduction_all_sparse
2022-09-06T07:15:47.8481134Z     self._test_reduction_equality(device, dtype, op, torch.sparse_coo)
2022-09-06T07:15:47.8481301Z 
2022-09-06T07:15:47.8481597Z Set torchdynamo.config.verbose=True for more information
2022-09-06T07:15:47.8481922Z ==========
2022-09-06T07:15:47.8483104Z /opt/conda/lib/python3.7/site-packages/torch/masked/maskedtensor/core.py:279: UserWarning: It is not recommended to create a MaskedTensor with a tensor that requires_grad. To avoid this, you can use data.clone().detach()
2022-09-06T07:15:47.8483564Z   "To avoid this, you can use data.clone().detach()", UserWarning)
2022-09-06T07:15:47.8637265Z ERROR (0.018s)

:female_detective: 1 failure not recognized by patterns:

The following CI failures may be due to changes from the PR

Job	Step
^build	^Unknown

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

Aug 04 '22 19:08 facebook-github-bot

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/82841

:page_facing_up: Preview Python docs built from this PR
:page_facing_up: Preview C++ docs built from this PR
:question: Need help or want to give feedback on the CI? Visit our office hours

Note: Links to docs will display an error until the docs builds have been completed.

:x: 6 Failures, 2 Pending

As of commit 64afc528892b46300e59deb93dcee0dffb71a891:

The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Sep 09 '22 11:09 pytorch-bot[bot]

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/82841

:page_facing_up: Preview Python docs built from this PR
:page_facing_up: Preview C++ docs built from this PR
:question: Need help or want to give feedback on the CI? Visit our office hours

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Sep 09 '22 11:09 pytorch-bot[bot]

Couple more basic issues but looks like we're getting close.

High level question: TestBasics are kind of spot checks, while TestOperators does the more thorough sweeps using torch.testing infra . But afaict only TestBasics does backward() testing. Is that typical?

Not entirely sure what's typical -- Christian and I have had more adhoc testing along these lines in the out-of-tree repoi, but I suppose part of migrating into core is adjusting to core's stricter testing, which is definitely a good thing :)

But as of this comment (because of your previous comment), I think every function in TestBasics had been changed to also testing the forward testing? e.g.:

https://github.com/pytorch/pytorch/blob/ea6c9c1131ae1282f95b89133504b9cef50d48bc/test/test_maskedtensor.py#L151

https://github.com/pytorch/pytorch/blob/ea6c9c1131ae1282f95b89133504b9cef50d48bc/test/test_maskedtensor.py#L220

and so on

Sep 13 '22 17:09 george-qi

@pytorchbot merge

Sep 20 '22 15:09 cpuhrsch

@pytorchbot successfully started a merge job. Check the current status here. The merge job was triggered with the land checks (-l) flag. If you did not specify this flag yourself, you are likely enrolled in the land checks rollout. This means that your change will be merged once all checks on your PR have passed since you have added the ciflow/trunk label to your PR (ETA 0-4 Hours). If this is not the intended behavior, feel free to use some of the other merge options in the wiki. Please reach out to the PyTorch DevX Team with feedback or questions!

Sep 20 '22 15:09 pytorchmergebot

Merge failed

Reason: This PR is too stale; the last push date was more than 3 days ago. Please rebase and try again.

If you believe this is an error, you can use the old behavior with @pytorchbot merge -g (optionally with the ciflow/trunk to get land checks) or use @pytorchbot merge -f "some reason here". For more information, see the bot wiki.

Please reach out to the PyTorch DevX Team with feedback or questions!

Details for Dev Infra team

Raised by workflow job

Sep 20 '22 15:09 pytorchmergebot

@pytorchbot rebase

Sep 20 '22 15:09 cpuhrsch

@pytorchbot successfully started a rebase job. Check the current status here

Sep 20 '22 15:09 pytorchmergebot

Rebase failed due to Command git -C /home/runner/work/pytorch/pytorch rebase refs/remotes/origin/master gh/george-qi/39/orig returned non-zero exit code 1

Rebasing (1/1)
Auto-merging test/test_maskedtensor.py
CONFLICT (content): Merge conflict in test/test_maskedtensor.py
error: could not apply b9d97105cc... [maskedtensor] add more basic tests
hint: Resolve all conflicts manually, mark them as resolved with
hint: "git add/rm <conflicted_files>", then run "git rebase --continue".
hint: You can instead skip this commit: run "git rebase --skip".
hint: To abort and get back to the state before "git rebase", run "git rebase --abort".
Could not apply b9d97105cc... [maskedtensor] add more basic tests

Raised by https://github.com/pytorch/pytorch/actions/runs/3091552082

Sep 20 '22 15:09 pytorchmergebot

@pytorchbot merge

Sep 22 '22 07:09 george-qi

@pytorchbot successfully started a merge job. Check the current status here. The merge job was triggered with the land checks (-l) flag. If you did not specify this flag yourself, you are likely enrolled in the land checks rollout. This means that your change will be merged once all checks on your PR have passed since you have added the ciflow/trunk label to your PR (ETA 0-4 Hours). If this is not the intended behavior, feel free to use some of the other merge options in the wiki. Please reach out to the PyTorch DevX Team with feedback or questions!

Sep 22 '22 07:09 pytorchmergebot

Hey @george-qi. You've committed this PR, but it does not have both a 'release notes: ...' and 'topics: ...' label. Please add one of each to the PR. The 'release notes: ...' label should represent the part of PyTorch that this PR changes (fx, autograd, distributed, etc) and the 'topics: ...' label should represent the kind of PR it is (not user facing, new feature, bug fix, perf improvement, etc). The list of valid labels can be found here for the 'release notes: ...' and here for the 'topics: ...'. For changes that are 'topic: not user facing' there is no need for a release notes label.

Sep 22 '22 07:09 github-actions[bot]

pytorch
pytorch copied to clipboard

[maskedtensor] add basic tests and unary/binary/reduction tests from common_method_invocations

:link: Helpful links

:x: 14 New Failures

:detective: 13 new failures recognized by patterns

trunk / linux-bionic-cuda10.2-py3.9-gcc7 / test (default, 3, 4, linux.4xlarge.nvidia.gpu) (1/13)

pull / linux-focal-py3.7-clang7-asan / test (default, 4, 5, linux.2xlarge) (2/13)

trunk / win-vs2019-cuda11.6-py3 / test (default, 5, 5, windows.8xlarge.nvidia.gpu) (3/13)

pull / linux-bionic-cuda11.6-py3.10-gcc7 / test (default, 3, 4, linux.4xlarge.nvidia.gpu) (4/13)

trunk / macos-12-py3-arm64 / test (default, 1, 2, macos-m1-12) (5/13)

trunk / linux-focal-rocm5.2-py3.7 / test (default, 2, 2, linux.rocm.gpu) (6/13)

trunk / parallelnative-linux-focal-py3.7-gcc7 / test (default, 1, 2, linux.2xlarge) (7/13)

pull / win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (8/13)

pull / linux-bionic-py3.7-clang9 / test (crossref, 2, 2, linux.2xlarge) (9/13)

trunk / macos-12-py3-x86-64 / test (default, 1, 2, macos-12) (10/13)

pull / linux-bionic-py3.7-clang9 / test (default, 2, 2, linux.2xlarge) (11/13)

pull / linux-focal-py3.7-gcc7 / test (default, 1, 2, linux.2xlarge) (12/13)

pull / linux-bionic-py3.7-clang9 / test (dynamo, 1, 2, linux.2xlarge) (13/13)

:female_detective: 1 failure not recognized by patterns:

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/82841

:x: 6 Failures, 2 Pending

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/82841

Merge failed

pytorch pytorch copied to clipboard

[maskedtensor] add basic tests and unary/binary/reduction tests from common_method_invocations

:link: Helpful links

:x: 14 New Failures

:detective: 13 new failures recognized by patterns

trunk / linux-bionic-cuda10.2-py3.9-gcc7 / test (default, 3, 4, linux.4xlarge.nvidia.gpu) (1/13)

pull / linux-focal-py3.7-clang7-asan / test (default, 4, 5, linux.2xlarge) (2/13)

trunk / win-vs2019-cuda11.6-py3 / test (default, 5, 5, windows.8xlarge.nvidia.gpu) (3/13)

pull / linux-bionic-cuda11.6-py3.10-gcc7 / test (default, 3, 4, linux.4xlarge.nvidia.gpu) (4/13)

trunk / macos-12-py3-arm64 / test (default, 1, 2, macos-m1-12) (5/13)

trunk / linux-focal-rocm5.2-py3.7 / test (default, 2, 2, linux.rocm.gpu) (6/13)

trunk / parallelnative-linux-focal-py3.7-gcc7 / test (default, 1, 2, linux.2xlarge) (7/13)

pull / win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (8/13)

pull / linux-bionic-py3.7-clang9 / test (crossref, 2, 2, linux.2xlarge) (9/13)

trunk / macos-12-py3-x86-64 / test (default, 1, 2, macos-12) (10/13)

pull / linux-bionic-py3.7-clang9 / test (default, 2, 2, linux.2xlarge) (11/13)

pull / linux-focal-py3.7-gcc7 / test (default, 1, 2, linux.2xlarge) (12/13)

pull / linux-bionic-py3.7-clang9 / test (dynamo, 1, 2, linux.2xlarge) (13/13)

:female_detective: 1 failure not recognized by patterns:

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/82841

:x: 6 Failures, 2 Pending

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/82841

Merge failed

pytorch
pytorch copied to clipboard