arrow icon indicating copy to clipboard operation
arrow copied to clipboard

GH-44461: [Release][Packacing][Python] Set PARQUET_TEST_DATA on verify-release-candidate-wheels.bat

Open raulcd opened this issue 1 year ago • 27 comments

Rationale for this change

The Windows wheel verification fails due to missing PARQUET_TEST_DATA

What changes are included in this PR?

Add PARQUET_TEST_DATA to verify-release-candidate-wheels.bat which is only tested on the binary verification job.

Are these changes tested?

Via archery

Are there any user-facing changes?

No

  • GitHub Issue: #44461

raulcd avatar Oct 17 '24 13:10 raulcd

:warning: GitHub issue #44461 has been automatically assigned in GitHub to PR creator.

github-actions[bot] avatar Oct 17 '24 13:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

raulcd avatar Oct 17 '24 13:10 raulcd

Revision: 6ba7a5ad50497ba33617b908b14d0cd355799537

Submitted crossbow builds: ursacomputing/crossbow @ actions-f980a8883a

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 17 '24 13:10 github-actions[bot]

The error has been fixed but there seems to be a new error with ORC and Timezones :( :

 >       result = dataset_reader.to_table(dataset)
C:\tmp\arrow-verify-release-wheels\_verify-wheel-3.9\Lib\site-packages\pyarrow\tests\test_dataset.py:3248: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
C:\tmp\arrow-verify-release-wheels\_verify-wheel-3.9\Lib\site-packages\pyarrow\tests\test_dataset.py:267: in to_table
    return dataset.to_table(**kwargs)
pyarrow\\_dataset.pyx:562: in pyarrow._dataset.Dataset.to_table
    ???
pyarrow\\_dataset.pyx:3841: in pyarrow._dataset.Scanner.to_table
    ???
pyarrow\\error.pxi:155: in pyarrow.lib.pyarrow_internal_check_status
    ???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
>   ???
E   pyarrow.lib.ArrowException: Unknown error: Time zone file /usr/share/zoneinfo/UTC does not exist. Please install IANA time zone database and set TZDIR env.
pyarrow\\error.pxi:92: ArrowException

raulcd avatar Oct 17 '24 13:10 raulcd

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

raulcd avatar Oct 17 '24 14:10 raulcd

Revision: 95b3016dce468e02858220d987f84c45f67d1bf5

Submitted crossbow builds: ursacomputing/crossbow @ actions-5687ee222c

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 17 '24 14:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 17 '24 21:10 kou

Revision: 2ba6b378f961d81d2c0bb47642ad4e0b309921f0

Submitted crossbow builds: ursacomputing/crossbow @ actions-935bdeefa6

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 17 '24 21:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 17 '24 22:10 kou

Revision: 2ba6b378f961d81d2c0bb47642ad4e0b309921f0

Submitted crossbow builds: ursacomputing/crossbow @ actions-3f8f3c6323

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 17 '24 22:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 18 '24 00:10 kou

Revision: d43d9719f843a5577fc2e0b68588a8b485a1e2af

Submitted crossbow builds: ursacomputing/crossbow @ actions-2851110c41

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 18 '24 00:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 18 '24 01:10 kou

Revision: acf0493904fe85a1cddb04120a9fbae10fb9df64

Submitted crossbow builds: ursacomputing/crossbow @ actions-628dc0a01d

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 18 '24 01:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 18 '24 02:10 kou

Revision: 6c3e4a5e1545aed3ecce5afd3a811f7b84386e33

Submitted crossbow builds: ursacomputing/crossbow @ actions-c2ac566e6f

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 18 '24 02:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 18 '24 02:10 kou

Revision: a753b3b3d4b444080230322563adf528ee6a9544

Submitted crossbow builds: ursacomputing/crossbow @ actions-55cf78c3ae

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 18 '24 02:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 18 '24 03:10 kou

Revision: bc9ff56692530a8defa9e9d91ba970a63f23fd98

Submitted crossbow builds: ursacomputing/crossbow @ actions-ebe4612117

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 18 '24 03:10 github-actions[bot]

I got it. tzdata 2024b is buggy:

https://github.com/ursacomputing/crossbow/actions/runs/11397027990/job/31711818254#step:5:90

/c/Users/runneradmin/Downloads/tzdata/northamerica:Rule	Mexico	1931	only	-	April	30	0:00	1:00	D

"April" should be "Apr" like other month.

kou avatar Oct 18 '24 04:10 kou

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 18 '24 04:10 kou

Revision: 2b1cc66b1e48bbd2a18f0fab037ed1161fd88978

Submitted crossbow builds: ursacomputing/crossbow @ actions-24dbdd9574

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 18 '24 04:10 github-actions[bot]

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

kou avatar Oct 18 '24 06:10 kou

Revision: 04c09828616529c4e2cae25946bbfffaafb62f5f

Submitted crossbow builds: ursacomputing/crossbow @ actions-07588210a4

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 18 '24 06:10 github-actions[bot]

It seems the new error is what was reported from the conda feedstocks:

  • https://github.com/apache/arrow/issues/44455

raulcd avatar Oct 18 '24 06:10 raulcd

It seems that we need to update bundled datetime...

kou avatar Oct 18 '24 07:10 kou

@github-actions crossbow submit verify-rc-binaries-wheels-windows --param release=18.0.0 --param rc=0

raulcd avatar Oct 24 '24 15:10 raulcd

Revision: 7200addcc6dce6ec26d8d027deeda3774cc2fc6a

Submitted crossbow builds: ursacomputing/crossbow @ actions-2790dff4a5

Task Status
verify-rc-binaries-wheels-windows GitHub Actions

github-actions[bot] avatar Oct 24 '24 15:10 github-actions[bot]

oh! yeah! I'm not sure why I run that, the change won't be there :)

raulcd avatar Oct 24 '24 16:10 raulcd