James Lamb comments

Results 912 comments of


                                            James Lamb

unclear how to prepare data for `lambdarank_position_bias_regularization` option

Please see https://lightgbm.readthedocs.io/en/latest/Advanced-Topics.html#support-for-position-bias-treatment

unclear how to prepare data for `lambdarank_position_bias_regularization` option

And there are some Python examples in tests: https://github.com/microsoft/LightGBM/blob/e9a6c798071632f0e9bdf4c5fa2fdf16bfd5eb36/tests/python_package_test/test_engine.py#L727

[ci] aarch64 python-package job failing: "cannot allocate memory in static TLS block"

I recall now that allocation of static TLS was one of the reasons we switched x86_64 wheels to `manylinux_2_28` (https://github.com/microsoft/LightGBM/issues/5584#issuecomment-1313091909)... there were some fixes in newer GLIBC versions related to...

[ci] aarch64 python-package job failing: "cannot allocate memory in static TLS block"

I just tried a rebuild, and this is still happening: https://dev.azure.com/lightgbm-ci/lightgbm-ci/_build/results?buildId=16481&view=logs&j=7a417b3a-6502-5a0d-1db8-7ef6155c93de&t=380f8b13-0b2d-5f03-5de0-8353018c7351 Looking more closely at the logs, I noticed that it is happening whenever a `libgomp.so` is loaded... sometimes from...

[ci] aarch64 python-package job failing: "cannot allocate memory in static TLS block"

It looks like `cuml` is running into similar issues (also only in its aarch64 builds): https://github.com/rapidsai/cuml/pull/5949 It has lots of the same dependencies as `lightgbm` (like `scikit-learn`, `numpy`, `scipy`, `dask`,...

[ci] aarch64 python-package job failing: "cannot allocate memory in static TLS block"

> `drop conda from that job` I like that idea too! Although it could be pretty involved... I suspect `conda` is doing a LOT of useful environment-resolution work for us...

[ci] aarch64 python-package job failing: "cannot allocate memory in static TLS block"

put up #6517 Thankfully we now have that one macOS job still providing coverage of compiling LightGBM on aarch64.

[ci] aarch64 python-package job failing: "cannot allocate memory in static TLS block"

Thanks @msarahan ! We're getting `scikit-learn` from conda-forge. Looking at the log more closely, I don't think this has anything to do with `scikit-learn` bundling its own `libgomp`. Its conda...

[ci] aarch64 python-package job failing: "cannot allocate memory in static TLS block"

Had an idea tonight 💡 Now that GitHub Actions offers a free `aarch64` macOS runner (#6391), we could probably build `aarch64` linux wheels on that runner + Docker! That should...

[ci] aarch64 python-package job failing: "cannot allocate memory in static TLS block"

I was able to reproduce this tonight without involving `lightgbm`'s unit tests. At least that narrows it down a bit! Ran the following on my M2 mac (which has an...