tvalentyn

Results 174 comments of tvalentyn

[BUG] Profiling/tracing fails in Py3.12

> if it were a simple change then we'd consider it. I came up with: https://github.com/cython/cython/pull/6125. We could include it if we expect usage of Cython 0.29 on 3.12. Does...

Ignore the profile directive on 3.12 and above.

Ah, yes of course. PTAL.

Ignore the profile directive on 3.12 and above.

Failures in the prior CI run appear unrelated: https://github.com/cython/cython/actions/runs/8542813488/job/23407808172?pr=6125

Ignore the profile directive on 3.12 and above.

Thanks.

Clear side input caches of dofninvoker when finishing bundle. Add microbenchmarks for map_fn with side inputs.

Thanks, @scwhittle ! > doing it every time slowed down the process time by about 25%. Have you observed this regression on Dataflow runner as well? > From the benchmark,...

Clear side input caches of dofninvoker when finishing bundle. Add microbenchmarks for map_fn with side inputs.

waiting on author

Clear side input caches of dofninvoker when finishing bundle. Add microbenchmarks for map_fn with side inputs.

FWIW I am planning to look into enabling state cache again next quarter

[Bug]: Python expansion with multiple SqlTransforms is extremely slow

cc: @chamikaramj

Logging loading filesystems failures.

Thanks, @RyuSA ! @Abacn had some suggestions about the proposal, so passing to @Abacn for review. Re formatter & lint errors: see: s.apache.org/beam-python-dev-wiki for pointers on linters and yapf. You...

Upgrade cibuildwheel in another place as well.

> Is there any way to document this somewhere for the future? Yes, we collect notes in https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=217387702