Tom Kaitchuck

**Problem description** Currently we have a very simplistic algorithm which allows one batch outstanding at a time. We should first measure the throughput of this on a real system, and...

Get pravega client working on 32bit architectures

1

This does not seem to work with the latest maturin and workflow combination. Hence I have commented it out. _Originally posted by @shrids in https://github.com/pravega/pravega-client-rust/pull/115/files_

When running the gstreamer plugin a user encountered this: ``` +++ dirname ./scripts/pravega-to-file.sh ++ readlink -f ./scripts/.. + ROOT_DIR=/home/sumit/Pravega-Idea/gstreamer-pravega + pushd /home/sumit/Pravega-Idea/gstreamer-pravega/gst-plugin-pravega ~/Pravega-Idea/gstreamer-pravega/gst-plugin-pravega ~/Pravega-Idea/gstreamer-pravega + cargo build Finished dev [unoptimized...

Parallelize deletion of zk garbage

3

**Change log description** Attempt at fixing: InProcPravegaClusterTest https://github.com/pravega/pravega/actions/runs/7933776118/job/21778295050?pr=7396 **Purpose of the change** **What the code does**

**Describe the bug** ``` o.pravega.segmentstore.server.host.ExtendedS3IntegrationTest > testEndToEndWithChunkedStorage FAILED java.lang.AssertionError at io.pravega.segmentstore.server.reading.StreamSegmentReadIndex.getSingleReadResultEntry(StreamSegmentReadIndex.java:993) at io.pravega.segmentstore.server.reading.StreamSegmentReadIndex.getMultiReadResultEntry(StreamSegmentReadIndex.java:1026) at io.pravega.segmentstore.server.reading.StreamSegmentReadResult.next(StreamSegmentReadResult.java:208) at io.pravega.segmentstore.server.reading.StreamSegmentReadResult.next(StreamSegmentReadResult.java:32) at io.pravega.segmentstore.server.store.StreamSegmentStoreTestBase.checkSegmentReads(StreamSegmentStoreTestBase.java:874) at io.pravega.segmentstore.server.store.StreamSegmentStoreTestBase.lambda$checkReads$14(StreamSegmentStoreTestBase.java:858) at io.pravega.common.util.Retry$RetryAndThrowBase.run(Retry.java:194) at io.pravega.segmentstore.server.store.StreamSegmentStoreTestBase.checkReads(StreamSegmentStoreTestBase.java:855) at io.pravega.segmentstore.server.store.StreamSegmentStoreTestBase.endToEndProcess(StreamSegmentStoreTestBase.java:358) at io.pravega.segmentstore.server.store.StreamSegmentStoreTestBase.testEndToEndWithChunkedStorage(StreamSegmentStoreTestBase.java:276) at...

Create a better way to run MapReduce jobs from unit tests.

1

For the project's own unit tests this can be done by extending EndToEndTestBase. However this comes with a lot of baggage, and would need to be cleaned up. Alternately InProcessMapReduce...

Controller keeps rescheduling itself.

12

In python the controller callback (Used to update the UI) continuously runs. See: https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/python/src/mapreduce/handlers.py#L1414 https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/python/src/mapreduce/handlers.py#L1124 The problem is that this can continue even after the job has finished. An easy...

Warn if a user is on the default version and module

1

This can cause the UI to be completely unresponsive. And will be very hard for the user to understand what is wrong. So what we should do is in the...

Coping this from http://stackoverflow.com/questions/23508116/appengine-mapreduce-how-to-filter-structuredproperty-while-using-datastore-input/23530474#23530474 While using appengine mapreduce lib, how to filter by StructuredProperty? I tried: ``` python class Tag(ndb.Model): # ... tag = ndb.StringProperty() value = ndb.FloatProperty(indexed=False) class User(ndb.Model):...

Right now if a Mapper spins up multiple threads that all try to increment counters they can get inconsistent values.