goerch

> i want dynamic number of objects in the result and cancellation token It could be helpful if you point us to the signature which is missing the `CommandDefinition` parameter?

Only method mentioned was `Base.setproperty!(::Nothing)` and we could live with or without it probably. But waiting on the resolution seems reasonable too.

Edit: `DataStructures.jl` uses ``` @test [] == detect_ambiguities(Base, Core, DataStructures) ``` to detect type piracy.

> Let me know if it helps with your benchmarks and whether we still need this merged 1.6.3 and 1.8.0-DEV now only show marginal improvements, 1.7.0-rc2 is still awaiting the...

I'm now going to look into @ggerganov 's [PR](https://github.com/ggerganov/whisper.cpp/pull/343). Back again: I need guidance on how to merge the different approaches.

> * If code is taken verbatim from an external source I think we should document this. Absolutely. Assorted associations: * I'd love to use some kind of standard `pthreads`...

There are a couple more questions I'd like to discuss: - The pool is currently located in `ggml_state`. Should we manage it in `ggml_context` instead? - Can we improve error...

Thanks for testing! I changed the order of unlocking/signaling and retested with a bigger model ``` ./bin/release/mpt -m models\mpt-7b-storywriter\ggml-model-f16.bin --threads n --temp 0 --prompt "..." ``` for n = 4/6...

> We suspect that we somehow manage to use different statements which map > to the same cache `Identity` so that concurrently running queries may use > a wrong cache...

@mgravell: many thanks for your support! > _do you have a concrete example I can look at, that fails?_ We are currently lucky(?) enough that our problem occurs rather deterministically,...