sidekiq-throttled
sidekiq-throttled copied to clipboard
ixti
Concurrency and rate-limit throttling for Sidekiq
Greetings, we've been using Sidekiq-Throttle gem for a while and it seems to work perfectly. Lately we've implemented sidekiq pros's super_fetch. For some reason, after this change sidekiq-throttling seems to...
It seems that if I continue to refresh `/sidekiq/queues/high` - I see a lot of change. And I took a look at the codez and it looks like the gem...
Latest release of Sidekiq 6.5.0 is incompatible with this gem. ``` /builds/blish/gems/blish-gem/vendor/bundle/ruby/2.7.0/gems/bootsnap-1.12.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:27:in `require': cannot load such file -- sidekiq/exception_handler (LoadError) [337](https://gitlab.com/blish/gems/blish-gem/-/jobs/2560542042#L337) from /builds/blish/gems/blish-gem/vendor/bundle/ruby/2.7.0/gems/activesupport-5.2.8/lib/active_support/dependencies.rb:291:in `block in require' [338](https://gitlab.com/blish/gems/blish-gem/-/jobs/2560542042#L338) from /builds/blish/gems/blish-gem/vendor/bundle/ruby/2.7.0/gems/activesupport-5.2.8/lib/active_support/dependencies.rb:257:in `load_dependency'...
Also prepares the gem for compatibility with Redis 5 Example warning: ``` Pipelining commands on a Redis instance is deprecated and will be removed in Redis 5.0.0. redis.pipelined do redis.get("key")...
``` Pipelining commands on a Redis instance is deprecated and will be removed in Redis 5.0.0. redis.pipelined do redis.get("key") end should be replaced by redis.pipelined do |pipeline| pipeline.get("key") end (called...
This replicates one of the latest [changes in Sidekiq 6.3.0](https://github.com/mperham/sidekiq/blob/main/Changes.md#630). Basically the word "worker" is usually used for the process or thread that's actually processing the jobs in the queue,...
### Environment: gem 'sidekiq', '6.1.2' gem 'sidekiq-throttled', '0.13.0' ### How to reproduce: Set sidekiq concurrency to 25 ``` class MockWorker include Sidekiq::Worker include Sidekiq::Throttled::Worker MY_OBSERVER = lambda do |strategy, *args|...
Greetings, sidekiq_throttle_as is not working properly as the jobs that are finishing are not clearing the keys. The concurrency key is always stuck at max ( 20 ) `redis.zrange('throttled:feed_listing_worker_concurrency_strategy:concurrency.v2', 0,...
If a batch has been marked as invalid, I would like throw all threshold rules out the window and let the jobs in the batch finish as fast as possible...
Given this situation: ```ruby # config/initializers/sidekiq.rb file Sidekiq::Throttled::Registry.add( :my_throttle, concurrency: { limit: 50 } ) # app/jobs/my_job.rb file class MyJob include Sidekiq::Worker include Sidekiq::Throttled::Worker sidekiq_throttle_as :my_throttle end ``` How can...
