libtorrent icon indicating copy to clipboard operation
libtorrent copied to clipboard

STOP Using Stale bot

Open allanlaal opened this issue 2 years ago • 34 comments

all the arguments: https://blog.benwinding.com/github-stale-bots/

allanlaal avatar Apr 07 '22 18:04 allanlaal

Agreed. Moving along to where my time is better spent

cocokola avatar Apr 07 '22 18:04 cocokola

@allanlaal @cocokola And guys, there are so many of you and you're all programmers. Why haven't you developed at least some swarm-merging hack together?

Arvin is not the only one who can code. The source code is open source, as everyone loves it.

master255 avatar Apr 07 '22 20:04 master255

The code is above my pay grade, otherwise I would help.

On Thu, Apr 7, 2022, 3:11 PM Oleg @.***> wrote:

@allanlaal https://github.com/allanlaal @cocokola https://github.com/cocokola And guys, there are so many of you and you're all programmers. Why haven't you developed at least some swarm-merging hack together?

Arvin is not the only one who can code. The source code is open source, as everyone loves it.

— Reply to this email directly, view it on GitHub https://github.com/arvidn/libtorrent/issues/6797#issuecomment-1092156961, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACLTLQOEDHPZYZ45GLMFSOLVD46NHANCNFSM5S2GC7CA . You are receiving this because you were mentioned.Message ID: @.***>

cocokola avatar Apr 08 '22 19:04 cocokola

@cocokola What? You're the author of this issue. You're the first one who needs it. So you write the code. It's all free.

master255 avatar Apr 09 '22 18:04 master255

Thanks for flack. My coding experience isn't sufficient. I joined, added the issue, pulled down the code and realized it is beyond my abilities. I never v removed myself, but can if it is a problem.

On Sat, Apr 9, 2022, 1:38 PM Oleg @.***> wrote:

@cocokola https://github.com/cocokola What? You're the author of this issue https://github.com/arvidn/libtorrent/issues/4936. You're the first one who needs it. So you write the code. It's all free.

— Reply to this email directly, view it on GitHub https://github.com/arvidn/libtorrent/issues/6797#issuecomment-1094103931, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACLTLQKC4R66LMBRO6UQEG3VEHFCJANCNFSM5S2GC7CA . You are receiving this because you were mentioned.Message ID: @.***>

cocokola avatar Apr 09 '22 18:04 cocokola

@cocokola Maybe you're not a real programmer. Unfortunately, there are now a lot of people who even work as programmers and have a degree in programming, but do not know how to write programs.

A real programmer can write any program in any programming language.

master255 avatar Apr 10 '22 23:04 master255

I'm old school. Basic, cobol, c, c++, assembler (8/16), lisp,vb, powershell, and a dozen I forget. I can debug Java, C#, scripting/admin. Switched to project/program manager, then health to me out. Like I said, I can drop out if needed. Cheers

On Sun, Apr 10, 2022, 6:34 PM Oleg @.***> wrote:

@cocokola https://github.com/cocokola Maybe you're not a real programmer. Unfortunately, there are now a lot of people who even work as programmers and have a degree in programming, but do not know how to write programs.

— Reply to this email directly, view it on GitHub https://github.com/arvidn/libtorrent/issues/6797#issuecomment-1094410295, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACLTLQLVDIQDJCZTUOOARYDVENQRFANCNFSM5S2GC7CA . You are receiving this because you were mentioned.Message ID: @.***>

cocokola avatar Apr 11 '22 01:04 cocokola

@allanlaal the arguments made in that blog post seem to be against the stale bot locking issues. I haven't seen github's stale bot lock any issues in this repository. If you have, please point me to it, there may be some configuration that can be changed.

arvidn avatar May 07 '22 11:05 arvidn

@arvidn Just turn that bot off. He' s shutting down problems that need to be solved.

master255 avatar May 07 '22 11:05 master255

@arvidn Stale bot also spams issues with offtopic messages, requiring offtopic messages for it to shut up for a while and post an offtopic event for that issue :|

example 1 of 400+:

https://github.com/arvidn/libtorrent/issues/6690#issuecomment-1110976534

allanlaal avatar May 08 '22 13:05 allanlaal

@arvidn Stale bot also spams issues with offtopic messages, requiring offtopic messages for it to shut up for a while and post an offtopic event for that issue :|

Only on issues that you (and other people) care about. The majority of issues don't have this problem, they are closed.

The question is; does the value of closing issues that nobody cares about, and that may very well have been fixed outweigh the cost of keeping issues people care about open?

If you only see issues you care about, there's a risk you have a selection bias in your estimation.

arvidn avatar May 08 '22 21:05 arvidn

@arvidn Just turn that bot off. He' s shutting down problems that need to be solved.

Keeping issues open that have no champion doesn't help anyone as far as I can tell. It doesn't matter whether they need to be solved or not.

Problems aren't solved by keeping issues open, they're solved by people investigating them and submitting patches to test and fix them. Having people that can reproduce the issue and verify that it hasn't been fixed yet is a prerequisite.

arvidn avatar May 08 '22 21:05 arvidn

@arvidn but stalebot does lock threads. It will close an issue despite me (the author!) bumping it, and I can't reopen it once closed. Seems locked to me.

Its timeout is also too short. There's lots of stuff that should definitely be changed in libtorrent. It's hard to keep track of it all when stalebot closes all my issues. Yes, some issues persist for months, or even years, until someone can look at it. That's the FOSS game.

#6532 #6531 #6447 #6385 #6198 #5333 #5154

I recognize you get a lot of low-quality bug reports and stalebot helps filter them, but if it can't be configured in a better way, then I'm +1 for disabling it

Seems locked to me.

I take it you don't have the "reopen" button available then, do you? I do (but that might be because I own the project). I would have expected there being a message about it being locked, rather than just the normal "closed" message. I assume that if you close one of your tickets, you can still reopen it, right? Does it matter who closes the ticket?

Its timeout is also too short. There's lots of stuff that should definitely be changed in libtorrent. It's hard to keep track of it all when stalebot closes all my issues. Yes, some issues persist for months, or even years, until someone can look at it. That's the FOSS game.

The timeout should probably be increased. I think one problem is that the tickets here are not a great place to keep long-term todo-items. In fact, it's quite terrible, especially given all the noise. Most people that open tickets don't close them, even when they are resolved.

I suppose I could add a "todo" tag that disables stable bot. But that's still just items I think would be good to get to eventually, and I might change my mind down the road. In that case there still would need to be someone else championing it.

arvidn avatar May 11 '22 06:05 arvidn

https://github.com/arvidn/libtorrent/pull/6858

arvidn avatar May 11 '22 06:05 arvidn

@allanlaal ticket #6690 is a perfect example of what stale-bot is for. That ticket should be closed. It was kind of a "drive-by" bug report, that probably isn't a bug. The champion of it didn't respond for months. In fact, I suspect the stale-bot flagging it brought it to the posters attention to respond to it. (which is a great feature).

arvidn avatar May 11 '22 07:05 arvidn

Disclaimer: I am a 30-year automation specialist for windows/active directory architect/Project/Program Manager who created Project Management Offices for fortune 100 companies. I script, I don't really develop full time, so take my opinion with the seasoning I provided..

From what I understand, locking an issue translates to the same thing that happens here, without activity issues expiring and falling off. The best thing that comes of this for real issues is you get issues created/closed/reopened/closed/reopened until it gets fixed or the poster gives up. Let me be clear, this is TOTALY YOUR CHOICE to keep it if you know the downsides and it will encourage users to NOT report issues and instead switch to another product if the issue is severe enough. Not world-ending per see.

Perhaps it is my lack of expertise, but closing issues that don't get attention seems at first to be a great way to eliminate work. But how many folks search for the problem, find an issue logged, and move on? The only way to capture that metric is to add upvotes so others can tag it so you know there ARE others that have the issue, but nothing to add unless you want all folks to comment Yeah ME TOO.. which is not the best way to add weight to issue tracking inho.

If you use issue tracking as a task list, then yes it can help eliminate workloads. It would be better to see if something is still in issue, if you cant reproduce it, the poster doesn't return (here is where having a ME TOO/Upvote/might help others to respond who are active and willing to help would help.. but I digress.

these articles/discussions capture the good/bad/ugly.
The article's points are valid Replace STALE/locking with Closing, re-read it and see.

Here are a few to read, digest, ignore and I guess close this if you disagree which is your prerogative.

https://news.ycombinator.com/item?id=28998374#:~:text=It%20unnecessarily%20invalidates%20the%20experience,something%20to%20your%20software%20project.

reddit post and related article: https://www.reddit.com/r/programming/comments/kzvryq/github_stale_bots_a_false_economy/ https://blog.benwinding.com/github-stale-bots/

related, and perhaps what is happening? https://github.com/probot/stale/issues/343

thanks for your time!

cocokola avatar May 11 '22 19:05 cocokola

From what I understand, locking an issue translates to the same thing that happens here

It's still not obvious to me that issues are locked. did we establish that? Is it not possible to re-open an issue that has been closed by stale bot? I've definitely seen other users re-open issues, so I'm pretty sure that's not a privilege only I have.

Let me be clear, this is TOTALY YOUR CHOICE to keep it if you know the downsides and it will encourage users to NOT report issues

I don't see that. My experience right now is that people are eager to report issues, much more so than interested in helping out trying to pin-point what's failing. Obviously not all issues, but a material number of them.

closing issues that don't get attention seems at first to be a great way to eliminate work.

I think there's some disconnect here. The things that eliminate "work" are things like "day jobs", "spending time with family" and "sleeping".

In open source hobby projects, the limiting factor is the amount of work people are willing to put in. Nothing happens if nobody is willing to put in the work. That doesn't just go for engineers debugging and writing code; it also goes for people reporting issues, trouble shooting, experimenting and drilling down to what might be going wrong and under what conditions.

Bugs aren't fixed by tickets being left open. Closing tickets that nobody cares about avoids the important ones from drowning in noise. You really should see the noise.

Stale bot surfaces, and makes explicit, this reality; if not enough people care about an issue nothing will happen. It doesn't matter whether the ticket is open or closed. In that sense, it helps people understand how the process works.

It would be better to see if something is still in issue, if you cant reproduce it, the poster doesn't return (here is where having a ME TOO/Upvote/might help others to respond who are active and willing to help would help.. but I digress.

I agree with you that there are probably better tools than github issues for this, especially to gauge how impactful issues are. However, the important thing isn't necessarily to count the number of people experiencing an issue, but to find one of them that is willing to help fixing it. Without that, there's little point in working on the issue (assuming I can't reproduce it or understand the description enough to write a test that can).

I would love to have a uservoice-like voting system. Do you know of a free one?

related, and perhaps what is happening? https://github.com/probot/stale/issues/343

I have been assuming stale-bot works as advertised and won't close tickets with activity. Reading that makes me think perhaps it does.

arvidn avatar May 11 '22 22:05 arvidn

There's also https://github.com/actions/stale/issues/719, which echoes a lot of concerns here. The OP suggests stalebot should only act on issues with a needs-more-information label. That sounds better than what we have.

But given https://github.com/probot/stale/issues/343, which has stung me (#5154, #6198), maybe stalebot isn't worth using at all. It seems broken.

It's still not obvious to me that issues are locked. did we establish that? Is it not possible to re-open an issue that has been closed by stale bot? I've definitely seen other users re-open issues, so I'm pretty sure that's not a privilege only I have.

https://github.com/actions/stale/issues/345 confirms it's known behavior that users can't reopen their own staled issues. Maybe only the OP can't reopen their own issue, if what you say is true.

Also libtorrent's issue template is fairly bare bones and could probably be expanded to improve report quality. At the extreme end: https://github.com/pre-commit/pre-commit/blob/3cdc6c9d81149ab1f74b05c17743f988cb3af655/.github/ISSUE_TEMPLATE/bug.yaml requires users to submit the search terms they used for existing issues before submitting a new one!

Also @arvidn, IMO, you should be more aggressive about closing poor-quality reports. I've followed a lot of issues where you clearly put in a lot of time translating vague explanations and/or foreign languages. I am amazed at your success rate at this, even when the OP gives no reproduction steps. But perhaps it's not the best use of your time.

IMO, you should be more aggressive about closing poor-quality reports.

I was hoping stale-bot could do that for me.

arvidn avatar May 17 '22 13:05 arvidn

IMO, you should be more aggressive about closing poor-quality reports.

I was hoping stale-bot could do that for me.

stalebot doesn't prevent the time sink. I've seen a lot of examples of the following:

  1. poor quality issue opened
  2. you spend time figuring out what the OP means, and reply / ask clarification
  3. OP never replies and stalebot closes the issue

What I think should happen, orthogonal to stalebot, is:

  1. poor quality issue opened
  2. you close the issue without spending time figuring out what OP means, and reply they can reopen if they add context / clarification / do google translate themselves / validate that the issue is really a libtorrent issue not an app issue / etc

One of the "Closed" issues is actually quite active:

https://github.com/arvidn/libtorrent/issues/4936

iopq avatar Aug 16 '22 06:08 iopq

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Nov 23 '22 03:11 stale[bot]

Guess we have an answer. 🤣

On Tue, Nov 22, 2022, 9:17 PM stale[bot] @.***> wrote:

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

— Reply to this email directly, view it on GitHub https://github.com/arvidn/libtorrent/issues/6797#issuecomment-1324499647, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACLTLQJCKE7FZRQLCSOUULDWJWEDNANCNFSM5S2GC7CA . You are receiving this because you were mentioned.Message ID: @.***>

cocokola avatar Nov 23 '22 09:11 cocokola

One of the "Closed" issues is actually quite active:

#4936

That ticket is not active. Sure, people post comments on it, but none of it is driving any progress on the feature request.

arvidn avatar Nov 23 '22 09:11 arvidn

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Mar 18 '23 20:03 stale[bot]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Aug 12 '23 18:08 stale[bot]