twitter
Dubious "Your Rating Impact has increased" messages
I have received 7 "Your Rating Impact has increased*" messages (all > 1 hr ago), but my rating is a 3.
Shown currently:
3 Rating Impact Last update: 1 hour ago
6 < sic - ??? - What is the 6 for? > Want to start writing notes? Raise your Rating Impact to 5 or higher.
Ratings that helped a note earn the status of Helpful: +3. <=FALSE
Ratings that helped a note reach the status of Not Helpful:+0
Contrasting ratings:-0
I assume I'm far from alone...? Have I misread something? This seems to be a clear bug. I've DM'd @CommunityNotes (starting 2/27), but DMs are ignored - not one response yet.
UPDATE: Aha!? Does https://communitynotes.twitter.com/guide/en/under-the-hood/contributor-scores#valid-ratings explain it? Then it's an in-app mis-messaging/documentation problem.
*As in You helped this note earn the status of Helpful, and it's now been seen by over 250K people on Twitter. Your Rating Impact has increased. < content of Community Note >
Hi @elvey sorry about the late response. We're getting too much traffic in the DMs and I was unable to find yours. Would you mind sending another one to bump it up the list?
Hi @elvey, circling back here to ask if you're still seeing issues with these counts? Thanks!
I am. A while back, I got approved to write notes, because I had so many helpful ratings that it overwhelmed the bug, but I'm disinclined to spend time sending more DMs as long all so far remain ignored and still warrant a response, HOWEVER, if you want to find them, look; The last two were
- "URGENT! :" [with an image] and
- "HELP! 911!"
I had included screen shots showing the many "...Your Rating Impact has increased" messages, so very actionable.
Update 1: Just sent: "I was asked to bump these messages, so [bump] - per [link to comment above]" Update 2: Despite Update 1, messages to @communitynotes still don't show as read (and have garnered no response).
"Would you mind sending another one to bump it up the list?"
I have done so, I said I did...and crickets.
(I've tried running the code, with no success. I suppose I should try to resolve / open an issue about that. I wonder if there's a forum for asking whether fellow community devs are having success running the code on M Macs. )
Please DM me directly here : https://twitter.com/lucasnantonio It has become really hard to keep track of the @communitynotes handle DMs due to scale.
Do you want me to DM you everything I sent to @communitynotes? Alternately, I just DM'd it "Bump for lucasnantonio." -should help with the scaling problem as you can search for that or "911" .
For anyone following this, we've been DM'ing and I've provided Lucas with everything he's asked for.
The problem continues, and I've documented ongoing miscounts.
He's been saying, e.g. "We do not see any issues with how these notifications are being sent."
I responded, "I don’t know how you cannot see the problem. You have my screenshots documenting it."
He said he would "take a deeper look" but then responded
"What seems to be happening here is that you're being notified about notes that became Helpful and then flipped back to Needs More Ratings. So your points go away. We'll improve it"
But that’s not it. I got one and then two more "Your Rating Impact has increased" messages this week, on notes that are still live, but my Rating Impact has not budged.
I reconfirmed "You got that notification, the note is still Helpful, and your score hasn't changed?"
I shared links to the tweets as requested.
It doesn't seem like it should be necessary, but X seems to be having a hard time with something - believing me? So I'm offering to meet up and show folks, as I am walking distance to X HQ.
Thanks @elvey to bring this issue to our attention and thanks for your patience. We identified at least 3 issues that may be causing you and others to experience this.
- The notification says "you helped this note become Helpful...and your rating impact has increased" Originally we were sending these to people who rated a note before it earned the status of helpful. However it's also being sent even if you rate a note AFTER it was already Helpful. In these cases, your rating helps strengthen the Helpful state, but Impact points are not awarded.
We agree this is highly confusing because of what the notification says, and will work on updating the copy according to the context and moment it's sent.
- Notes often change state as more ratings come in. You might get a notification for helping rate a note as Helpful, but by the time you see the notification, it is no longer Helpful.
We have an entire roadmap of improvements to reduce how often notes flip, and send notifications when we have high confidence in the stability of their current state.
- Our system doesn't yet run in real time, so in some rare misalignments between systems you might see a note as "Needs More Ratings" in your app, when in fact it already has enough score to be Helpful. That note will become Helpful as soon as the scoring system runs next, and your rating might not get counted as helping the note achieve that state.
We also have an entire track of work to make Community Notes run as fast as possible to "real time" and reduce delays between ratings and outcomes.
I have reported this repository to Github Support for false information since Community Notes devs' FAQ solution of DMing community notes on Twitter and asking to be removed does not work. They are currently looking into it.
