kernzyp's Feed

kernzyp
04-17-2020 at 03:43 PM
8 Comments
Rate this Entry

Adjudication speed !

My last submission was accepted in less than a day. Is that normal nowadays? What happened?
Thanks to all who voted. :)
Have a great weekend.

Thankstrivia212005, JJT_Defender thanked this post
Likestrivia212005, Rogerpoco, JJT_Defender liked this post
Comments
  1. Derek's Avatar

    stuff is going through quick, I've had a couple MAME subs go really quick, without INP analysis or even without anyone saying they voted yes

    Thankskernzyp thanked this post
    Likeskernzyp liked this post
  2. Rogerpoco's Avatar

    Lol, I guess that's how we roll now!

    Kinda seems...excessive, but I admit to just being used to what I'm used to, is all fine by me, encourages active adjudication, really, so that's a plus, snooze and loose!!!

    Thankskernzyp thanked this post
    Likeskernzyp liked this post
  3. MyOwnWorstEnemy's Avatar

    Yeah they definitely greased the skids on TGSAP... while its nice to see these submission get accepted quicker, I get a strong sense this is going to somehow prove to be a bad idea. This shifts most of the burden of gatekeeping from adjudication to the dispute system. Take the good with the bad I guess....

    Thankskernzyp thanked this post
    Likeskernzyp, onlyinajeep liked this post
  4. kernzyp's Avatar

    Quote Originally Posted by MyOwnWorstEnemy

    Yeah they definitely greased the skids on TGSAP... while its nice to see these submission get accepted quicker, I get a strong sense this is going to somehow prove to be a bad idea. This shifts most of the burden of gatekeeping from adjudication to the dispute system. Take the good with the bad I guess....

    I have to agree. More bad entries will slip through, for sure...
    LikesMyOwnWorstEnemy liked this post
  5. redelf's Avatar

    I believe it's great that the submissions are going through quicker and with less scrutiny. Diehards and known players aren't trying to cheat. Random people we've never heard of may try but at some point those scores will be found and easy to remove. Any score of the mass submitters that get through will be treated as a mistake as they should be and just removed and most likely that player will just resubmit or just go about life, they aren't trying to cheat.

    Hopefully we will still catch the errors that we all have made in a submission or two.

    Thankskernzyp thanked this post
    LikesPixe Sukola, kernzyp liked this post
  6. redelf's Avatar

    More than half the adjudicators on the site rely on a few active members to tell them which way to vote. It really comes down to 1-3 people stating the way they are voting for the rest to go along and the submissions passes. On a more contested title or a popular title usually gets a lot more scrutiny.

    This is how I think things are working, feel free to tell me otherwise.

    Likesfrancoisadt, kernzyp liked this post
  7. MyOwnWorstEnemy's Avatar

    One of my concerns is that for years, the dispute system was badly ignored under he guise of requiring 'irrefutable proof' to remove. It's much easier to vote 'No' and persuade other adjudicators to do the same with a valid argument than to spend hours of research and posting to persuade site administrators to review, only after you've convinced enough folks to click yes on the dispute claim.

    These days, administration is / has maintained the dispute thread and I'll give them kudos for the recent focus. How long will that continue until the 'next' priority is determined and disputes get neglected again. The community can control the outcome of adjudication, however the community can only recommend removal of invalid scores. There is no guarantee anyone is listen or will continue to listen. Also there's a concern about scalability. If the community grows, submission grows, and disputes will grow. However, will the administrative staff also grow to review and act upon more disputes?

    The way I see it is that anyone who votes NO (with valid reasons) in TGSAP will probably get steamrolled by Yes click happy voters. It will take the No voter weeks to months to have the valid dispute accepted and their credibility returned to normal. After a few cycles of this, they will stop voting No and abstain; too much work just to return to normal.

    As I mentioned before, I'll take the good and the bad and see how this new approach works out...

    PS - I recently helped out with research on one dispute for a pre TGSAP Guitar Hero submission. That research uncovered that submission along with 40-50 others, was placed in the wrong track based on difficulty setting. The response from TG Admin was that I or Community would have to dispute all 50 tracks individually. I figured I did my part and informed management of scoreboard integrity errors that they have the power to fix. They told me to spend a weekend filing out forms. That's not how I'm going to spend my time here.

    Thankskernzyp thanked this post
    Likeslexmark, kernzyp liked this post
  8. starcrytas's Avatar

    I recently had a MAME submission get approved without INP analysis.

    I'm all for speeding up adjudication, but can we at least have INP analysis done?

    LikesMyOwnWorstEnemy, kernzyp liked this post
Join us