Article: Preview of Twin Galaxies’ Score Submission and Adjudication Process

  1. 11-24-2014, 07:40 PM
    Quote Originally Posted by erockbrox View Post
    So there is accept and reject. What about undecided as in a tie? Also there may be some players out there who simply only want to set records and who do not want to partake in evaluating submission. According to this system you must evaluate submission. Is this so that the submissions don't over flood the site? I know that some people just want to play and then submit and that's it. Also did you hire a mathematician/computer programmer to come up with all of those algorithms?
    A tie is basically impossible. The system will not allow it and the way it works makes that outcome not feasible.

    You are correct. If you want to submit and be recognized, you need to participate.

    Yes, engineers are involved with the creation and execution of this sophisticated system.
    Jace Hall
    Head Custodian
    www.TwinGalaxies.com
  2. 11-24-2014, 07:57 PM
    Will there be a way to search for score submissions that have not yet been fully verified one way or another...this way interested gamers can contribute towards the validation of scores that are not yet fully accepted/rejected ?

    Additionally, a very informed individual may have good reason to validate a score that multiple uninformed gamers rejected. Their single "voice" could be lost in the masses as a result. And anyone who has seen "Twelve Angry Men" knows how difficult it can be to hold the dissenting opinion.
  3. 11-24-2014, 09:10 PM
    Does it matter if someone submits a really long video or not? I honestly would think that short videos should get a small amount of points if the verifier is correct, but for really long video there should be even more points if it were correct. Why because it makes a difference between a 10 min video and a 4 hour video. The longer the video the more you should earn. Especially on the marathon video which are 10+ hours.
  4. 11-24-2014, 09:23 PM
    Quote Originally Posted by RTM View Post
    Will there be a way to search for score submissions that have not yet been fully verified one way or another...this way interested gamers can contribute towards the validation of scores that are not yet fully accepted/rejected ?

    Additionally, a very informed individual may have good reason to validate a score that multiple uninformed gamers rejected. Their single "voice" could be lost in the masses as a result. And anyone who has seen "Twelve Angry Men" knows how difficult it can be to hold the dissenting opinion.
    You will be able to search the SUBMISSION REVIEW FORUM with full search capabilities. This is the forum that will contain all submissions that are going through the adjudication process and have not been accepted/rejected. Interested gamers can contribute towards the validation of scores here.

    During the adjudication process, any legitimate reason that an informed individual may have to validate a score can simply be posted into that submission's adjudication thread for all to see. A voice does not get lost there since correct adjudication is what is rewarded.

    However, you are correct that a very informed individual may have good reason to want to validate a score that multiple uninformed gamers rejected after adjudication. The possibility of this occurrence will be extremely rare due to the nature of the voter weighting system, however it is possible. The reverse of the described scenario is also true. A very informed individual may have a good reason to INVALIDATE a score that multiple uninformed gamers accepted. To address these scenarios there is a post-adjudication challenge system that is being implemented. Since these scenarios are the exception to the norm, this secondary system will be enabled only after the primary adjudication system is functioning normally, with good understanding of the participants. It is important not to overwhelm everyone.

    Jace
    Jace Hall
    Head Custodian
    www.TwinGalaxies.com
  5. 11-24-2014, 09:27 PM
    Quote Originally Posted by erockbrox View Post
    Does it matter if someone submits a really long video or not? I honestly would think that short videos should get a small amount of points if the verifier is correct, but for really long video there should be even more points if it were correct. Why because it makes a difference between a 10 min video and a 4 hour video. The longer the video the more you should earn. Especially on the marathon video which are 10+ hours.
    Video length is not a factor.
    Jace Hall
    Head Custodian
    www.TwinGalaxies.com
  6. 11-24-2014, 09:49 PM
    Couple of concerns:

    1. I think you still need to make video submissions a requirement. While photographic/other evidence is nice it should be to supplement a submission and not as an only means of proof. A picture does nothing to verify game play.

    2. You mentioned there will be a requirement for submitting scores where if a verified user wants to submit, he/she will also need to have a certain "STAR".

    What happens if, for example, you have a user (Person A) who likes to submit mass amounts of scores. If this STAR is at least somewhat proportional to the number of submissions, could there potentially be a problem if there are not enough submissions by other users that would allow Person A to reach the appropriate STAR?
  7. 11-24-2014, 09:53 PM
    Just thought of something else to add. Will there also be something in place that essentially punishes people who repeatedly submit scores that are voted as non-valid submissions by the community?
  8. 11-24-2014, 10:51 PM
    Will there be a way to appeal a accept/reject final ruling? There are times where you can show a group a gameplay video and of the 10 who watch it only 1-2 "get" what happened.
  9. 11-24-2014, 11:40 PM
    Quote Originally Posted by d3scride View Post
    Couple of concerns:

    1. I think you still need to make video submissions a requirement. While photographic/other evidence is nice it should be to supplement a submission and not as an only means of proof. A picture does nothing to verify game play.

    2. You mentioned there will be a requirement for submitting scores where if a verified user wants to submit, he/she will also need to have a certain "STAR".

    What happens if, for example, you have a user (Person A) who likes to submit mass amounts of scores. If this STAR is at least somewhat proportional to the number of submissions, could there potentially be a problem if there are not enough submissions by other users that would allow Person A to reach the appropriate STAR?
    Answer 1 - Video submissions are not a requirement. It's up to the peer-review process to decide if it wants to accept a score that has no video. It doesn't have to. If it doesn't accept what is presented (video or not), then it doesn't accept it.

    Answer 2 - You are correct - and this will act as a gating mechanism to prevent too many submissions from overloading the site's ability to adjudicate all the scores. The previous version of Twin Galaxies just got overloaded until things came to a standstill for many. That can't happen here.
    Jace Hall
    Head Custodian
    www.TwinGalaxies.com
  10. 11-24-2014, 11:43 PM
    Quote Originally Posted by d3scride View Post
    Just thought of something else to add. Will there also be something in place that essentially punishes people who repeatedly submit scores that are voted as non-valid submissions by the community?
    Yes. Continuing to fail the adjudication process with rejected submissions will drive up that individual's STAR. Making it more and more costly to submit because of the number of CORRECT adjudications they must achieve to qualify for submission.
    Jace Hall
    Head Custodian
    www.TwinGalaxies.com
Page 2 of 13 FirstFirst 1 2 3 4 12 ... LastLast
Results 11 to 20 of 127
Page 2 of 13 FirstFirst 1 2 3 4 12 ... LastLast
Join us