admin staff's Feed

admin staff
07-01-2018 at 01:26 AM
23 Comments
Rate this Entry

Updates !! Database Services

Hi All

We have updated our database recalculation services . The updates include enhanced performance and scheduled daily recalculations including SP used in buying certificates.

In the past the service ran every time a dispute was accepted or rejected. Soon the service will run everyday.

We hope that this will reduce the sudden spike or fall in CR and SP which users noticed after the acceptance or rejection of a dispute.

This service will be operational in 48 hours . The service will recalculate all SP and CR from the beginning of times.

Feel free to ask questions that you may have regarding SP and CR services.

Regards
Admin Staff
Comments
  1. HugDD's Avatar
    I'm confused, I thought all the calculations were complete from earlier on with this TGSAP era, as of last year when all submissions were being redone, sorta speak. Does this mean another revamping of this process is underway? I hope I'm making sense here, I don't remember when I came about this, but I do recall it taking place last year, and stella_blue, before he was no longer that active on here, informed me of this.

    As for the certificates, would it be possible to have an entirely digital version made at request? I'm never anticipating ever landing a world record or what not, but I'm with you and your colleagues on the whole paperless green ways of doing things.

    Thanks, and hope you're all having a great weekend! :)

    -Duc
    Chicago, IL
    LikesHAN, Conjured Entertainment liked this post
  2. admin staff's Avatar
    Hi HugDD

    The database service recalculates SP and CR generated during the TGSAP era .

    TGSAP has a 5% CR deduction for wrong votes on any submission.

    For fair calculations , when a dispute is accepted , the services check the submission date of the score and checks the CR and SP of all users who voted on that submission .

    It then recalculates 5% deductions based on the numbers on the submission date . Currently this service runs every time a dispute is accepted or rejected.

    Now this service will run everyday to recalculate the CR and SP . This will resolve any discrepancies in CR or SP on a daily basis .

    I hope this made sense

    Regards
    Admin Staff
    Likesdatagod liked this post
  3. HugDD's Avatar
    Quote Originally Posted by admin staff
    Hi HugDD

    The database service recalculates SP and CR generated during the TGSAP era .

    TGSAP has a 5% CR deduction for wrong votes on any submission.
    Actually, the five percent CR hit was implemented towards the end of 2015, but before then, it was something, and then something (at some points before I registered here in September of that year), then 100 points just prior to this post in December 2015:
    https://www.twingalaxies.com/content...lty-Adjustment

    Hopefully this'll end up making sense, with the work you're all doing, especially for folks who take both submission points and credibility rating points seriously

    -Duc
  4. admin staff's Avatar
    Hi Hugdd

    We have a record of each and every submission and related deduction and award criteria . If a submission has points deduction attached to it then the service will recalculated based on that .

    The database service was implemented after the 5% deduction criteria was introduced . We have been running recalculations on the site after every dispute is accepted or rejected.

    The problem with that is if a dispute is not accepted for a long time , the service wont recalculate and resolve any discrepancies.

    The only change this new service will have is the run frequency and performance improvements .

    Regards
    Admin Staff
    LikesHugDD liked this post
  5. JasonV91's Avatar
    Is this same service responsible for recalculating ESI when submissions are accepted or removed from leaderboards after a successful dispute? If ESI is recalculated by a different service, does it also run on a daily basis, or is there a different schedule?
  6. kernzyp's Avatar
    Is this why I've just lost 400+ submission points and I'm now on -353???
    The switch happened during a double submission.

    ThanksHugDD, Barthax thanked this post
    LikesRaGe, HugDD, Barthax liked this post
    Updated 07-01-2018 at 11:48 AM by kernzyp
  7. Max's Avatar
    I just gained 400! It's very satisfying to think that these bonus points came directly from kernzy's account. :D
    LikesHugDD, kernzyp, Barthax liked this post
  8. datagod's Avatar
    Thank you for all the hard work you do, everyone at Twin Galaxies. I would love to take a peek at the internals and see how everything works. It is what I do for a living.
  9. kernzyp's Avatar
    Quote Originally Posted by Max
    I just gained 400! It's very satisfying to think that these bonus points came directly from kernzy's account. :D
    LMAO!!!!!!!!!!!!!
    Such a shame you have nothing to add. ;)
    Updated 07-01-2018 at 04:15 PM by kernzyp
  10. Snowflake's Avatar
    I gained 150 pts today, but only got notication that would count for a small fraction of that
  11. Max's Avatar
    Quote Originally Posted by kernzyp
    LMAO!!!!!!!!!!!!!
    Such a shame you have nothing to add. ;)
    A little light hearted humor sir. TG works so hard to make everything work, a little levity now and again never hurts.
    Likesdatagod, kernzyp liked this post
  12. Barthax's Avatar
    What bugs me about these posts is if there have been no disputes completed, then what is there to recalculate? It would be nice for TG to actually acknowledge something is borked elsewhere. These posts come across as "everything is working perfectly but we need to recalc to correct the perfection". :(
    ThanksHugDD thanked this post
    LikesSnowflake, HugDD, stella_blue liked this post
  13. admin staff's Avatar
    Hi Barthax
    The adjudication services run 240 times every day to process the submissions and award or penalize the voters .
    We identified cases where .5% times the services did not update the SP of a few voters after the adjudication services sprint . This was logged and we created a reconciliation service to resolve the discrepancies.
    The problem was that the reconciliation services used to run only after a dispute was accepted or rejected.
    If the reconciliation service runs everyday, it will resolve any discrepancy automatically . Its a huge huge load to automate and recalculate all stats for all TG users in one go .
    We have re-coded the services to make it happen .
    I hope this made sense .
    Regards
    Admin Staff
    ThanksBarthax, HugDD, Dave Hawksett thanked this post
  14. kernzyp's Avatar
    So what costs 400 submission points??
    LikesBarthax liked this post
  15. Barthax's Avatar
    Quote Originally Posted by admin staff
    Hi Barthax
    The adjudication services run 240 times every day to process the submissions and award or penalize the voters .
    We identified cases where .5% times the services did not update the SP of a few voters after the adjudication services sprint . This was logged and we created a reconciliation service to resolve the discrepancies.
    The problem was that the reconciliation services used to run only after a dispute was accepted or rejected.
    If the reconciliation service runs everyday, it will resolve any discrepancy automatically . Its a huge huge load to automate and recalculate all stats for all TG users in one go .
    We have re-coded the services to make it happen .
    I hope this made sense .
    Regards
    Admin Staff
    Thank you.

    If your wording is correct and there is occasionally too little SP given to the submitters, it would be impossible for anyone to reach negative SP after a recalculation (all SP would increase or remain static). However, negative SP has happened on four different occasions to myself and has happened multiple times to other users. I've learned to keep ~100 SP or more because of the known issue and even created a scoreboard in cheek publicise the problem (which also lead to a different problem about the scoreboard not accepting negative integer submission). The voiced experience of the users includes your stated findings but also widely contrary experiences to your stated findings.

    Could you confirm that this is a known nuance to the situation? It is by far a worse nuance than in your stated findings.

    Thanks for reading. :)
    LikesHugDD liked this post
  16. kernzyp's Avatar
    Feel free to ask questions that you may have regarding SP and CR services. (Except Kernzy)

    Regards
    Admin Staff
  17. establshed's Avatar
    Hi Barthax /Kernzyp
    The adjudication services include the creation of tracks .
    Users donate SP to create tracks .
    The services "update=deducts" the User SP and activates the tracks.
    I specifically used the word update as it could mean adding or deducting SP
    Now if you have noticed that users who donate for tracks face the negative SP issue .
    People who have never donated for a track will not face this problem
    Regards
    Admin Staff
    Updated 07-02-2018 at 01:19 PM by admin staff
  18. kernzyp's Avatar
    Are you saying that my SP's were not taken during track creation/donations? Because I can assure you, they were. I watched it go down when donating to one of Barthax's tracks.
    You're making kindness on here suck, and have stopped people submitting/playing.
    How lovely.

    This means that I have been submitting using "loaned" SP's, with a massive interest rate.
    This is WELL overpriced.
    ThanksHugDD thanked this post
    LikesHugDD liked this post
    Updated 07-02-2018 at 03:48 PM by kernzyp
  19. stella_blue's Avatar
    8 days ago, on July 11th, I had 11,423 submission points.

    On July 12th, I posted the following submission:

    https://www.twingalaxies.com/showthread.php/190093

    Immediately after submitting the score, 3 SP were correctly deducted from the total, leaving me with 11,420 submission points.

    So far so good.

    Roughly 24 hours later, 3 points were inexplicably added back, restoring my original 11,423 SP total.

    Earlier today, at 10:10 AM (EDT), my submission was accepted.

    I currently have 11,427 submission points (see below):



    I did NOT vote for my accepted submission. The last time I voted for ANY submission was almost exactly one year ago.

    Within the past week, I have gained 7 SP for no apparent reason.

    Had I been aware that I could "earn" submission points for doing nothing, I would have embraced that strategy years ago.

    All joking aside, something seems to be amiss.

    @admin staff
    ThanksSnowflake, HugDD, MyOwnWorstEnemy thanked this post
    LikesHugDD liked this post
  20. kernzyp's Avatar
    Tell me about it.
    -356 submission points...
    LikesHugDD liked this post
Page 1 of 2 1 2 LastLast
Join us