Facts behind the Tribunal (A guide with math)!
Hello fellow Summoners!
I have been a big fan of the Tribunal since I began playing League of Legends. I was dying to see the math behind it and provide a guide on the math behind the tribunal. I achieved this guide by reading every post by Lyte I could find over the past 3 months. I hope you find it as informative as it is interesting. Please sticky!
Facts about the Tribunal
1) 12 million people play LoL every day
2) The average player plays 1 bot game and 2 pvp games (Per LoL stats)
1 bot game 2.4 mill
1 pvp game 4.8 mill
2nd pvp game 4.8 mill
for 12 million players playing every day!
3) The average player gets 1-5 reports per 100 games played (Per Lyte)
“Right now, on NA, depending on which population you pull (players with no ban histories, players with ban histories but are 'good' now, etc), you actually do see that the typical player only has a 1-4% reports/game ratio in the lifetime of their account.” @Lyte
“Consider that the average player receives about 4-5 reports every 100 games and you can see how absurd the difference is.” @Lyte
4) To face the tribunal you need 12% reports or 12 in 100 games played (Per WookieeCookie)
On a personal note I suspect the actual % is 25% beacuse I have never seen anyone in tribunal under this %!
"In fact, you've actually only been reported in .08% of the games you've played.” @WookieeCookie
“players who end up in the Tribunal are reported anywhere from 12% to 30% of the games they've played.” @WookieeCookie
“You have been reported in 26% of your games, which is dramatically higher than the rest of the population” @Lyte
5) 98% of players in NA will never once face the tribunal (Per Lyte)
“On NA, 98% of players will probably never see the Tribunal.” @Lyte
6) If you got 9 reports in 1 game it still only counts as 1 report from that game (Per Lyte)
7) Based on average statistics the Tribunal on average pardons 20% of people who face the tribunal (Per Justice Review stats)
8) There is a minimum number of reports required to face the tribunal it is not a Ratio system (Per Lyte)
“Typically a large number of reports are required before a player appears in the Tribunal, so if you had a bad game and are reported, don’t worry! You will most likely not end up in the Tribunal.” @Lyte
9) In other words a 1:1 ratio in 20 games will not send you to the tribunal (Per Lyte) However you are in danger of a Riot Audit.
10) If you average a 1:1 ratio in 20 games you can play a lot of games without being reported and eventually your old reports decay (3 months) (Per Lyte)
“This isn't a mistake. This punishment is deserved. This player has received over 1000 reports in 900 games. That's a staggering number that almost no players ever reach.” @Lyte
11) It takes at least 40% reports per games played to find yourself in the top 0.8% of toxic reported players subject to hand riot reviews (Per Lyte)
“You've accumulated hundreds and hundreds of reports. You are reported in almost 40% of your games.” @Lyte
“You were reported in nearly every single game you've ever played in that account's history; in fact, you have more than twice as many reports as games played. That's a staggering data point.” “In your case, we audited your account by hand and had to immediately act on it.” @Lyte
How do we know we can trust Riot in these internal reviews?
"There is a simpler reason to trust Riot’s internal audit: PROFIT. Riot want to make profit, and more people it bans the less potential profit Riot will make." @RiotKiddington
What does these facts about the Tribunal tell us?
1) The average LoL player plays 90 games per month, 270 games per 3 month cycle.
2) The average LoL player needs 27 reports in 90 games in a single month to face the tribunal.
3) The average LoL player needs 81 reports in 270 games per 3 month cycle to face the tribunal.
4) The average LoL NA player only gets 4 reports in a 90 game month, 12 in a 270 game 3 month cycle.
5) If you are trolled in ELO Hello but do not break the summoners code the 20% pardon rate tells us you will be pardoned!
“I bring this up, because I think you bring up a reasonable fear: "If I slip up in one game do I have to worry about a ban?" But the easy answer is: No. You don't.” @WookieeCookie
6) If you are punished by the Tribunal you are 99.99% guilty.
Having said that I did find 1 innocent person who got a warning from tribunal. Lyte himself corrected this mistake. My friend Getsuei rightly pointed out to me this quote from the official tribunal sticky "contact Riot Support to fix your record if you have been wrongfully punished". The person who was wrongly punished actually had his case posted in the tribunal forum so that might also be helpful for anyone who is innocent and punished =).
7) The average number of people impacted by a person who faces the tribunal
1 bot game 4 times 30 games in a month Equals 120 people affected
1 pvp game 9 times 30 games in a month Equals 270 people affected
2nd pvp game 9 times 30 games in a month Equals 270 people affected
for a total of 660 people affected by a player facing the tribunal in a single month
for a total of 1980 people affected by a player facing the tribunal over a 3 month cycle
8) In the tribunal typically a person gets 1 warning, 1 1 day ban, 1 3 day ban, 1 7 day ban, 1 14 day ban and is then permabanned.
9) This means they faced the tribunal 6 times (Sometimes more). This means it is possible this one person ruined the games of 11,880 games!
“Well it depends. Did they get a Warning? Did they refuse to change after the Warning and then get a 3 Day Suspension? Did they refuse to change after the 3 Day Suspension and then get a 7 Day Suspension? Did they refuse to change after the 7 Day Suspension and then get a 14 Day Suspension? If they did all that and refused to change. Then yes. They could get perma-banned.” @WookieeCookie
“All perma bans are reviewed by riot before going through to make sure that it has in fact been earned. As you know this perma ban did not appear out of the blue and was only made after a total 9 punished cases.” @Riot DavieB
10) In conclusion no one ever got perma banned who did not deserve it and LoL NA is a better place without them!
Some General questions and answers!
The only reason people even vote (Spam punish) is for the free IP! So untrue!
I would like to thank my friend Velore for pointing out that for a few months now there has been no IP reward for judging. We are now part of the Justice Review system going into season three and the only reason for people to judge now is to help out the community!
Is the only reason the tribunal exists becasue it is cheaper having players do Riots job? No!
I would like to thank my good friend PogoPogoPogoPogo for pointing out this great reference from Lyte.
"I have no idea why people assume having a Tribunal is 'cheaper' for Riot. It's more expensive. We still have a full Player Support team that reviews Tribunal cases and we also have a full development team that has to maintain the Tribunal and develop new features for it. If you want to argue about the Tribunal, let's have a discussion about it. Randomly saying it is cheaper or it's about money is basically the opposite of the truth." @Lyte
Is threatening to report someone a form of harrasment?
If you say it once because they broke the summoners code then no. If you say it because they are unskilled or if you say it multiple times then yes!
"the players that keep convincing others to report someone specific in a game tend to be the most toxic players in the game" @Lyte
Is it ok to curse? What if it is in retaliation?
“It is not ok to rage at teammates and curse them out. It is not ok to retaliate.” @ Lyte
How to avoid the tribunal or can you sum up the summoner’s code in a phrase?
“Players frequently write to my team full of excuses for their case, or fearful that they're going to get banned in the future. They often want to debate the Summoner's Code down point by point. Is it okay to do this? What about that? What if someone else does X, and I do Y to them in retaliation? Can I get banned for Z? And our response can always be summed up with one simple phrase: “Don't be a jerk”” @WookieeCookie
When someone is mean to you, you are not entitled to: 1) Threaten to have *** with their mothers.
2) Call them names (f***head, d***face, *****) 3) Berate them for "KS"ing. (It's not a thing, IMO. It's a team game, it's not possible to 'steal' something that nobody owns) 4) Yell at them in caps.
5) Call the other teams noobs for losing 6) Declare "bg" because you lost. (I've done this a few times, I understand the frustration. Don't do it) @Damiya
Are Inappropriate summoner names allowed?
“And since technically it violates our naming guidelines I went ahead and replaced it with a temporary name instead.” @Wookieecookie
About the leaverbuster system!
“Your leaverbuster level will go down as you play without leaving. But unfortunately I can't provide specific time frames as to how much time needs to pass before it decreases. Otherwise less... honorable players would try to game the system as much as possible to their benefit. One thing to keep in mind though is that it is based off of game time played, and not real time. So if you tried to wait three weeks but only played one or two games, your leaver level would not decrease very much.” @WookieeCookie
“SimplyAlive is right. Your leaver penalty will decay as you play games without dropping off. Eventually it will decay back to zero and you'll have a grace period where you can disconnect from a game or two without getting suspended.” @WookieeCookie
About innocent people being punished?
“I actually mentioned this in another thread but I hand-reviewed all of these cases over a lunch break. Every single case except the last one deserves the ban for a variety of reasons from pre- and post-game chat to consistent and constant passive-aggressiveness or blatant rage. The last one for the low level Bot player was a mistake. The system isn't perfect, but I'm OK with 1 false positive every 140,000 cases and I'll manually correct the last case.” @Lyte
Lyte’s email address
Please e-mail me at lyte [[[at]]] riotgames.com. Lyte@Riotgames.com
Did you get banned because of 1 bad game?
"It takes hundreds of reports over dozens of games to end up in the Tribunal and actually even have a case. Just because you see 1 game in the Tribunal case doesn't mean 1 game landed you in the Tribunal." @Lyte
Are you sure the Tribunal works?
"We know for a fact that only 1.4% of total player base get into the Tribunal, and less than 50% of that actually get into the Tribunal again. So that’s 0.7% of players that will be impacted by the feature you seek. If I take those resources and make features that will affect other 99.3% (or 98.6%) of the player base, wouldn’t that be more effective and impactful?" @RiotKiddington
Are there other ways to get banned other than Tribunal, Leaverbuster and Riot hand selected cases?
Yes if you are rude in chat rooms you can find yourself banned!
"You won't be getting a reform card because you were not banned by the Tribunal. If you don't want to make the same mistake again then you should be aware that chat in the LoL Chat Rooms is monitored and you should be more careful about what services you claim to sell others." @WookieeCookie
I want to do an experiment with the report system and Tribunal. Is this dangerous? Yes!
"It's pretty cool that you're doing an experiment like this, but I should warn you that if your experiment is successful, all your accounts are likely to have some punitive action taken, not just the extra accounts you've made for the purposes of this experiment. I'd advice against actually following through with this. I love experiments, but I wouldn't want you to get banned in the name of Science." @RiotMontag
How can you tell when someone is intentionally feeding?
Yes intentionally feeding is punishable! Personally I look at all of the reports and if they are a pro and in one game all of a sudden they pretend to be new and have a terrible score its pretty obvious it was intentional.
"Typically when judging Intentional Feeding cases, I look for massively inappropriate items like 5 basic boots, phrases like " I'mma feed then" in the chat, or use my best judgement to determine if someone could reasonably have that score in a game of that length." @EncasedShadow
I am a unskilled player will my Unskilled Player report get me into trouble?
I would like to thank Velore for answering this one and for finding the reference! NO!
"Don't worry, Unskilled Player reports do not show up in the Tribunal. Those reports are just for our research, analyses and system features." @Lyte
Why are some Toxic cases pardoned and some Innocent cases punished?
"We keep a close eye on cases like this, so we can see why they would be frustrating. There's a pretty simple explanation for what's going on here though, and hopefully after I share it with you then you'll be a little less discouraged. Think of it like this. Imagine there are 1000 tribunal voters. 80% of those tribunal voters are pretty consistent voters. 10% of those tribunal voters are more strict than usual. 10% of those tribunal voters are more lenient than usual. This can lead to situations like this where we may see a case pardoned where the actual behavior can be questionable." @WookieeCookie
Do you have a clean slate after a punish? Some breathing room? Yes!
"That’s not what happened here. In fact, since the previous 3 Day suspension the player has been reported in over 45 games. Over 45 Games? That's toxic behavior that affects over 405 players in League of Legends." @WookieeCookie
I only said 1 bad thing in all 5 of my cases. Do I deserve to be punished?
I would like to thank SchierkeWiking for providing this quote and reference! YES!
"The Tribunal verdict is not based on a 'majority' rule; there is also no requirement that all games have to be toxic for it to warrant a suspension. Depending on the case, sometimes 1 game is all that is needed to show that the player deserves a suspension. To Tribunal reviewers, decisions like these are up to you. When you view a Tribunal case, the questions you should ask yourselves are, "Is this player's behavior appropriate in League of Legends?" and "Would I want to play with this player?" @ Lyte
Can i get warned then banned for cases close to each other (Double Jeopardy)? No!
I would like to thank Magoomba for providing excellent details on this question! 100% credit due to Magoomba!
"If someone is punished in the Tribunal, and then they end up in the Tribunal again, reports that were made against them prior to the verdict of the first Tribunal case won't show up in the second." @RiotPi
"The Tribunal technically only searches for games since your last ban, so if this actually happened it's a bug. Could you send me the dates of your Reform Cards that supposedly had overlapping games? I just checked your last 4 cards and I don't see any overlapping games." @Lyte
"I won't post your stats or chat here, but the main reason you were permanent banned was due to games from 11/9/12 to 11/12/12 which were all games after your 2 week ban." @Lyte
This guide in foreign languages
For Brazillian players of LoL my dear friend Makarath translated this guide into Portuguese. I would like to thank him for his great effort and contribution to LoL brazil! Here is his link.
Funniest Tribunal case ever!
"Health pool too big" "IM A BEAAAARRRR"
A little about me! Currently Reneckton is my favorite Champion. I have an 87% correct case rate on the Tribunal (Peaked at 104) probably because I am a little lenient. I judged over 2k cases before I decided to take a Hiatus. I 100% believe in the tribunal and in Riot. And I look forward to making new friends and hearing your responses! Take care friends =)
Also you may want to check out my new guide on Season 3 Experience Modifiers with proof.
My guide to counter initiation junglers with Heimerdinger jungle.
And in the Player Behavior Forum my 'how to get the honor banner you want' guide.
I see 50 posts a day asking about how the tribunal works, I do a months worth of research and no one has a comment? lol come on guys throw me a bone =)
Thnxs for the guide :) btw how did u get this info just curious
If this thread had links to posts by Lyte, etc. and all the sources for all your information, I'd be making a habit out of linking other players to this thread as a reference for any questions they have. It'd save me some time and effort every time.
Thanks for taking the time to put this together! It's nice to see that my 30 - 60 minutes judging cases everyday is worth while. I wish there was a way to follow you so if you ever did another research post, I wouldn't miss it.
I don't know what the forum rules are about reposts, but this thread also belongs in the Tribunal section!
(am currently hovering around rank 130 at 87% accuracy)
Thank you for your comments Ancient Fraggle and Shatteredskys. I literally spent a month reading posts. People ask for references but I just didnt feel like adding them. I mean it is as simple as looking for Red posts in the Tribunal forum, you can see everything pretty easy. The hard part was deciphering which information was relevant and then doing math on that information. For example Lyte talked to a lot of banned people and this is where I got most of my information. He said several times what % of reports they recieved to face the tribunal. I simply had to find the lowest % Lyte mentioned because that is the lowest % I can factually say can land someone before the tribunal. I have several other projects in the works on the tribunal and I love jundging but I am far too lenient =). Take care friends!
I would just like to share this with you guys. Yesterday I logged into my Justice review and 9 of my 20 cases from the previous day got Permabanned! lol wow what a record! It took me weeks just to get 1 permaban and now 9 in a single day. I feel on top of the world knowing LoL is better today and getting better all the time! Stay thirsty my friends =)
Who gets punished?
Who get punished*For wasting 20+ minutes of a persons time because they somehow have no idea how to play despite Co-Op and bot games?
I would like to point out that Lyte's recent remarks on the banning of Iwilldomiate seem to validate my original post. On a brighter note I am now in a 36 case win streak (A high for me) and I am in the top 350 tribunal judges (Also a high) so everything seems good in the world again =)
|All times are GMT -8. The time now is 08:33 PM.|
(c) 2008 Riot Games Inc