Which of these do you consider inappropriate?

"you ks'd me you stupid n-gger" 678 86.04%
"sorry for being such a n-gger, lol" 519 65.86%
"you ks'd me you stupid f-ggot" 624 79.19%
"sorry for being such a f-ggot, lol" 435 55.20%
"ur f-cking gay" 596 75.63%
"lol that was gay sorry" 235 29.82%
"kennen ur a ******" 520 65.99%
"sorry for being such a ******, lol" 251 31.85%
"I raped you so hard" 437 55.46%
"sorry, I got raped mid" 164 20.81%
None of the above 77 9.77%
Multiple Choice Poll. Voters: 788. You may not vote on this poll

(Initial Results Posted) Google Poll on Offensive Language in LoL

First Riot Post
Comment below rating threshold, click here to show it.

CupcakeTrap

This user has referred a friend to League of Legends, click for more information

Senior Member

12-29-2012

In the poll above: it should say "kennen ur a r-tard" and then "sorry for being such a r-tard, lol".

Here's the original thread:

http://na.leagueoflegends.com/board/....php?t=2934959

The initial results are attached here as a PDF.

Wow, Reds! I'm still on my weekend adventure, but I wanted to thank you for responding and reply to your comments.

Quote:
Originally Posted by RiotDerivative View Post
This is a very interesting analysis. Thanks for sharing!

Keep in mind that some of your results might be surprising because you are working with a biased sample (participating bias). Your sample consists of LoL players that read the forums, and that found the interest to click on you survey. Also, you should not be shy about tossing out entire surveys from respondents that are obvious trolls.
I do have data on which responses are from the LoL forums versus which are from Reddit; later on, I'd like to see if I can identify any significant relationships between "poll origin" and responses. I certainly would not presume to claim that this survey measures the LoL community's views with great accuracy: not only did I throw it together rather quickly, but there's surely a selection bias at work here. That said, on the language issue, I mostly interact with forumgoers, so knowing what the forum/Reddit crowds think is interesting to me.

And yes, one thing I plan to do when I do a proper analysis is go through and delete duplicate results or the most obvious troll responses.

(on the "are you rethinking your use of any of these words" question)
Quote:
Originally Posted by RiotDerivative View Post
This is great! I found it interesting that people reconsidered their use of the word "******" but not some of the more inflammatory words.
As a rough measure, if you look at these response rates as fractions of the "which words do you use" response sets, it seems like for each word roughly a quarter of that word's users are reconsidering their use. That's a very rough measure, of course; I might go back and (e.g.) only count "rethinking 'r-tard'" responses from people who said they sometimes use 'r-tard'. Then again, perhaps they're rethinking it and not currently using it.

Anyway, I was quite pleased to see that so many respondents are apparently willing to rethink their use of language.

Quote:
Originally Posted by RiotDerivative View Post
If you did not do so already, you should probably throw out the responses on this question for anyone that said "None of these" for the previous question.
Perhaps, although I think my poor question-phrasing has me in a dilemma here: perhaps someone said "none of these" because they're currently rethinking all of them. The literal wording of the question would exclude these, but I can easily imagine someone zeroing in on the "rethinking" part and neglecting the "currently use" phrase. I'll check later and see how often this sort of combination arose.

Quote:
Originally Posted by RiotDerivative View Post
You should also throw out any responses that answer "None of these" for this question AND mark one of the other answers, as they are invalid.
Definitely so! That would be a part of a proper pre-analysis data-cleaning ... which I unfortunately haven't been able to get to yet.

Quote:
Originally Posted by RiotDerivative View Post
The responses for "unacceptable/acceptable" words is kind of startling. Though, there could be a troll bias, and age may be a factor (the most common age in the sample is 16 and younger).
This is where I'm glad I left open some text fields and also had forum/reddit threads going. I noticed that some respondents objected to the acceptable/unacceptable phrasing as too context-independent, and felt that neither answer choice really expressed their views. (The poll I posted on this thread aimed to address this by providing concrete use-examples.) I expected some problems from the absolute phrasing, and I considered some middle-ground options, but in surveys I sometimes like to put in a few extremely simple, often binary, questions.



Quote:
Originally Posted by RiotDerivative View Post
51% of respondents do not autopunish for any word. This is powerful because to me that means that a player-supported system like that Tribunal is better than a computer program that might automatically punish someone based on their choice of words.
Full disclosure: I autopunish for n-gger and f-ggot, in all but the most contrived situations (e.g. "stop calling him a f-ggot"). IMO, neither of these words has a place in the gamer slang lexicon. (I do respect that Riot wants to avoid giving out a comprehensive Tribunal rulebook, so I won't ask for approval of this practice from you.) But yes, Tribunal is great, in part because it's flexible. Relatedly, it's harder to get around than a computer program that only understands a set of 20 "bad words".


Quote:
Originally Posted by RiotDerivative View Post
Note that many people that chose "I do not autopunish for any words" probably also selected "I do not autopunish for any of these words." Additionally, there is troll potential on this question as well.
Yep! I should have phrased it differently ... something like "I do not autopunish for any of these words, but I autopunish for other words."

Quote:
Originally Posted by RiotDerivative View Post
As you mentioned, they are most likely trolls and their responses can be tossed... but it is true that some people do not identify with either ***.
I feel odd assuming a priori that there aren't any people responding who have alternate gender identities, but yeah, the proportion here seems higher than what I'd expect the population average to be (although worth a check), and a large number of these were obvious troll responses that put SUCK MY DICK or whatever in the text fields.


Quote:
Originally Posted by RiotDerivative View Post
Would be cool to see the differences between male/female and age (such as "teenager", "college aged", "adult" etc.) as that might explain some of the more startling results.
Absolutely. I plan to run some analyses on that later.

Quote:
Originally Posted by davin View Post
Interesting! Poll data is often tricky--beyond the non-random sample considerations that need to be made when interpreting data like these (as RiotDerivative noted), you might be interested in doing things like covarying out social desirability bias! There's some fun controls you can apply to help filter out troll responses and get even more 'clean' responses from non-trolls.
Sounds interesting! What sorts of things might you ask in a language poll?

Quote:
Originally Posted by davin View Post
With a large enough set of statements, you could begin to randomize presentation and code based on statement characteristics (e.g., antagonistic vs. apologetic), then perform statistical analyses. For example, there seems to be a trend in these data toward apologetic statements containing hate speech being rated as less problematic. Though if you ask me, I don't like people throwing around 'gay' and 'rape' in those contexts.

Psychometrics!
Are you referring to the poll in this thread itself? If I do another Google survey, I might include more concrete example questions. (I'd also really like to add some questions about whether or not a given respondent has been punished by Tribunal yet, and then give them an open-ended prompt to explain what they got punished for and how they've reacted to it.) The advantage of concrete questions, like the ones in this thread poll, is that they get around some of the "well...it depends, I dunno" reaction that people seem to get an extra dose of when they're somewhat uncomfortable with their likely answers.

Quote:
Originally Posted by davin View Post
EDIT: Oh hey, I just noticed you're the same person who compiled the arachnophobia solutions for people. I'm noticing a Psychology theme
Haha, thanks! I again appreciate you publicizing the no-spiders mod on your Twitter account.

I don't have much of a psych background beyond AP Psych in high school, but I did major in the social sciences in college, so I have some rudimentary survey/statistical competence which I've found quite handy. I do find psychology a very interesting field with a lot to say of relevance to fields I've spent more time studying, such as political science, economics, and law. Like with political science in particular, my hunch is that doing good psych work is tricky because you have to think very hard about how you operationalize concepts, and how you're willing to trade accuracy for simplicity (because "a theory that explains everything explains nothing", in the sense that it doesn't make the world any easier to understand).


Comment below rating threshold, click here to show it.

Baren the Baron

Senior Member

12-29-2012

Someone tell me it's safe.


Comment below rating threshold, click here to show it.

Brennivin

Senior Member

12-29-2012

This poll is really disappointing, but thanks for compiling the data.

EDIT: Add an "All of the above," option to the poll?


Comment below rating threshold, click here to show it.

CupcakeTrap

This user has referred a friend to League of Legends, click for more information

Senior Member

12-29-2012

Quote:
Originally Posted by Brennivin View Post
This poll is really disappointing, but thanks for compiling the data.
You're welcome.

Would you mind explaining in what way you found the survey disappointing? (Since you posted before I'd posted the forum poll up, I assume you're referring to the Google poll.)


Comment below rating threshold, click here to show it.

Dainyan

Senior Member

12-29-2012

I thought this was actually pretty interesting, and it's obvious you put a lot of work into it!

I was shocked (shouldn't have been) by how many more teenagers were polled than not. It would be interesting to see how each age group feels as well. I like to think people closer to my age don't think it's okay to use those words. Hopefully? Please?


Comment below rating threshold, click here to show it.

Vahal

Senior Member

12-29-2012

Wow... that's pretty scary.

The PDF is safe, but it may cause you to lose faith in humanity. Effects may wear off between about five minutes and never.


Comment below rating threshold, click here to show it.

Brennivin

Senior Member

12-29-2012

Quote:
Originally Posted by CupcakeTrap View Post
You're welcome.

Would you mind explaining in what way you found the survey disappointing? (Since you posted before I'd posted the forum poll up, I assume you're referring to the Google poll.)
It wasn't the poll itself, but the results, especially with people voting that "Rape," is acceptable.


Comment below rating threshold, click here to show it.

Vahal

Senior Member

12-29-2012

Quote:
Originally Posted by Brennivin View Post
It wasn't the poll itself, but the results, especially with people voting that "Rape," is acceptable.
I found that one to be pretty heartless, even by the internet's standards. That first text clip that CupcakeTrap had pretty much summed up everything I feel about the word.


Comment below rating threshold, click here to show it.

CupcakeTrap

This user has referred a friend to League of Legends, click for more information

Senior Member

12-29-2012

Quote:
Originally Posted by Brennivin View Post
It wasn't the poll itself, but the results, especially with people voting that "Rape," is acceptable.
Yeah, I posted a thread arguing that people should reconsider the casual use of "rape", and it got downvote-closed in minutes.

That said, I prefer to think of this poll as merely showing the current state of the community.

On "rape", for example: 29% said they used the word, but about a quarter of those people said they were also having second thoughts about it.

Quote:
Originally Posted by Vahal View Post
I found that one to be pretty heartless, even by the internet's standards. That first text clip that CupcakeTrap had pretty much summed up everything I feel about the word.
I felt that response was very well-put.


Comment below rating threshold, click here to show it.

Nowevil

Senior Member

12-29-2012

Sorta sad. Can't believe some people think that they're entitled to making others feel bad.