League of Legends Community

League of Legends Community (http://forums.na.leagueoflegends.com/board/index.php)
-   General Discussion (http://forums.na.leagueoflegends.com/board/forumdisplay.php?f=2)
-   -   (Initial Results Posted) Google Poll on Offensive Language in LoL (http://forums.na.leagueoflegends.com/board/showthread.php?t=2953204)

CupcakeTrap 12-29-2012 11:42 AM

(Initial Results Posted) Google Poll on Offensive Language in LoL
 
2 Attachment(s)
In the poll above: it should say "kennen ur a r-tard" and then "sorry for being such a r-tard, lol".

Here's the original thread:

http://na.leagueoflegends.com/board/....php?t=2934959

The initial results are attached here as a PDF.

Wow, Reds! I'm still on my weekend adventure, but I wanted to thank you for responding and reply to your comments.

Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
This is a very interesting analysis. Thanks for sharing!

Keep in mind that some of your results might be surprising because you are working with a biased sample (participating bias). Your sample consists of LoL players that read the forums, and that found the interest to click on you survey. Also, you should not be shy about tossing out entire surveys from respondents that are obvious trolls.

I do have data on which responses are from the LoL forums versus which are from Reddit; later on, I'd like to see if I can identify any significant relationships between "poll origin" and responses. I certainly would not presume to claim that this survey measures the LoL community's views with great accuracy: not only did I throw it together rather quickly, but there's surely a selection bias at work here. That said, on the language issue, I mostly interact with forumgoers, so knowing what the forum/Reddit crowds think is interesting to me.

And yes, one thing I plan to do when I do a proper analysis is go through and delete duplicate results or the most obvious troll responses.

(on the "are you rethinking your use of any of these words" question)
Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
This is great! I found it interesting that people reconsidered their use of the word "******" but not some of the more inflammatory words.

As a rough measure, if you look at these response rates as fractions of the "which words do you use" response sets, it seems like for each word roughly a quarter of that word's users are reconsidering their use. That's a very rough measure, of course; I might go back and (e.g.) only count "rethinking 'r-tard'" responses from people who said they sometimes use 'r-tard'. Then again, perhaps they're rethinking it and not currently using it.

Anyway, I was quite pleased to see that so many respondents are apparently willing to rethink their use of language.

Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
If you did not do so already, you should probably throw out the responses on this question for anyone that said "None of these" for the previous question.

Perhaps, although I think my poor question-phrasing has me in a dilemma here: perhaps someone said "none of these" because they're currently rethinking all of them. The literal wording of the question would exclude these, but I can easily imagine someone zeroing in on the "rethinking" part and neglecting the "currently use" phrase. I'll check later and see how often this sort of combination arose.

Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
You should also throw out any responses that answer "None of these" for this question AND mark one of the other answers, as they are invalid.

Definitely so! That would be a part of a proper pre-analysis data-cleaning ... which I unfortunately haven't been able to get to yet.

Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
The responses for "unacceptable/acceptable" words is kind of startling. Though, there could be a troll bias, and age may be a factor (the most common age in the sample is 16 and younger).

This is where I'm glad I left open some text fields and also had forum/reddit threads going. I noticed that some respondents objected to the acceptable/unacceptable phrasing as too context-independent, and felt that neither answer choice really expressed their views. (The poll I posted on this thread aimed to address this by providing concrete use-examples.) I expected some problems from the absolute phrasing, and I considered some middle-ground options, but in surveys I sometimes like to put in a few extremely simple, often binary, questions.



Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
51% of respondents do not autopunish for any word. This is powerful because to me that means that a player-supported system like that Tribunal is better than a computer program that might automatically punish someone based on their choice of words.

Full disclosure: I autopunish for n-gger and f-ggot, in all but the most contrived situations (e.g. "stop calling him a f-ggot"). IMO, neither of these words has a place in the gamer slang lexicon. (I do respect that Riot wants to avoid giving out a comprehensive Tribunal rulebook, so I won't ask for approval of this practice from you.) But yes, Tribunal is great, in part because it's flexible. Relatedly, it's harder to get around than a computer program that only understands a set of 20 "bad words".


Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
Note that many people that chose "I do not autopunish for any words" probably also selected "I do not autopunish for any of these words." Additionally, there is troll potential on this question as well.

Yep! I should have phrased it differently ... something like "I do not autopunish for any of these words, but I autopunish for other words."

Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
As you mentioned, they are most likely trolls and their responses can be tossed... but it is true that some people do not identify with either ***.

I feel odd assuming a priori that there aren't any people responding who have alternate gender identities, but yeah, the proportion here seems higher than what I'd expect the population average to be (although worth a check), and a large number of these were obvious troll responses that put SUCK MY DICK or whatever in the text fields.


Quote:

Originally Posted by RiotDerivative (Hozzászólás 32959246)
Would be cool to see the differences between male/female and age (such as "teenager", "college aged", "adult" etc.) as that might explain some of the more startling results.

Absolutely. I plan to run some analyses on that later.

Quote:

Originally Posted by davin (Hozzászólás 32960596)
Interesting! Poll data is often tricky--beyond the non-random sample considerations that need to be made when interpreting data like these (as RiotDerivative noted), you might be interested in doing things like covarying out social desirability bias! There's some fun controls you can apply to help filter out troll responses and get even more 'clean' responses from non-trolls.

Sounds interesting! What sorts of things might you ask in a language poll?

Quote:

Originally Posted by davin (Hozzászólás 32960596)
With a large enough set of statements, you could begin to randomize presentation and code based on statement characteristics (e.g., antagonistic vs. apologetic), then perform statistical analyses. For example, there seems to be a trend in these data toward apologetic statements containing hate speech being rated as less problematic. Though if you ask me, I don't like people throwing around 'gay' and 'rape' in those contexts.

Psychometrics!

Are you referring to the poll in this thread itself? If I do another Google survey, I might include more concrete example questions. (I'd also really like to add some questions about whether or not a given respondent has been punished by Tribunal yet, and then give them an open-ended prompt to explain what they got punished for and how they've reacted to it.) The advantage of concrete questions, like the ones in this thread poll, is that they get around some of the "well...it depends, I dunno" reaction that people seem to get an extra dose of when they're somewhat uncomfortable with their likely answers.

Quote:

Originally Posted by davin (Hozzászólás 32960596)
EDIT: Oh hey, I just noticed you're the same person who compiled the arachnophobia solutions for people. I'm noticing a Psychology theme :)

Haha, thanks! I again appreciate you publicizing the no-spiders mod on your Twitter account.

I don't have much of a psych background beyond AP Psych in high school, but I did major in the social sciences in college, so I have some rudimentary survey/statistical competence which I've found quite handy. I do find psychology a very interesting field with a lot to say of relevance to fields I've spent more time studying, such as political science, economics, and law. Like with political science in particular, my hunch is that doing good psych work is tricky because you have to think very hard about how you operationalize concepts, and how you're willing to trade accuracy for simplicity (because "a theory that explains everything explains nothing", in the sense that it doesn't make the world any easier to understand).

Baren 12-29-2012 11:45 AM

Someone tell me it's safe.

Brennivin 12-29-2012 11:47 AM

This poll is really disappointing, but thanks for compiling the data.

EDIT: Add an "All of the above," option to the poll?

CupcakeTrap 12-29-2012 11:50 AM

Quote:

Originally Posted by Brennivin (Hozzászólás 32957648)
This poll is really disappointing, but thanks for compiling the data.

You're welcome.

Would you mind explaining in what way you found the survey disappointing? (Since you posted before I'd posted the forum poll up, I assume you're referring to the Google poll.)

Dainyan 12-29-2012 11:51 AM

I thought this was actually pretty interesting, and it's obvious you put a lot of work into it!

I was shocked (shouldn't have been) by how many more teenagers were polled than not. It would be interesting to see how each age group feels as well. I like to think people closer to my age don't think it's okay to use those words. Hopefully? Please?

Vahal 12-29-2012 11:52 AM

Wow... that's pretty scary.

The PDF is safe, but it may cause you to lose faith in humanity. Effects may wear off between about five minutes and never.

Brennivin 12-29-2012 11:52 AM

Quote:

Originally Posted by CupcakeTrap (Hozzászólás 32957730)
You're welcome.

Would you mind explaining in what way you found the survey disappointing? (Since you posted before I'd posted the forum poll up, I assume you're referring to the Google poll.)

It wasn't the poll itself, but the results, especially with people voting that "Rape," is acceptable.

Vahal 12-29-2012 11:55 AM

Quote:

Originally Posted by Brennivin (Hozzászólás 32957797)
It wasn't the poll itself, but the results, especially with people voting that "Rape," is acceptable.

I found that one to be pretty heartless, even by the internet's standards. That first text clip that CupcakeTrap had pretty much summed up everything I feel about the word.

CupcakeTrap 12-29-2012 11:56 AM

Quote:

Originally Posted by Brennivin (Hozzászólás 32957797)
It wasn't the poll itself, but the results, especially with people voting that "Rape," is acceptable.

Yeah, I posted a thread arguing that people should reconsider the casual use of "rape", and it got downvote-closed in minutes.

That said, I prefer to think of this poll as merely showing the current state of the community.

On "rape", for example: 29% said they used the word, but about a quarter of those people said they were also having second thoughts about it.

Quote:

Originally Posted by Vahal (Hozzászólás 32957894)
I found that one to be pretty heartless, even by the internet's standards. That first text clip that CupcakeTrap had pretty much summed up everything I feel about the word.

I felt that response was very well-put.

Nowevil 12-29-2012 12:04 PM

Sorta sad. Can't believe some people think that they're entitled to making others feel bad.


All times are GMT -8. The time now is 11:59 AM.


(c) 2008 Riot Games Inc