Stories
Slash Boxes
Comments

Dev.SN ♥ developers

Dev.SN Moderation

This document attempts to explain the moderation system that lies underneath this implementation of Slashcode's vast comment section. It was originally written for Slashcode years ago, so the specifics of this moderation system are outlined here. Keep in mind that as this project grows, some aspects can change to better serve the community and improve the overall experience.

Contents

  1. Purpose
  2. Goals
  3. Who
  4. How
  5. Mod Bombs
  6. Spam Mod
  7. Moderation Issues
  8. FAQ

Purpose

As you might have noticed, a site like this can get a lot of comments. Some are downright terrible; others are truly gems, and hundreds of comments can be hard to sift through.

The moderation system is designed to sort the gems and the crap from the steady stream of information that flows through the pipe. And wherever possible, it tries to make the readers of the site take on the responsibility.

The goal is that each reader will be able to read the the threshold they prefer. Select "-1" and you'll see trolls and possible wrongly-modded comments, try "5" and you'll see only the top-rated comments.

Goals

  1. Promote Quality, Discourage Crap.
  2. Make SoylentNews as readable as possible for as many people as possible.
  3. Do not require a huge amount of time from any single moderator.
  4. Do not allow any single moderator a 'reign of terror' -- no 'mod bombs'.

Who

We've set up a few simple rules for determining who is eligible to moderate.

  1. Logged In User If the system can't keep track, it won't work, so you gotta log in. Sorry if you're paranoid, but this system demands a certain level of accountability.
  2. Positive Contributors Slashcode tracks your "Karma" (see the FAQ). If you have non-negative Karma, this means you have posted more good comments than bad, and are eligible to moderate. This weeds out spam accounts.
  3. No Sockpuppet Accounts Accounts newer than 1 month are not eligible to moderate. This should keep sockpuppet accounts from immediately being a problem.

So the end result is a pool of eligible users that represent (hopefully) average, positive SoylentNews contributors.

How

Each day every eligible moderator is given 5 mod points to play with. Each comment they moderate deducts a point. When they run out of points, they are done moderating until 00:10 UTC when mod points are regenerated.

Moderation takes place by clicking the drop down list that appears next to comments, and selecting one of the adjectives like 'Flamebait' or 'Informative'. In general, bad words will reduce a comment's score by a single point (a 'down mod'), good words increase a comment's score by a single point (an 'up mod'). All comments are scored on an absolute scale from -1 to 5. Logged in users start at 1 (although this can vary from -1 to 2 based on their overall contribution to discussions) and anonymous users start at 0.

Moderators can participate in the same discussion as both a moderator and a poster. You are only prevented from modding your own posts.

Concentrate more on promoting than on demoting. The real goal here is to find the juicy good stuff and let others read it. Do not promote personal agendas. Do not let your opinions factor in. Try to be impartial about this. Simply disagreeing with a comment is not a valid reason to 'down mod' it. Likewise, agreeing with a comment is not a valid reason to 'up mod' it. The goal here is to share ideas. To sift through the haystack and find golden, shiny needles. And to keep the children who like to spam in check.

Mod Bombs

A 'mod bomb' is simply when a user, 'A', uses all of their moderation points to 'down mod' comments posted by a single user, 'B'. Would you want someone who has a vendetta to use all of their mod points on your comments? It works both ways -- don't use all of your mod points on a single user. When this is detected, the account performing the moderation ('A') is given a 30-day 'time out' on moderating. We would like to make the code automatically prevent a mod bomb from occurring, but this is not yet in place. The focus is on the quality of the comments on the site, not on who posts them.

Spam Mod

The spam moderation (spam mod) is to be used only on comments that genuinely qualify as spam. Spam is unsolicited advertisement, undesired and offtopic filth, or possibly illegal in general. Spam can come in many forms, but it differs from a troll comment in that it will have absolutely no substance, is completely undesired, are detrimental to the site, or worse.

The spam mod is special in that is removes 10 Karma points from the user that posted the comment. This mod is meant to combat spam and not to be used to punish commenters (when in doubt, don't use this mod). Our goal is to put a spammer in Karma Hell and for them to not be able to get out of it easily. As we do not want this used against non-spamers, we monitor all spam mods to make sure moderators are not abusing the spam mod. If we find a moderator that unfairly applied the spam mod, we remove the mod giving the poster back the Karma points, and the modder is banned from modding for one month. Further bans to the same modder add increasing amounts of ban time. If you inadvertently applied a spam mod, mail the admin and we will remove the spam mod without banning you. Even though we have updated the interface to physically separate the spam mod from the other mods, unintentional modding may still be an unfortunate occurrence.

Examples

If you are unsure of whether a comment is spam or not, don't use the spam mod. Here are some examples of spam:

  • Proper spam. Anything whose primary purpose is advertisement (unless somehow relevant to the discussion/article).
  • HOSTS/GNAA/etc... type posts. Recurring, useless annoyances we're all familiar with.
  • Posts so offtopic and lacking value to even be a troll that they can't be called anything else. See here, here or here for example.

Moderation Issues

If you see moderation abuse (mod bombing or spam mod), please mail the admin any comments (the cid link) showing the abuse. Alternatively, mention it on the main IRC channel. We will investigate and make amends if necessary. Note: in the rare case that someone has contacted us regarding "moderation abuse", we not only find this practice practically non-existent here (yay!), but in fact, comments that are incorrectly modded down get modded back up nearly every time.

FAQ

I just got moderator access, what do I do?

The fact that you are reading this document proves that you are already on the right track.

Why can't I moderate any more?

  • Do you still have any moderator points left?
  • You can't moderate your own posts.

What is a Good Comment? A Bad Comment?

  • Good Comments are insightful. You read them and are better off having read them. They add new information to a discussion. They are clear, hopefully well written, or maybe amusing. These are the gems we're looking for, and they deserve to be promoted. (Score: 2-5)
  • Average Comments might be slightly offtopic, but still might be worth reading. They might be redundant. They might be a 'Me Too' comment. They might say something painfully obvious. They don't detract from the discussion, but they don't necessarily significantly add to it. They are the comments that require the most attention from the moderators, and they also represent the bulk of the comments. (Score: 0-1)
  • Bad Comments are flamebait, incorrect, or have nothing to do with the article. Other examples: Ad Hominem, ridicule for others with different opinion (without backing it up with anything more tangible than strong words), repeats of something said 15 times already (read previous comments before you post), use of unnecessary foul language, some are hard to read or just don't make any sense. Basically they detract from the article they are attached to. (Score: -1)

What is Karma?

Karma is the sum of all moderation activity done to a user. Karma is used to determine eligibility for moderator status and can affect your comments starting score. Every new user starts with a Karma of 0, and as long as your Karma isn't negative you are eligible to become a moderator.

Why Don't I get my points back after I post in a discussion I moderated?

We've decided to allow a moderator to moderate in a discussion, and then comment afterward without undoing their moderation.

How can I improve my Karma?

10 tips for improving your Karma:

Post intelligently:
Interesting, insightful, thought provoking comments are rated higher on a fairly consistent basis.
Post calmly:
Nobody likes a flame war. In fact, more times than not the flamer gets burned much more than their target. "Flamebait" is hit quickly and consistently with "-1" by moderators. As the bumper sticker says... "Don't be a dick."
If you can't be deep, be funny:
If you don't have something to contribute to the discussion, some humor is welcome. Humor is lacking in our lives and will continue to be promoted. Remember though, what rips your sides out may be completely inane to somebody else.
Post early:
If an article has over a certain number of posts on it already, yours is less likely to be moderated. This is less likely both statistically (there are more to choose from) and due to positioning (as a moderator I have to actually find your post way at the end of a long list.)
Post often:
If you only post once a month you can expect your karma to remain low. Also, lively discussion in an open forum is what makes SoylentNews really "Rock the Casbah."
Stay on topic:
Off topic posts are slapped quickly and consistently with "-1" by moderators.
Be original:
Avoid being redundant and just repeating what has already been said. (Did I really just say that?) Yes, being moderated as "redundant" is worth "-1" to your post and your karma. Especially to be avoided are the "what he said" and "me too" posts.
Read it before you post:
Does it say what you really want it to say? Check your own spelling and grammar. Occasionally, a perfectly beneficial post is passed over by moderators because it is completely irrelevant to content feature. This is also a good approach to checking yourself for what you're really saying. Can't tell you the number of times I've stopped myself from saying the opposite of what I meant by checking my own s&g.
Log in as a registered user:
I know, this sounds obvious but, "Anonymous Coward" does not have a karma rating. You can't reap the perceived benefits of your own accidental brilliance if you post anonymously. Have pride in your work and take credit for it.
Read SoylentNews regularly:
You can't possibly contribute to the discussion if you're not in the room. Come to the party and play.