Ubuntu QA:
BlogBrainstormPackage status
Log in
Ubuntu QA
The Ubuntu community has contributed 16758 ideas, 103216 comments, 2163394 votes
Idea sandbox Idea sandbox
Popular ideas Popular ideas
Ideas in development Ideas in development
Implemented ideas Implemented ideas
Idea #19679: Brainstorm is not being moderated properly

Written by AndrewLuecke the 7 May 09 at 03:17. Related project: brainstorm.ubuntu.com. Category: Ideas/comments moderation. Status: New
Rationale
Let's be honest:

1) All the dupes are getting approved. The sandbox seems to have exactly 0% impact on this. It seems as though every idea getting approved is a dupe of another
2) Old ideas Brainstorm V1 ideas are conflicting with new ideas. Most aren't being fixed, and the end result is dozens of ideas, which are technically dupes of solutions of well written problems. These aren't getting fixed
3) Solutions/Rationales which don't make sense, are illogical or based on incorrect/unproven information are being approved. Information isn't being checked for accuracy
Tags: (none)

57
votes
up equal down
Solution #1: Filter "old" style ideas from brainstorm
Written by AndrewLuecke the 7 May 09 at 03:17.
If it wasn't clear when I said that the old ideas shouldn't be imported months ago, it certainly is now.

I'd say, move them into their own category "needs revising", and slowly integrate them into brainstorm. As they are added into proper rationales.

They need to be filtered from the rest of brainstorm though, as barely any have been properly rewritten (I posted probably hundreds of old ideas as "Auzy", and I will not be revising them).

This may make brainstorm more manageable and cleaner
49
votes
up equal down
Solution #2: Mods need better training
Written by AndrewLuecke the 7 May 09 at 03:22.
Before a moderator approves an idea it should be:
1) Checked as it is now
2) Checked to identify if it is a dupe (a very large percentage of ideas are not being properly checked, whilst being obvious dupes)
3) Checked for accuracy. All mods should test the problem themselves to identify if it exists in cases where appropriate. None seem to be..
57
votes
up equal down
Solution #3: Sandbox should allow negative votes
Written by AndrewLuecke the 7 May 09 at 03:28.
It seems idea reviewers who don't think an idea should be approved can only rate 0, but they should be able to vote as -1.

Ideas at -2 in the sandbox (with at least 2 mods disapproving it for various reasons), should be automatically rejected. This prevents ideas sitting in the sandbox for weeks until it inevitably gets accidentally approved.
26
votes
up equal down
Solution #4: All problems should be tested before approval
Written by AndrewLuecke the 7 May 09 at 03:34.
Problems which are actually non-existant are getting approved. In fact, ideas and solutions are getting approved that make a claim, yet have no evidence attached.

I could pretty much post an idea that claims that compiz consumes a large amount of GPU, and it would get approved, without ever provided any proof.

Therefore, it should be required to test all problems before approval, and ideas which aren't obvious and are lacking evidence should require more evidence first.
55
votes
up equal down
Solution #5: Different problems can have the same solution
Written by AndrewLuecke the 7 May 09 at 03:52.
Whilst multiple problems can possess the same solution, there is no way to represent this on Brainstorm. So people end up voting 15x for the same solution, over 15 different problems. The votes aren't collated, so none stand out.

We need a way to link solutions to one another and merge the votes, when they are the same solution, so that solutions can stand out, and users aren't voting twice for the same idea.

An example that demonstrates this is the following problems:
- Users have difficulty determining which driver to install from the repos, as their don't know their chipset
- Drivers are too difficult to install

The solution for both may be:
- Maintain a driver repository which can install valid drivers for your specific hardware automagically.

This will help make brainstorm infinitely more usable, and more useful to developers.
39
votes
up equal down
Solution #6: We need more moderators.
Written by Darwin Survivor the 7 May 09 at 17:59.
If we implement negative voting, more moderators should be added so that moderators have more time to properly review each submission.

I think part of the problem is that there are WAY more suggestions than there are mods, so instead of each suggestion getting a good 2-4 minutes of checking (especially for duplicates), the mods only have time to check if it is marginally feasible and completely outlandish.
11
votes
up equal down
Solution #7: Solutions should pass quality standards before approval.
Written by lavinog the 2 Jun 09 at 06:33.
Ideas and solutions should be considered professional proposals.
If a user doesn't want to take the time to clearly present their idea or solution, then the idea must not be that important to them.
Ideas should be written without focus on personal opinions.
Ideas should use proper capitalization, and punctuation so that they can be read clearly.
They should avoid slang, slander, or signs of personal frustration.
Moderators can make small corrections to ideas, but the responsibility should fall on the poster.
A moderator should leave a comment if the quality is in question, and leave it up to the poster to correct any issues.
If the poster does not work to comply with the standards, then the idea will not be approved.

6
votes
up equal down
Solution #8: Anti duplicate rules are way too strictly enforced
Written by vexorian the 2 Jun 09 at 15:16.
Unlike what most people seem to think the intended use for marking something as duplicate is not to stop every single new idea from ever getting added. It is to stop an idea that was already made before from getting added.

It seems right now that mods are doing some very rushed pattern matching before deciding whether something is a duplicate or not:
Wrong way to enforce the duplicate rule:
There is already an idea ("Add a bicycle icon to pidgin emoticons") that contains the words "cycle" and "icon" therefore the idea ["A new install ubuntu icon for each release cycle"] is a duplicate.

Right way to enforce the duplicate rule:
Idea A and idea B mean almost exactly the same, therefore B is a duplicate.


Propose your solution

Attachments
No attachments.


Duplicates


Comments
eierdieb wrote on the 7 May 09 at 20:54
I think its not just a moderating problem - it is more the structure of brainstorm that should be reformed.

AndrewLuecke wrote on the 8 May 09 at 03:35
@eierdieb: Hence Solution #5 and solution #3.

Without negative sandbox votes, if you have 20 mods, and the votes have nowhere to go but up, every idea gets approved eventually. (Its common sense)


Furthermore, I don't think there is a severe lack of mods. The reality is only a handful of problems get posted a day (maybe 10). Even if there are only 10 mods, mods only need to test 2 a day. I have made thousands of comments, and posted probably a hundred solutions by now, and brainstorm is only a year old.

So its certainly doable.. If a brainstorm user can accomplish that, then the mods certainly can

mydoghasworms wrote on the 8 May 09 at 15:25
I propose idea #19508 (which, if you compare to this, proves itself :-)

mydoghasworms wrote on the 8 May 09 at 15:26
... as many ideas go in very similar directions.

mydoghasworms wrote on the 8 May 09 at 15:27
... and that goes for the solutions too. (Sorry, I should think through what I'm saying before posting comments).

lavinog wrote on the 30 May 09 at 16:06
+1 for #1

I cannot vote for #2 since I don't know how mods are currently trained. Looking for dupes is not always a trivial task. Checking for accuracy shouldn't be needed if the ideas are not bug reports.

#3 makes sense +1

Although I agree with #4, I think it only applies to bug reports, and ideas as such should be considered invalid.

I agree with #5, but small differences between similar solutions can cause problems if votes are linked. A better solution would be to move those solutions to a centralized idea, and have the original solution point to that idea.

#6: Too many moderators can be a problem too. Consistency between moderators is important. Adding more moderators reduces the consistency

AndrewLuecke wrote on the 31 May 09 at 05:08
@lavinog.. The problem is more that they aren't even looking for dupes... I have been here since early brainstorm days, and many of the ideas getting approved are OBVIOUS dupes, and should be even to people who haven't been here long. In fact, some obvious dupes that are approved were posted a few days beforehand.

lavinog wrote on the 31 May 09 at 15:15
@AndrewLuecke: ok, I see what you are saying about dupes, what about checking for accuracy? I don't see how ideas can be checked for accuracy. Can you give an example?

AndrewLuecke wrote on the 2 Jun 09 at 03:32
Lavinog:

I mean, many ideas which are posted state incorrect facts, totally not feasible, or make assumptions which are completely incorrect.

http://brainstorm.ubuntu.com/idea/11045/ : Solution #1
100 people voted. Its obviously not plausible because it takes 30 secs to see the entire thing was written for windows.


http://brainstorm.ubuntu.com/idea/19817/ :
Nobody has actually confirmed that OO doesn't support SVG.


http://brainstorm.ubuntu.com/idea/19954/
Assumptions are being made all over. Furthermore, there is no benchmarks performed.


There are much more being made too..


Post your comment