How do you know these ratings aren’t rigged?

May 4, 2007 in restohof by The Hof

This is the question I hear most often when I show someone the site, and the one that I spend the most time thinking about.

If the site is driven by ratings submitted by surfers, how do I know that a single surfer with an axe to grind, or a job to sell, isn’t going to skew the ratings?

Well, first off, one user gets only one chance to rate a job. They can’t grudge something 100 times.

Secondly, each user needs to verify their profile through a real email account.

This is a very mild barrier to entry, I admit. So someone who’s determined enough could create 100 accounts with 100 real email addresses and log in and out 100 times to grudge a job 100 times?

Not quite.

While the site may look simple, there’s a lot happening in the programming behind the scenes to prevent someone from doing this. And I’m keeping an eye on how the site is used so I can keep one step ahead of any determined faker.

Also, a brand-new user doesn’t have the same weight as a more established user. Again, this is built into the programming of the system so that it can recognize a member of the community as opposed to someone trying to “game” the system. And again, this programming is constantly being tweaked.

The whole idea is to build a site that rewards legitimate participation of its members and create a strong online ESL community, while weeding out the scammers.

Will it work? It should. If it doesn’t I will change it.
I didn’t invent these ideas myself, I learned them from studying social software.

But seeing how these ideas are still new and this technology untried, anything could happen. It’s still very cutting-edge.

Should be interesting to watch.