When Crowdsourcing Doesn’t Work

Written by Keith Rozario

Mar 25, 2013

Crowdsourcing is a great tool for solving problems, but just like any other tool–it doesn’t solve everything. As the saying goes, when all you’ve got is a hammer everything starts to look like a nail.

Crowdsourcing will never be the one-all solve-all tool for problem solving, and while it’s growing popularity validates its efficacy, the reality is that there will always be problems that cannot be solved by crowdsourcing–or any other method for that matter.

Take for instance, this ‘wisdom of the crowds’ video from youtube that asked the crowd to predict the final position of a roulette ball in mid-flight, it follows in the footsteps of other popular wisdom of crowds video that have the crowd perform far simpler predictions like guessing the weight of the cow, or guessing the number of jellybeans in a jar. Of course trying to predict something static like the weight of a cow is far less complex than trying to predict the trajectory of a silver ball while it spins around a roulette wheel, in fact there’s so much chaos in the system–it would probably could not be solved by crowdsourcing or any other method.

The result from the video was a disappointment of sorts, the crowd not only couldn’t accurately predict where the ball would land–the average answer was actually as far away from the actual result as it possibly could be. In other words, crowdsourcing couldn’t be more wrong. This flies in the face of the previous results where the crowd manage to successfully predict the number of jelly beans in a jar to a remarkable degree of accuracy, could this be the proof that crowdsourcing was nothing but a fad that could predict Jelly beans, but starts to lose its efficacy the moment you try to do anything even remotely more complex, of could it be something else?

The fact remains, that crowdsourcing isn’t going to be be able to solve the unsolvable, we can’t crowdsource the next powerball numbers or the next lottery winner. While we may be able to crowdsource football results (to just slightly better than guessing) we’ll probably never be able to use crowdsourcing to predict the weather. A random and chaotic environment is unpredictable by definition, and the fact that it can’t be predicted is in no way indicative of the efficacy of any predictive method you use. We could perform statistical analysis on the lottery results and try to predict the next result–but that would fail for obvious reasons–and the fact that it would fail doesn’t mean that statistical analysis is a flawed method, it just means that the problem wasn’t solvable in the first place.

To me, the fact that the wisdom of crowds didn’t accurately predict the where the roulette ball landed isn’t surprising, what would be surprising is that we’ve somehow found a way to predict a system that chaotic, that would be something to really get excited about.

Anyone who tells you that crowdsourcing is the future of problem solving is going to gain popularity in the future is merely stating the obvious, anyone you tells you that crowdsourcing is the future of problem solving is merely an optimist, but anyone that tells you crowdsourcing will be able to solve any problem we come across–well let’s just say I’ve seen snake oil salesmen who’ve had more substance to their message than that.

The bottom line is that while we’ve seen crowdsourcing used to find Gold in Canada, build a great operating system or to simply predict the number of jelly beans in a jar,there will undoubtedly be realms where it would remain impractical or even impossible for it to be used, and that’s fine. As long as you’ve got a hammer–that’s still better than having no hammer at all.

Bold Awards Early Birds
About Author

About Author

Keith Rozario

Keith Rozario is a Malaysian tech evangelist with a focus on cloud computing, crowdsourcing and copyright from a Malaysian perspective.

You may also like

Earn From Your Smartphone In The Crowd Economy

Earn From Your Smartphone In The Crowd Economy

The gig economy continues to provide new opportunities for people to earn money, either from what can become a fulltime occupation, or a number of side hustles, from what they already own. One is an opportunity from Mode Mobile to earn money from your smartphone. Mode...

How To Connect Social Media Influencers With Brands That Fit

How To Connect Social Media Influencers With Brands That Fit

Influencer marketing is a hot topic. How big do you think the creator economy is? In 2023, an estimated $1.25 trillion will change hands through Social Commerce, and social media influencers will help sell products worth billions of dollars online. Influencer...

How Can Crowdsourced Data Annotation Help With Data Structures?

How Can Crowdsourced Data Annotation Help With Data Structures?

Data structures are essential for organizing and representing data in a way that allows for efficient storage, retrieval, and processing. Data annotation can be immensely helpful in various aspects of data structures, especially when dealing with large datasets that...

Speak Your Mind


Submit a Comment

Your email address will not be published. Required fields are marked *

Time limit is exhausted. Please reload CAPTCHA.

Join Our Global Community

You have Successfully Subscribed!