Using big data and creativity for Social Good

Posted on July 12, 2013 at 7:43 pm

Google just announced its plans to enlist big data in the fight against human trafficking. The search giant will work with three advocacy groups to collect and analyze data from human trafficking hotlines.

The work is aimed to stifle human trafficking by bringing about a shared data platform for anti-trafficking groups. By using big data, advocacy groups can identify trafficking hotspots and create stronger strategies to put an end to traffickers.

Google’s work in the field is an illuminating reminder of the types of projects big data can take on. Big data doesn’t have to be used just to create the perfect targeted ad or discover the biggest IT bottleneck.

Big data can also be used to solve a variety of the world’s ills. The potential big data holds for the greater good can’t be underestimated. From being able to project future crime sprees to solving big city traffic jams, big data holds the key to fighting a variety of societal troubles.

That is one of the reasons why the lack of qualified big data analysts is so troubling. We can have all the data in the world but if we don’t have qualified analysts it won’t mean anything.

Knowledgeable and creative big data scientist will be crucial if the industry ever hopes to create some sort of major social change. The world will need scientists who not only know what they are doing technically, but also have the creativity needed to use data in unique ways.

Last year, Oracle president Mark Hurd made the comment that most big data is “worthless”. According to Hurd, 99.9 percent of big data is unusable.

His assessment may hold weight in the sense that most data will not help a business improve its infrastructure. However, the idea that most big data is useless in the greater context of society is off base.

To truly use data to uncover societal truths we need imaginative analysts, who can take seemingly benign data and transform it into real-world solutions.

It’s already being done to some extent. Analysts are already finding data links between things like home census data and food shortages or telecommunications and natural disasters.

By now it’s become a cliché to say the world needs more Steve Jobs, but it’s the truth. Steve Jobs (and the many pioneers of the computing age) took the technology of their time and brought a sense of creative thinking to it.

We need a generation of Steve Jobs. The technology exists to such a point that creative thinking can change the world. Tech like big data can be used to revolutionize how we think about the world’s problems.

With creativity and know-how a data analyst can do amazing things. Not just in business, but also for society as a whole.

Now, it’s up to clever people to take up an interest in the field. To do that people will need equal parts ingenuity and opportunity. They’ll need the opportunity to learn and discover the power of the trade. They’ll also need to understand big data is more than just statistics.

11 Apr 2013

Posted in Cloud Hosting