Have you ever thought about how to store pictures when you upload pictures or change status or even post comments on a friend’s profile? Have you ever imagined the amount of data created by millions of users every day? How to manage?
In fact, since the 1980s, the world ’s technical capacity to store information per person has doubled approximately every 40 months. As of 2012, 250 million bytes (2.5 powers × 10 powers 18) bytes of data were created every day . Due to continuous technological progress, a large amount of data is being generated. Because organizations are still trying and finding ways to maximize the use of data and take advantage of its advantages, large amounts of data are still not used. Forrester Research estimates that less than 5% of the available data is used effectively by organizations. Big data technology is here. It will open new doors and new ways for enterprises. This may be a path for them to become leaders of tomorrow. It can help them analyze the market, understand customers, understand their needs and new business approaches.
Example-Big data usage
* The US Federal Government has collected more than 370,000 original and geospatial data sets from 172 agencies and sub-agency. It uses the data to provide a portal for applications developed by 230 citizens.
* Professional social network LinkedIn uses data from over 100 million users to create new social products based on the user’s own skills.
* Facebook has more than 800 million active users, and more than 900 million objects interact with users (pages, groups, events, and community pages). Facebook users spend more than 700 billion minutes on the site each month, creating an average of 90 pieces of content and sharing 30 billion pieces of content every month. Facebook’s data infrastructure team is responsible for quickly analyzing all data and presenting it to users in the most relevant way.
The latest technological advances enable organizations to take advantage of big data and big data analysis:
As new technologies advance, many factors can help organizations make the most of the power of big data:
* Open source software framework like hadoop for analyzing data
* Use MapReduce-programming model to process large data sets
* Use Google file system
* NoSQL as a database management system
Only in the future can we judge whether big data will become a real big problem. But analysts say it may even be the future.