Big Data

Big Data

Big Data very large data sets that may be analyzed computationally to reveal patterns, trends, and associations, especially relating to human behavior and interactions. It is a word for data sets that are so huge or complex that traditional data processing application software is inadequate to deal with them. Challenges include capture, storage, analysis, data curation, search, sharing, transfer, visualization, querying, and updating and information privacy. This term often refers simply to the use of predictive analytics, consumer deeds analytics, or certain other advanced data analytics method that extract value from data, and seldom to a particular size of data set.

Meaning

Big data means really a big data. It is a collection of huge data sets that cannot be processed via traditional computing techniques. Big data is not merely a data. It has rather become a complete subject, which involves various tools, techniques, and frameworks.

What is Big Data Management

Big data management is the organization, administration, and governance of large volumes of both structured and unstructured data. The objective of big data management is to ensure a high level of data quality and accessibility for business intelligence and big data analytics applications. Corporations, government agencies, and other organizations use big data management strategies to help them contend with fast-growing pools of data.Typically involving many terabytes or even petabytes of information saved in a variety of file formats. Efficient big data management helps companies locate precious information in large sets of unstructured data and semi-structured data from a variety of sources. This includes call detail records, system logs, and social media sites.

Characteristics

• Volume
• Variety
• Velocity
• Variability
• Veracity

What Comes Under Big Data

• Black Box Data:

It is a part of helicopter, airplanes, and jets, etc. It captures voices of the air travel crew, recordings of microphones and earphones, and the performance information of the aircraft.

• Social Media Data:

Social media such as Facebook and Twitter hold data or information and the views posted by millions of people across the globe.

• Stock Exchange Data:

The stock exchange data holds data or information about the ‘buy’ and ‘sell’ decisions made on a share of different companies made by the customers.

• Power Grid Data:

The power grid data holds data or information consumed by an exacting node with respect to a base station.

• Transport Data:

Transport data includes model, capacity, distance and availability of a vehicle.

• Search Engine Data:

Search engines recover lots of data from different databases.

  The data will be of three types:

• Structured data: Relational data.
• Semi-Structured data: XML data.
• Unstructured data: Word, PDF, Text, Media Logs.

List of Companies in India

• IBM
• HP
• EMC
• Teradata
• Oracle
• SAP
• Microsoft
• Amazon Web Services
• VMware
• Google
• Splunk
• MemSQL
• Palantir Technologies
• Trifacta
• Datameer
• Neo Technology
• DataStax
• Info bright
• Fractal Analytics
• Metric Insights
• Informatics
• Syntasa
• Chartio
• Thought works
• Platform
• YarcData
• SiSense
• ZettaSet
• Clearstory Data