Jobs – Big data and Analytics

A search on Naukri with key words Hadoop + analytics / Big data + analytics gave me some interesting insights into the type of jobs that are currently floating in the Indian market.

My take-away is as follows :-

1. Job Description: – this is very brief . Eg:-

• • Design and Implementation of Big data utilities for Business Analytics
  • Data mining and Explorative analytics for various Industry Benchmark Reports

2. Competency Required :- contains terms of technology understanding , logical thinking and ability to solve unstructured problems

3. Desirable Skill Sets :-

• • Good understanding of Business Metrics and parameters.
  • Ability to apply right statistical tools to business case
  • Technical – Apache Hadoop, Pig, hive, big data
  • Domain Exp MANDATORY

4. Pay – Best in the industry – often 1.5 times that in pure play analytics or Hadoop

5. Experience – 4+ years’

6. Employer – Top MNC

Terms that crop up include

• Identify pilot opportunities
• Drive early development
• Build reference architecture and blue prints
• Network extensively with the ecosystem, lead and participate in conferences and workshops, and establish thought leadership

So what is big data analytics? As a domain, it is very new and encompasses ETL, data visualisation and Statistical analytics on ‘big data’. Big data is data which is larger than ‘normal’, contains structured and unstructured elements (tables, videos, images, text) and is coming in at a very high rate (internet, sensors, ERP data on transactions etc.).

What would a company need in a Big Data Analytics expert? A confident, tech friendly, ‘early adopter’ who is willing to look at amalgamating understanding on big data with skills from analytics. This person will have the opportunity to emerge as a SME (subject matter expert) who will guide a team of Hadoop engineers and Data Analysts to create value from the data that is available to the company.

For such a candidate, remuneration is no bar and the industry is willing to pay handsomely.

Some data types are particularly ripe for analysis, such as:

• Surveillance footage. Typically, generic metadata (date, time, location, etc.) is automatically attached to a video file. However, as IP cameras continue to proliferate, there is greater opportunity to embed more intelligence into the camera (on the edge) so that footage can be captured, analyzed, and tagged in real time. This type of tagging can expedite crime investigations, enhance retail analytics for consumer traffic patterns, and, of course, improve military intelligence as videos from drones across multiple geographies are compared for pattern correlations, crowd emergence and response, or measuring the effectiveness of counterinsurgency.
• Embedded and medical devices. In the future, sensors of all types (including those that may be implanted into the body) will capture vital and non-vital biometrics, track medicine effectiveness, correlate bodily activity with health, monitor potential outbreaks of viruses, etc. — all in real time.
• Entertainment and social media. Trends based on crowds or massive groups of individuals can be a great source of Big Data to help bring to market the “next big thing,” help pick winners and losers in the stock market, and yes, even predict the outcome of elections — all based on information users freely publish through social outlets.
• Consumer images. We say a lot about ourselves when we post pictures of ourselves or our families or friends. A picture used to be worth a thousand words, but the advent of Big Data has introduced a significant multiplier. The key will be the introduction of sophisticated tagging algorithms that can analyze images either in real time when pictures are taken or uploaded or en masse after they are aggregated from various Web sites.

(Refer – https://www.emc.com/leadership/digital-universe/iview/big-data-2020.htm)

 Source: IDC’s Digital Universe Study, sponsored by EMC, December 2012

The largest chunks of big data are available in USA , Western Europe .

Source: IDC’s Digital Universe Study, sponsored by EMC, December 2012

India will emerge as a low cost and high skill destination for big data management and storage. The boom in jobs in Big Data Analytics is just around the corner.

For all of you out there who are making the shift to this new world of big data analytics – bon voyage !!

From 2002 onwards, Subhashini has a decade of experience across roles in Analytics in Retail Finance and Banking. These roles have been across Risk Management , Collections strategy , Fraud Control and Marketing in  GE Money, Standard Chartered Bank, Tata Motors Finance and Citi GDM . Her area of interest is the integration of results / outputs of Analytics with Business Decisions – Tactics and strategy.

She is currently active in the Analytics Training and Consulting arena.

(Link to LinkedIn profile – https://in.linkedin.com/pub/subhashini-s-tripathi/3/405/77b )

WRITTEN BY CloudThat

CloudThat is a leading provider of cloud training and consulting services, empowering individuals and organizations to leverage the full potential of cloud computing. With a commitment to delivering cutting-edge expertise, CloudThat equips professionals with the skills needed to thrive in the digital era.