Back to search
Unison Group Linkedin · Posted 3mo ago

Bigdata Developer

India

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

  • Big data production support Role :-
  • Client - IBM/DBS
  • Mode of work - 24/7 Rotational shift (WFO)
  • Experience - 4-6 years
  • Location - Hyderabad
  • N.P - Immediate - 15days
  • Required skills:- Spark, Scala, Hive, Hadoop, SQL, Unix
  • Mode of interview F2F
    • Spark,
    • Scala,
    • Hive,
    • Hadoop,
    • SQL,
    • Unix

Requirements

Job Summary

We are looking for a Big Data Support Engineer with hands-on experience in Hadoop ecosystem technologies to provide production support, monitoring, troubleshooting, and performance optimization of Big Data platforms. The candidate should possess strong analytical and problem-solving skills and be comfortable working in a support environment.

Key Responsibilities

  • Provide L2/L3 support for Big Data applications and Hadoop clusters.
  • Monitor platform health, analyze logs, and proactively identify issues.
  • Troubleshoot production incidents and perform root cause analysis (RCA).
  • Support Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, Kafka, Oozie, and Sqoop.
  • Manage job failures, performance bottlenecks, and data pipeline issues.
  • Work closely with development and infrastructure teams during deployments and releases.
  • Perform cluster maintenance, upgrades, patching, and capacity planning.
  • Create and maintain operational documentation, runbooks, and SOPs.
  • Participate in on-call support and incident management activities.
  • Ensure SLA compliance and timely resolution of support tickets.

Required Skills

  • Strong experience with Hadoop ecosystem (HDFS, Hive, Spark, YARN).
  • Good knowledge of Kafka, Sqoop, Oozie, Flume, or NiFi.
  • Hands-on experience with Linux/Unix administration.
  • Strong SQL and data analysis skills.
  • Shell scripting (Bash) and/or Python scripting.
  • Experience with log analysis and monitoring tools.
  • Knowledge of Cloudera CDP/CDH or Hortonworks platforms.
  • Understanding of incident, problem, and change management processes.
  • Excellent troubleshooting and communication skills.

Good to Have

  • Experience with Kubernetes/OpenShift.
  • Knowledge of Airflow, Data Engineering concepts, and ETL pipelines.
  • Exposure to cloud platforms (AWS, Azure, GCP).
  • Banking or Financial Services domain experience.
  • Git and CI/CD knowledge.

Mandatory Skills

Hadoop, HDFS, Hive, Spark, Kafka, Linux, SQL, Shell Scripting, Python, Production Support, RCA, Cloudera/CDP, Incident Management.

Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search