Data Engineer

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Cloudera Data Platform

Good to have skills : NA

Minimum 7.5 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

We are seeking a highly experienced Assistant Manager/Manager with strong expertise in Big Data platforms Management. The ideal candidate will lead the design, development, and operational support of enterprise-scale of HDFS / Ozone.

This role requires deep technical knowledge of Cloudera Hadoop ecosystem and provides solutions, combined with leadership skills to manage engineering teams and collaborate with cross-functional stakeholders.

Job Title: Assistant Manager/Manager – Cloudera Administrator

Roles & Responsibilities:

• Production Support & Incident Management

Manage batch scheduling

Investigate and resolve:

• Application failures
• Query aborts/long running
• Services down
• Lost Nodes
• Memory errors

Perform root cause analysis (RCA) and implement preventive solutions.

Coordinate with application teams for issue resolution.

Participate in on-call rotations and L1/L2 production support.

Ensure adherence to SLAs and operational compliance standards.

• Stakeholder Management

Manage sprint deliverables and engineering tasks using Agile methodologies.

Collaborate with:

• Data architects
• BI developers
• Data scientists
• Data governance teams
• Business stakeholders

Drive automation, operational efficiency, and engineering best practices.

Enforce coding standards, version control, and release management processes.

Professional & Technical Skills:

8+ Years (Minimum 2+ years in Team Lead / Support role)

• Scripting & Automation

Proficiency in Unix/Linux and Shell scripting

• Data Warehousing

Strong understanding of:

• Star Schema
• Snowflake Schema
• Fact and Dimension modeling
• Development lifecycle management
• Preferred Skills

Familiarity with version control tools (Git / SVN).

Experience with Oozie or Cron scheduling.

Exposure to cloud data platforms (AWS / Azure / GCP).

Experience in Banking, Financial Services, or Insurance (BFSI) domain.

Knowledge of data lake architecture and governance frameworks.

• Key Success Metrics (KPIs)

SLA adherence and production stability

Team productivity and quality standards

Additional Information:

• The candidate should have minimum 7.5 years of experience in Cloudera Data Platform.
• This position is based at our Chennai office.
• A 15 years full time education is required.