ETL Developer
Indexed description
We are seeking a highly experienced and strategic ETL Developer with 5+ years of data engineering experience to join our growing data warehousing team.
Key Responsibilities
1. ETL Architecture & Pipeline Development
- Design, build, and maintain complex end-to-end ETL mappings, workflows, and sessions using Informatica PowerCenter.
- Develop, optimize, and schedule Python automation scripts for data ingestion, processing, custom transformations, and system monitoring.
- Architect and scale data integration pipelines within the Hadoop ecosystem (Hive, HDFS, Spark, or MapReduce) to handle massive datasets.
2. Performance Tuning & Optimization
- Analyze and tune long-running Informatica workflows, complex SQL overrides, memory allocations, and session bottlenecks.
- Implement performance tuning strategies in relational databases (especially Teradata macro/stored procedures, volatile tables, primary indexes, and join strategies).
- Optimize big data storage formats and execution engine resources within Hadoop to maximize throughput.
Required Skills & Qualifications
Technical Requirements
- ETL Expertise: 5+ years of core, hands-on experience with Informatica PowerCenter (including advanced transformations, XML parsing, and SQ overrides).
- Programming: Strong proficiency in Python for data engineering tasks, alongside advanced shell scripting (Unix/Linux) and SQL is a must.
- Big Data Ecosystem: 3+ years of experience working with Hadoop platforms (HDFS, Hive, Impala, Sqoop).
- Relational Databases: Advanced SQL skills. Teradata expertise (including BTEQ, FastLoad, MultiLoad, TPT, and Volatile Tables) is an added advantage.
Experience & Education
- Total Experience: Strictly 5+ years in Data Engineering, Data Warehousing, or ETL Development.
- Domain Knowledge: Prior experience in the Telecom Domain is highly preferred / good to have.
- Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search