Senior Associate Data Engineer

Senior Associate Data Engineer

We are seeking a Senior Associate Data Engineer to design, develop, and optimize scalable data engineering solutions. The ideal candidate will have strong experience with Big Data technologies, data ingestion and transformation, real-time pipelines, cloud platforms, and distributed data processing. This role will work closely with stakeholders to translate business requirements into robust technical solutions.

Responsibilities

• Design and implement scalable data ingestion, integration, and transformation pipelines.
• Build batch and real-time data pipelines using distributed data processing and messaging technologies.
• Develop solutions for data analytics, search, aggregation, and large-scale data processing.
• Work with cloud-based data platforms and services, primarily AWS.
• Optimize data pipelines and applications for performance, reliability, and scalability.
• Work with NoSQL, MPP, and relational database technologies.
• Participate in technical design discussions and independently drive data engineering solutions.
• Apply data governance, security, lineage, and cataloging best practices where applicable.

Qualifications

• 5.5+ years of overall experience, including 4+ years working with Big Data technologies.
• Strong hands-on experience with Hadoop ecosystem technologies such as Spark, Kafka, Hive, NiFi, Airflow, Flink, or similar tools.
• Experience building both batch and real-time data pipelines.
• Strong programming skills in Java, Scala, or Python, with Java preferred.
• Experience with NoSQL and MPP platforms such as HBase, MongoDB, Cassandra, Redshift, Azure SQL DW, or BigQuery.
• Hands-on experience with AWS data and cloud services.
• Experience with relational databases such as Oracle, MySQL, SQL Server, or PostgreSQL.
• Understanding of ETL tools, data governance, distributed messaging, and data platform architectures.
• Strong knowledge of data pipeline performance tuning and optimization.
• Bachelor’s degree or equivalent combination of education and experience.