Sr. Data Engineer

We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will play a pivotal role in optimizing data flow, ensuring scalability, and enabling seamless access to structured/unstructured data across the organization. The ideal candidate will design, build, and optimize scalable data pipelines with strong SQL proficiency and data modeling expertise.

Responsibilities

• Design, develop, and maintain scalable pipelines to process structured and unstructured data.
• Optimize and manage SQL queries for performance and efficiency in large-scale datasets.
• Experience working with data warehouse solutions (e. g., Redshift, BigQuery, Snowflake) for analytics and reporting.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
• Experience in Implementing solutions for streaming data (e. g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.
• Ensure data quality, governance, and security across pipelines and storage systems.
• Document architectures, processes, and workflows for clarity and reproducibility.

Requirements

• 4 or more years of experience in Data Engineering file.
• Expertise in SQL (complex queries, optimization, and database design).
• Write optimized and production-grade SQL scripts for transformations and data validation.
• Solid understanding and hands-on experience in creating data pipelines and patterns.
• Proficiency in any programming languages like Python or R for scripting, automation, and pipeline development.
• Hands-on experience with Google Bigquery and Apache Airflow.
• Experience working on any cloud-based platforms like AWS or GCP or Azure.
• Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).
• Familiarity with cloud-based data warehouses (Redshift, BigQuery, and Snowflake).
• Knowledge of version control systems (e. g., Git) and CI/CD practices.

This job was posted by Kumar Ags from BigThinkCode.