Data Engineer
Indexed description
Experience: 10+ Years
Job Description
We are seeking an experienced Data Engineer with 10+ years of experience in designing, developing, and maintaining scalable data solutions. The ideal candidate will have strong expertise in data architecture, ETL/ELT processes, cloud platforms, and big data technologies. This role requires close collaboration with business stakeholders, data analysts, and engineering teams to deliver high-quality data products and insights.
Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL/ELT processes.
- Develop and optimize data models, data warehouses, and data lakes.
- Work with structured and unstructured data from multiple sources.
- Implement data integration solutions to support business intelligence and analytics.
- Ensure data quality, governance, security, and compliance standards are met.
- Monitor and optimize database performance and data processing workflows.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Develop and maintain documentation for data architecture, processes, and workflows.
- Troubleshoot and resolve data-related issues in production environments.
- Mentor junior engineers and contribute to best practices within the data engineering team.
- 10+ years of experience in Data Engineering, Data Warehousing, or related fields.
- Strong proficiency in SQL and database technologies such as SQL Server, Oracle, PostgreSQL, or Snowflake.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Hands-on experience with ETL/ELT tools and frameworks.
- Strong programming skills in Python, Scala, Java, or Spark.
- Experience with big data technologies such as Apache Spark, Hadoop, Kafka, or Databricks.
- Knowledge of data modeling, dimensional modeling, and data warehousing concepts.
- Experience with workflow orchestration tools such as Airflow.
- Understanding of CI/CD, DevOps, and data governance principles.
- Excellent problem-solving, communication, and stakeholder management skills.
- Experience with Snowflake, Databricks, Redshift, or BigQuery.
- Experience working in Agile/Scrum environments.
- Cloud certifications (AWS, Azure, or Google Cloud Platform) are a plus.
- Experience with real-time data streaming and event-driven architectures.
- Bachelor''s or Master''s degree in Computer Science, Information Technology, Engineering, or a related field.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search