Data Engineer
Indexed description
platforms. This role focuses on building scalable, efficient, and secure data solutions using modern cloud
technologies. The engineer collaborates with analytics, BI, and business teams to transform requirements into
reliable data assets that support reporting, analytics, and operational needs.
Responsibilities
Data Engineering & Pipeline Development
- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, Foundry, and
- Build and optimize data ingestion, transformation, and integration processes across structured and
- Develop and support data lakes, lakehouses, and data warehouse environments using MSSQL and cloud-
- Implement ETL/ELT best practices to ensure performance, reliability, and data quality.
- Automate data workflows and monitor pipeline health; identify and resolve issues promptly.
- Work closely with analytics, BI, and business teams to understand data requirements and translate them
- Partner with cross-functional teams to support data-driven initiatives and ensure pipelines align with
- Contribute to documentation of data structures, transformation logic, and system dependencies.
- Contribute to evaluating and adopting new tools, frameworks, and technologies that enhance data
- Follow standards for code quality, testing, version control, and documentation.
- Apply data governance, quality, and reliability principles in daily engineering work.
- Build reusable data models and curated datasets to enable self-service analytics.
- Ensure downstream BI teams receive accurate, well-structured, and timely data.
- Transform business requirements into scalable and maintainable technical designs.
- Ensure data engineering solutions align with privacy regulations such as GDPR and HIPAA, as well as internal security requirements.
- Maintain proper data access controls and contribute to monitoring data quality and compliance metrics.
- 5–7 years of experience in data engineering, ETL/ELT development, or cloud data platforms.
- Hands-on experience with Azure Data Factory, Databricks, Microsoft Fabric, and MSSQL.
- Strong knowledge of data lake, lakehouse, and data warehouse architectures.
- Solid understanding of ETL/ELT processes, data modeling, and metadata management.
- Proficiency in SQL and Python; familiarity with cloud platforms and big data technologies.
- Ability to diagnose data issues, optimize performance, and work with cross-functional technical and
Preferred Certifications
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Certified Data Engineer
- Certifications related to data governance, risk, or compliance
- Master’s degree in Computer Science, Information Systems, or related fields
We are an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other status protected by law.
Min
USD $107,000.00/year
Max
USD $143,000.00/year
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search