Data Engineer
Indexed description
Requirements
ROLES AND RESPONSIBILITIES
- Design, build, and maintain scalable batch and streaming data pipelines (ETL/ELT).
- Model and structure data in warehouses and lakehouses to support reporting and analytics use cases.
- Integrate data from a wide range of sources: databases, APIs, third-party platforms, and event streams.
- Ensure data quality, reliability, and observability through testing, monitoring, and alerting.
- Optimize pipeline and query performance and manage cost and scalability of data systems.
- Implement and enforce data governance, security, and access-control best practices.
- Collaborate with analysts, data scientists, and software engineers to understand requirements and deliver usable data products.
- Document data flows, schemas, and processes to keep the platform maintainable.
- Perform all other duties as assigned.
The above list reflects the general details necessary to describe the principle and essential functions of the position and shall not be construed as the only duties that may be assigned for the position.
Minimum Qualifications And Requirements
Experience / Training: 3+ years of experience in data engineering or a closely related role. Strong proficiency in SQL and some programming knowledge, preferably .NET and Python. Solid understanding of data modeling, dimensional modeling, warehousing concepts, and distributed data systems. Strong problem-solving skills and attention to data quality and correctness.
Licenses / Certifications: None required
Technology / Equipment: Hands-on experience with a cloud data warehouse and/or lakehouse platform. Experience building pipelines with orchestration tools (e.g., Airflow, Dagster, or dbt for transformations). Familiarity with a major cloud provider, preferably Azure.
Preferred Qualifications And Requirements
Experience / Training: Exposure to data governance, lineage, or catalog tools. Experience supporting machine learning or analytics teams in production.
Licenses / Certifications: None specified
Technology / Equipment: Infrastructure-as-code and CI/CD experience (Terraform, Docker, Git-based workflows). Azure resource implementation with a working understanding of networking and security fundamentals, including virtual networks, private endpoints, firewall and IP rules, and managed identities. Experience with Microsoft Fabric and OneLake.
PHYSICAL AND MENTAL DEMANDS
While performing the duties of this job, the employee must be able to continuously sit, use a keyboard, calculator, and telephone. The employee is occasionally required to stand, walk, stoop, and/or kneel. The employee must occasionally lift and/or move up to 10 pounds while moving files or small packages. Specific vision abilities required by this job include close vision and the ability to adjust focus. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
The mental and physical requirements described here are representative of those that must be met by an individual to successfully perform the essential functions of this position.
WORK ENVIRONMENT
Work is performed in an office environment, with hybrid/remote flexibility available for the ideal candidate. The noise level in the work environment is usually moderate. The work environment characteristics described here are representative of those an individual encounters while performing the essential functions of this position.
The work environment characteristics described here are representative of those an individual encounters while performing the essential functions of this position.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search