Data Engineer / BI & ETL Developer
Indexed description
Core Responsibilities:
- Design, develop, test, deploy, and maintain robust ETL/ELT pipelines that ingest and transform structured and unstructured data from multiple internal and external sources.
- Build, enhance, and optimize data warehouses, data lakes, data marts, and analytical data models using dimensional modeling and appropriate architecture patterns.
- Develop and maintain BI dashboards, reports, semantic models, KPIs, and visualizations that support operational monitoring, management reporting, and strategic analysis.
- Write, review, and optimize complex SQL queries, stored procedures, data transformations, and database objects to achieve reliable and efficient processing.
- Implement automated data validation, reconciliation, quality checks, exception handling, logging, monitoring, and alerting across data workflows.
- Ensure data accuracy, completeness, consistency, lineage, security, performance, availability, and scalability in accordance with organizational standards.
- Monitor, troubleshoot, tune, and resolve failures or performance bottlenecks in pipelines, databases, data models, reports, and BI platforms.
- Work with business stakeholders to elicit, analyze, document, and translate reporting and analytics requirements into practical technical solutions.
- Collaborate with data architects, database administrators, analysts, application teams, information-security teams, and vendors to integrate and deliver data products.
- Apply source control, release management, CI/CD, testing, documentation, and change-management practices to data engineering and BI deliverables.
- Prepare and maintain technical documentation, including source-to-target mappings, data dictionaries, architecture diagrams, operating procedures, and support guides.
- Support data governance, metadata management, access control, privacy, retention, audit, and compliance requirements.
Experience:
- Minimum 5 years of relevant professional experience in data engineering, BI development, ELT/ETL development, analytics engineering, or a closely related role.
- At least 3 years of hands-on experience designing and supporting production ETL/ELT pipelines and analytical data models.
- At least 3 years of hands-on experience developing enterprise BI dashboards and reports using Power BI or an equivalent platform.
- Demonstrated experience with advanced SQL, query optimization, data warehousing, dimensional modeling, and integration of multiple data sources.
- Practical experience implementing data-quality controls, monitoring, troubleshooting, performance tuning, and production support.
- Experience working directly with business stakeholders to define KPIs, reporting requirements, acceptance criteria, and data solutions.
- Experience with Microsoft Azure data services and the Microsoft BI ecosystem is strongly preferred.
- Experience in government or another regulated environment, including data governance and information-security requirements, is preferred.
Technical Competencies:
- Advanced SQL and relational database development.
- ETL/ELT design, orchestration, scheduling, dependency management, and error handling.
- Data warehousing, data lakes, data marts, dimensional modeling, and semantic modeling.
- Power BI development, including data modeling, DAX, Power Query, dashboard design, row-level security, and performance optimization.
- Microsoft data technologies such as Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, SQL Server, or equivalent platforms.
- Working knowledge of Python or another data-processing language.
- Source control and deployment practices using Git and CI/CD tooling.
Education:
- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Software Engineering, Computer Engineering, Business Intelligence, Data Analytics, or a closely related discipline.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search