Data Engineer

TMC Middle East is currently engaged in a project with one of our prestigious customers in UAE.

We are seeking a highly capable Data Engineer expert to help TMC to deliver this assignment.

About the Role:

Position: Data Engineer

Location: Abu Dhabi

Experience: 8+ Years

Preferred: UAE Based candidates

Technical Requirements:

Microsoft Fabric & Data Platform

Data Engineering & Pipeline Development

Database & SQL Development

Process Automation & Power Automate

Azure Platform Management

Data Integration & Quality

Microsoft Fabric & Data Platform

• Architect and implement end-to-end analytics solutions using Microsoft Fabric components (Data Factory, Synapse, Power BI, Data Activator)
• Design and manage Lakehouse architectures with OneLake integration
• Develop data pipelines using Fabric Data Factory and orchestrate complex workflows
• Implement real-time analytics using Fabric's streaming capabilities and KQL (Kusto Query Language)
• Configure and optimize Fabric workspaces, capacity management, and cost optimization strategies

Data Engineering & Pipeline Development

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, SSIS, and Microsoft Fabric Data Pipelines
• Build and optimize dimensional data models (star/snowflake schemas) for data warehouses
• Implement slowly changing dimensions (SCD Type 1, 2) and fact table designs following best practices
• Develop incremental load strategies, change data capture, and efficient data refresh processes
• Implement data quality frameworks with automated validation, monitoring, and alerting
• Handle pipeline error logging, recovery mechanisms, and performance optimization

Database & SQL Development

• Write complex SQL queries, stored procedures, functions, and triggers for data extraction and transformation
• Optimize database performance through query tuning, indexing strategies, and execution plan analysis
• Design and implement database schemas across SQL Server, Azure SQL Database, and Synapse Analytics
• Develop and maintain views, materialized views, and database security policies

Process Automation & Power Automate

• Design and implement automated workflows using Power Automate (cloud and desktop flows)
• Create automated data refresh schedules, alert systems, and notification frameworks
• Integrate Power Automate with Power BI, SharePoint, Teams, and other Microsoft 365 services
• Develop RPA (Robotic Process Automation) solutions for repetitive data-related tasks
• Implement error handling, logging, and monitoring for automated processes

Azure Platform Management

• Deploy and manage Azure resources including Storage Accounts, Key Vaults, and Virtual Networks
• Configure and optimize Azure Synapse Analytics workspaces and dedicated SQL pools
• Implement Azure DevOps CI/CD pipelines for automated deployment of BI solutions
• Monitor and optimize Azure resource costs and performance metrics
• Implement disaster recovery and business continuity strategies for critical data assets

Data Integration & Quality

• Connect and integrate data from multiple sources including databases, APIs, files, and cloud services
• Implement secure data transfer protocols and authentication mechanisms
• Monitor data accuracy, completeness, and consistency with automated alerts
• Document data lineage, transformation logic, and business rules

Please share your CV with the title of Data Engineer

Mail ID : [email protected]