Solution Data Engineer Sr.
Indexed description
Must Have Skills:
English advanced
Databricks Ecosystem
o Full management of the Databricks environment
o Environment configuration and workspace administration
Governance & Storage
o Implement data governance using Unity Catalog
o Manage structured storage with Delta Lake tables
Development
o Write and optimize data processing logic using Python, SQL, and PySpark
Version Control
o Manage code lifecycle and collaborative development using Git
o Data Warehousing & Integration (Important)
Important Skills:
Snowflake
o Manage data architecture, performance, and integrations within Snowflake
Adobe Data Ingestion
o Handle Adobe Data Feeds and Adobe Analytics
o Ensure correct ingestion and transformation of external marketing data
Nice to Have:
Redshift
o Oversee data warehousing operations in Amazon Redshift
Orchestration
o Use Airflow to schedule, monitor, and manage complex data pipeline workflows
Desirable:
Google Cloud Platform
o Maintain data availability and basic operations in BigQuery
AWS Data Services
o Manage serverless querying with Athena
o Handle metadata management with AWS Glue
Pipeline Ownership
o Own end to end maintenance of data pipelines
o Ensure reliability from data ingestion through final delivery across multiple cloud platforms
REMOTE
ADVANCED ENGLISH
Originally posted on Himalayas
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search