Senior Data Engineer
Indexed description
The three principles, or what we call as 3DNAs became the foundation and sets the guideline for the Magician belief system: Everyone is an owner, Growth Mindset, and A Will to Win.
Description
- Are you passionate about turning raw data into actionable insights? We're seeking a Senior Data Engineer to join our innovative team
Impact Driven: We are driven to create products that not only focus on user experience but also make a social impact as a bigger purpose.
Craftsmanship: To us, building a product is an art. We carefully craft every detail of it and ensure we have a strong sense of ownership.
Pushing Boundaries: Comfort zone is not a place we want to stay in. We keep innovating to keep our minds sharp.
Responsibilities
- Design and implement scalable data pipelines
- Optimize data storage and retrieval systems
- Collaborate with analytics and software engineer team
- Proficiency in Python and SQL
- Proficiency in Terraform, Jenkins, ArgoCD, and GitHub Actions for CI/CD
- Proficiency in Apache Spark and Airflow for Pipeline
- Proficiency in Kubernetes, Kafka, and Pub/Sub for Infrastructure
- Proficiency in PostgreSQL and MySQL for Databases
- Proficiency in Github for Version Control
- Proficiency in GCP for Cloud Environment
- Familiarity with ML/AI workflows
- Strong understanding of data modeling and ETL processes
- Familiarity with data warehousing solutions (e.g., Bigquery, Snowflake, Redshift)
- Proficiency in Java and Go
- 5+ years experience in data engineering
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search