Data Engineer
Indexed description
Want to learn more about life at Egen? Check out these resources in addition to the job description.
- > Meet Egen
- > Life at Egen
- > Culture and Values at Egen
- > Career Development at Egen
About the job:
- Design, develop, and deploy large scale data processing pipelines, both batch and streaming, using technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub
- Expertise with multiple data storage technologies such as Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres
- Work with stakeholders to understand business problems, develop use-cases, and translate them into pragmatic and effective technical solutions
- Design and develop appropriate schema for data based on understanding of the domain problem
- Manage data lineage and ensure data security with appropriate tools and methodologies
- Collaborate with data scientists, architects, and other stakeholders to ensure alignment between technical and business strategy
- Continuously monitor, refine and report on the performance of data management systems
- Mentor junior data engineers, reviewing their outputs and directing their professional development
- 2 - 4 years of experience in data engineering, particularly in designing and developing data pipelines
- Proven expertise with technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub
- Experience with various data storage technologies including Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres
- Ability to design data schemas based on an understanding of the domain problem
- Experience with data security and data lineage methodologies and tools is preferred
- Familiarity with agile development methodologies
- Exceptional communication skills, able to explain complex technical concepts in clear, plain English
- BSc degree in Computer Science, Engineering or a related field, or equivalent work experience
- Experience with data migration projects
- Knowledge of dbt, Airflow, or similar orchestration tools
- Experience in multi-cloud environments
- Familiarity with data modeling and analytics use cases
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Compensation & Benefits:
This role is eligible for our competitive salary and comprehensive benefits package to support your well-being:
- Comprehensive Health Insurance
- Paid Leave (Vacation/PTO)
- Paid Holidays
- Sick Leave
- Parental Leave
- Bereavement Leave
- 401 (k) Employer Match
- Employee Referral Bonuses
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search