Data Engineer II
Indexed description
Work you'll do
As a Data Engineer II on the Data Engineering team, you will be responsible for...
- Design, build, test, and maintain scalable data pipelines and workflows for ingesting, transforming, and delivering structured and unstructured data
- Develop and optimize data models, integration patterns, and storage solutions to support analytics, reporting, and operational use cases
- Collaborate with cross-functional stakeholders to define data requirements, troubleshoot issues, and implement data quality controls
- Build and support batch and near-real-time processing solutions using cloud-based and distributed data technologies
- Document technical designs, data lineage, and deployment processes, and support testing, release, and production stabilization activities
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
Qualifications
Required:
- Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, Information Systems, Data Science, or a quantitative field
- 3+ years of experience designing, building, and maintaining data pipelines and ETL/ELT workflows
- 3+ years of experience using SQL, Python, and PySpark for data ingestion, transformation, and automation
- 1+ years of experience using Palantir Foundry, including Pipeline Builder and Ontology-based data modeling
- 1+ years of experience monitoring data pipelines, troubleshooting issues, and supporting data quality and system reliability
- Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve.
- Must possess an active U.S. Secret security clearance and be able to maintain it for the duration of employment and assignment
- Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.
- Master's degree in Computer Science, Computer Engineering, Software Engineering, Information Systems, Data Science, or a quantitative field
- 1+ years of experience with workflow orchestration tools such as Apache Airflow
- 1+ years of experience with data warehousing platforms such as Snowflake, Databricks, or Amazon Redshift
- 1+ years of experience with version control and continuous integration tools
- 1+ years of experience supporting data quality, metadata, and data lineage processes
- 1+ years of experience working in Agile delivery environments
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search