Data Engineer
Indexed description
Title - Data Engineer
Location: Austin, TX , Onsite
Experience: 4–5 Years
Job Summary
We are looking for a skilled Data Engineer with 4–5 years of experience to join our team. The ideal candidate will have strong expertise in Python, SQL, and modern data engineering technologies, with hands-on experience in building and maintaining scalable data pipelines. Experience with ClickHouse, Vertica, Apache Airflow, and AI-powered coding tools is essential.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Develop high-quality, efficient, and maintainable code using Python.
- Write complex SQL queries for data extraction, transformation, validation, and performance optimization.
- Work with ClickHouse and Vertica databases to manage and optimize large-scale datasets.
- Build, schedule, and monitor workflows using Apache Airflow.
- Ensure data quality, integrity, and reliability across data platforms.
- Collaborate with cross-functional teams to understand business requirements and deliver data solutions.
- Troubleshoot and resolve data pipeline, database, and workflow issues.
- Leverage AI-assisted coding tools (such as GitHub Copilot, Cursor, or ChatGPT) to improve development productivity and code quality.
- Follow software engineering best practices, including version control, testing, and documentation.
Required Skills
- 3–5 years of experience in Data Engineering.
- Strong programming skills in Python.
- Strong proficiency in SQL, including query optimization and performance tuning.
- Hands-on experience with ClickHouse.
- Experience working with Vertica.
- Strong knowledge of Apache Airflow for workflow orchestration.
- Experience building and supporting ETL/ELT pipelines.
- Familiarity with Git and version control systems.
- Experience using AI-powered development tools for coding and productivity.
Preferred Qualifications
- Experience working with large-scale data platforms.
- Knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Understanding of data warehousing concepts and data modeling.
- Strong analytical, problem-solving, and communication skills.
Nice to Have
- Experience with distributed data processing frameworks.
- Exposure to CI/CD pipelines and DevOps practices.
- Experience in Agile/Scrum development environments.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search