Sr. Data Engineer
Indexed description
Key Responsibilities
- Design and build the next-generation AI ready data platform.
- Develop and automate data processing systems leveraging DBT to deliver data insights at an enterprise scale.
- Design and implement workflow orchestration using Airflow / Cloud Composer for seamless data pipeline execution and scheduling across multiple systems.
- Develop logging, metrics, and alerts for active monitoring of processes.
- Collaborate with Product Managers and Application teams to create data models and schemas for easy access to complex datasets.
- Maintain data integrity in production systems.
- Balance and prioritize multiple conflicting requirements with high attention to detail.
- Bachelor’s degree or higher in Computer Science, Engineering, or related field.
- 3–5 years of experience designing, developing, testing, and implementing scalable, high-performing data warehouse and BI solutions.
- Enterprise development experience with databases (SQL Server, Oracle, MySQL, Vertica, MemSQL, Netezza, Redshift, Google BigQuery.
- Hands-on experience with real-time data pipelines (Pub/Sub, Kinesis, Kafka) and database architecture (including MPP).
- Experience with ETL/ELT and data transformation tools (DBT, DataFlow, Informatica).
- Hands-on experience with workflow orchestration platforms (Apache Airflow, Prefect, Dagster, Cloud Composer).
- Proficiency in BI/Analytical tools (Tableau, Looker, OBIEE, Power BI).
- Strong analytical skills to translate complex business problems into actionable insights.
- Exceptional communication and analytical skills with demonstrated ability to engage both technical and business audiences.
- Programming: Python, SQL, Java, Scala
- Cloud Platforms: AWS, Google Cloud Platform, Azure
- Data Warehousing: BigQuery, Redshift, Snowflake
- Stream Processing: Apache Kafka, AWS Kinesis, Google Pub/Sub
- Workflow Orchestration: Apache Airflow, Prefect, Dagster, Cloud Composer
- BI Tools: Tableau, Pentaho, Looker, Power BI, Thoughtspot
- E-verify Participation
- Right to Work
Create a free Caio profile to unlock the full index and keep your job-search signal for future recommendations.
Unlock free search