KnowledgeNet
Linkedin · Posted 29d ago
Senior Data Developer
Continue to application
Add your email once, then Caio opens the original posting.
Indexed description
Objective:
- Responsible for designing, developing, and maintaining ETL processes to support our data integration and analysis efforts that enable the efficient and accurate processing of data for analysis and reporting.
- Designing, developing, and maintaining ETL processes to support our data integration and analysis efforts.
- Understanding data requirements and translating them into ETL specifications.
- Developing and maintaining ETL documentation, including design documents, technical specifications, and data mappings.
- Conduct unit testing and integration testing of ETL processes to ensure the accuracy and completeness of data.
- Troubleshooting and resolving ETL-related issues, including performance tuning and optimization.
- Monitoring production ETL processes and proactively identifying and resolving issues to ensure data accuracy and availability.
- Participating in the design and development of data models, data architecture, and other data-related initiatives.
- Conducting training sessions for end-users.
- Periodically report project status to Tech lead/ principal.
- Bachelor's degree in computer science, information technology, engineering, or related field.
- 5–7 years of hands-on experience in data engineering, ETL/ELT development, and data integration.
- Knowledge of ETL tools and technologies such as DataStage or Informatica.
- Strong experience with Apache Spark (Java Spark) and Spark Structured Streaming for large-scale batch and real-time data processing.
- Strong programming skills in Java and Python, with experience building scalable data processing applications.
- Solid experience with Apache Hadoop (HDFS) and distributed data processing concepts.
- Experience with Apache Kafka and Kafka Connect data pipelines.
- Hands-on experience implementing Change Data Capture (CDC) solutions using technologies such as Debezium, Oracle Log Miner, and SQL Server CDC.
- Strong understanding of data warehousing concepts, including dimensional modeling, star and snowflake schemas, fact and dimension tables, and slowly changing dimensions.
- Strong SQL skills and experience working with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL.
- Knowledge of data modeling, data quality, metadata management, and data governance best practices.
- Familiarity with Docker, containerization, and Linux environments is a plus.
- Ability to leverage AI-powered tools and Large Language Models (LLMs).
- Experience working in Agile/Scrum development environments.
- USD Salaries: Earn a competitive salary in USD, with growth tied directly to your performance and impact.
- Comprehensive Benefits: Enjoy full social insurance and healthcare coverage to support your well-being.
- Continuous Growth: Stay ahead in a rapidly evolving world with access to ongoing learning and development opportunities.
- Autonomy & Impact: Define success on your terms. We provide the freedom, tools, and support you need to thrive and make a meaningful difference.
- Inclusive Culture: Be your authentic self. Join a team that values every voice, celebrates diversity, and fosters innovation through inclusion.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search
Want help applying to roles like this?
Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search
