Big Data Engineer
Indexed description
Key Responsibilities:
- Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka
- Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs
- Ensure high data quality and integrity by implementing robust data validation and testing processes
- Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments
- Monitor and troubleshoot data processing workflows to ensure timely data delivery
- Document data architectures, processes, and workflows for knowledge sharing and compliance
- Stay ahead of industry trends and best practices in big data technologies and methodologies
- Bachelor's degree in Computer Science, Information Technology, or a related field
- 3+ years of experience as a Big Data Engineer or in a similar data engineering role
- Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka
- Strong coding skills in programming languages like Java, Scala, or Python
- Familiarity with data processing frameworks and ETL tools
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery)
- Analytical mindset and excellent problem-solving abilities
- Strong communication skills to collaborate effectively with technical and non-technical stakeholders
- A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines
- Experience with machine learning frameworks and algorithms is a plus
- Knowledge of data governance and security best practices
- Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes
2- Family Benefits.
3- Visa.
4-Air Tickets.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search