Data Engineer
Indexed description
About The Role
Our Data Team is looking for a passionate and talented Data Engineer to join our data team. In this role, you will help build and maintain data pipelines and infrastructure that support the company’s data-driven decision-making processes. This is an exciting opportunity for someone who loves music and data and wants to contribute to shaping the future of our industry.
Responsibilities:
Data Pipeline Development:
- Assist in designing and developing data pipelines that collect, process, and store data from music-related sources such as streaming platforms, royalties systems, and social media.
- Work closely with the data team to ensure data pipelines meet the analytical needs of the business.
Data Warehousing and Storage:
- Help maintain and optimize our data warehouses, ensuring data is structured and stored in a way that is easily accessible for analysis.
- Support the development of data models that maintain data integrity and reliability.
Data Quality and Monitoring:
- Implement and run data quality checks to ensure that the data being used by the company is accurate, consistent, and reliable.
- Monitor data pipelines for performance issues, troubleshooting and resolving any problems to minimize downtime.
- Assist in developing tools and alerts to proactively monitor data flows and address issues as they arise.
Integration and Collaboration:
- Work on integrating data from various internal and external sources, such as streaming data from platforms like Spotify and YouTube, into our data infrastructure.
- Collaborate with other engineers and departments to integrate new data sources and refine existing data pipelines.
- Participate in cross-functional projects to leverage data for improving business outcomes, such as optimizing royalty payments or tracking song performance.
Learning and Development:
- Stay updated with the latest trends and technologies in data engineering and the music industry.
- Engage in continuous learning to enhance your technical skills and contribute innovative solutions to the team.
- Participate in team meetings and brainstorming sessions to help drive the company’s data strategy forward.
Qualifications:
Educational Background:
- Bachelor’s degree in Mathematics, Information Systems, Computer Science, Engineering, Data Engineer, or a related field.
- Minimum 2-3 years of relevant experience in Data Engineering.
Technical Skills:
- Proficiency in SQL, and NoSQL and experience with database management systems.
- Familiarity with programming languages such as Python
- Familiarity with visualization tools such as Metabase is a plus.
- Understanding of data warehousing concepts and ETL/ELT processes.
- Basic understanding of containerization (e.g., Docker) and orchestration concepts.
- Exposure to on premise (Hadoop) & Cloud platforms like Google Cloud is a plus.
- Experience with big data technologies (e.g., Airflow, Spark, Dbt, Flink) is advantageous.
- Experience with implementing APIs for seamless data integration and interoperability across diverse databases/systems is advantageous
Soft Skills:
- Strong analytical and problem-solving skills.
- Good communication and collaboration abilities.
- Attention to detail and commitment to data quality.
- Eagerness to learn and adapt to new challenges.
- Go-getter able to work independently.
*Portfolio needs to be attached to CV
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search