Data Engineer

Decskill, founded in 2014 as an IT Consulting Company, places paramount importance on its greatest asset: its people. Our main mission is to deliver value through knowledge and talent, and we achieve this by fostering a culture of excellence and investing in the development and well-being of our people. With over 600 dedicated professionals and offices in Lisbon, Porto, Madrid, and Luxembourg, Decskill operates across three core areas:

Decskill Talent: We believe that our people are key to our success.

Through Decskill Talent, we empower our team to embrace the digital transformation challenges of our clients. We collaborate with clients to drive innovation, ensuring project success and business growth.

Decskill Boost: Equipping our team with the latest tools and methodologies, we optimize Time-to-Market and deliver innovative solutions exceeding client expectations.

Decskill Connect: Our team collaborates closely with clients to implement and manage IT infrastructures that generate long-term value.

At Decskill, we believe that by nurturing and empowering our people to confront the challenges of digital transformation, we create value not only for our clients but also for our entire ecosystem, fostering a digital community dedicated to growth and progress.

We are looking for an Data Engineer

Responsabilities:

• Data Pipeline Development: Design and maintain robust data pipelines, ensuring seamless data flow from various sources to storage and analytical platforms;
• Data Modeling: Craft and optimize data models for efficient data retrieval and analysis, balancing performance and scalability;
• Data Quality Assurance: Implement rigorous testing and validation protocols to guarantee the accuracy and integrity of data;
• Troubleshooting and System Optimization: Proactively identify and solve data processing issues, enhancing the performance and reliability of data systems;
• Big Data Processing: Engage in large-scale data projects, utilizing frameworks like Apache Spark for efficient data handling and processing;
• Real-Time Data Streaming: Work on cutting-edge projects that process and analyze data in real-time, ensuring swift data delivery and insights.

Requirements:

• At least 3 years of experience in data engineering;
• Experience working with public cloud platforms, especially AWS;
• Experience with IaC tools, such as Terraform;
• Ability to code in at least one programming language (Python, Java, JavaScript, Scala) is a must;
• Experience working with and creating data-driven architectures, preferably in public cloud platforms;
• Experience using a querying language such as SQL;
• Experience with Big Data and data modelling;
• Advanced knowledge of multiple SQL/noSQL data environments and a strong. understanding of why and when to use a particular solution;
• Familiarity with tools in the Big Data ecosystem (like Hadoop, Cassandra, Apache Hive, Apache Spark, and others alike);
• Experience with orchestration tools like Airflow is a big plus.

If you’re interested in this job please send your CV in English to [email protected] with reference “SS / DE)”

Decskill is committed to equality and non-discrimination with all our talents. We recruit and promote talent, based on diversity and inclusion, regardless of age, gender, ethnicity, race, nationality or any other form of discrimination incompatible with the dignity of the human being.