Data Platform Engineer

Project Role : Data Platform Engineer

Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.

Must have skills : PySpark

Good to have skills : NA

Minimum 3 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Platform Engineer, a typical day involves contributing to the development and refinement of the data platform blueprint and design. This role requires close collaboration with Integration Architects and Data Architects to ensure seamless integration across various systems and data models. The position demands active engagement in aligning platform components to support organizational data needs, fostering a cohesive and efficient data environment. The engineer plays a vital role in bridging different architectural perspectives to create a unified data platform that supports business objectives and technological requirements.

Roles & Responsibilities:

• Expected to perform independently and become an SME.
• Required active participation/contribution in team discussions.
• Contribute in providing solutions to work related problems.
• Collaborate effectively with cross-functional teams to ensure alignment of data platform components with overall architecture.
• Assist in identifying potential improvements and optimizations within the data platform to enhance performance and scalability.
• Support junior team members by sharing knowledge and providing guidance on best practices.
• Maintain clear and thorough documentation of design decisions and integration processes.

Professional & Technical Skills:

• Must To Have Skills: Proficiency in PySpark.
• Experience with distributed data processing frameworks and big data ecosystems.
• Strong understanding of data integration techniques and data modeling concepts.
• Familiarity with cloud-based data platforms and services.
• Ability to troubleshoot and optimize data workflows for efficiency and reliability.
• Knowledge of scripting and automation to support data platform operations.

Additional Information:

• The candidate should have minimum 3 years of experience in PySpark.
• This position is based at our Chennai office.
• A 15 years full time education is required.

, 15 years full time education