Senior Software Developer (BigData)

Main Responsibilities

• Lead technical study into a proposed solution, while involving expertise from infrastructure big data experts, business analyst requirements.
• Document proposed design and develop the solution.
• Implicitly ensure all CI-CD artefacts are part of the solution.
• Perform code review while fostering knowledge and coaching best practices to team members.
• Interact and provide reporting to project managers.
• Monitor technical risk and escalate appropriately to management.
• Research, design, and develop software.
• Analyse user needs and develop software solutions.
• Update software, enhance existing software capabilities, and develop and direct software testing and validation procedures.
• Work with other engineers to integrate hardware and/or software systems.

The position requires autonomy and reliability in performing duties with initiatives and leadership when it comes to all non-functional deliverables such as testing tools, mocking objects, production monitoring concerns, quality control including performance and load testing.

Qualifications And Profile

Mandatory

• At least 8 years in Software development.
• At least 5 years in Java/J2EE development.
• Hands-on Data ingest and data processing technology like Spark streaming and Spark.
• Hands-on Messaging systems like Kafka, Flume or ActiveMQ, MQSeries or RabbitMQ.
• Hands-on knowledge on Hadoop (preferably Hortonworks distribution) - HDFS, HBase, Hive, ORC/Parquet.
• Build tool - Maven/sbt/ant, UML, Restful web services, Jenkins/Team City, Source management – SVN/GIT, TDD using Junit, Jira/QC.

Good to Have

• Solution design using proven patterns, awareness of anti-patterns, performance tuning, especially in streaming.
• Knowledge of tools like Phoenix, ElasticSearch, Sqoop, StreamSets are good to have.
• Basic understanding of finance and investment banking.