Data Platform Engineer (Apache Druid Specialist)

Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A “Great Place To Work® Certified™” company, Prodapt employs over 6,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.

The future of network operations is autonomous — and Prodapt is building it. This leadership role will define and drive Prodapt's Autonomous Operations and AIOps strategy across infrastructure and network domains, working with the world's largest telecom operators, fiber ISPs, and cloud network providers. You will combine deep network engineering expertise with AI/ML capabilities to eliminate manual toil, predict failures before they occur, and help clients achieve closed-loop autonomous network operations.

We are seeking a world-class Data Platform Engineer to take complete operational and architectural ownership of one of the largest Apache Druid deployments in the industry. Our environment operates at extreme velocity and petabyte scale, processing real-time streaming data via Kafka across ~7,000 parallel ingestion tasks. If you have pushed Druid, Zookeeper, and the Linux kernel to their absolute breaking points—and know exactly how to tune them to stay up—this role is built for you. In this role, you will bridge the gap between deep infrastructure engineering, Unix Linux systems administration, and distributed big data platforms. You will design, scale, and automate massive Middle Manager/Indexer fleets, optimize deep storage, eliminate metadata DB bottlenecks, and implement bulletproof query isolation. Utilizing Ansible and Infrastructure-as-Code methodologies, you will ensure our clusters are highly available, self-healing, and meticulously monitored. If you are a platform engineer who thrives on solving complex concurrency, JVM Garbage Collection, and high-throughput streaming challenges at scale, join us to redefine what is possible with real-time analytics.

• Design, deploy, administer, and optimize large-scale Apache Druid clusters supporting PB-scale datasets.
• Manage and troubleshoot Druid services.
• Perform cluster upgrades, patching, capacity planning, and platform modernization activities.
• Monitor cluster health, ingestion performance, query latency, segment distribution, and resource utilization.
• Troubleshoot ingestion failures, stuck tasks, compaction issues, retention policies, and segment management problems.
• Optimize Druid queries, partitioning strategies, indexing specifications, and compaction configurations.
• Configure and maintain Druid metadata stores using MySQL.
• Develop operational automation using Ansible and Infrastructure-as-Code methodologies.
• Create dashboards, alerts, and monitoring solutions using Grafana, Prometheus, and logging platforms.
• Work with platform teams to ensure high availability, disaster recovery, backup, and security compliance.
• Participate in production support, incident response, root cause analysis, and performance tuning initiatives.
• Collaborate with architects and business teams to understand analytical requirements and translate them into scalable solutions.

Requirements

• 10+ years in Platform Engineering with 5+ years in Apache Druid.
• Bachelor's or Master's degree in Computer Engineering, or a related field experience.