Senior Data Engineer
Indexed description
Sirrus.ai uses the power of agentic AI to automate real estate use cases and have created a proprietary framework of interacting agents which does the work automatically as humanoids giving it a cutting edge very few companies in real estate have been able to achieve.
About TCG
The Chatterjee Group (TCG) has an enviable track record as a strategic investor, with businesses in many sectors. Founded by Dr. Purnendu Chatterjee in 1989, the Group specializes in the Petrochemicals, Pharmaceuticals, Biotech, Financial Services, Real Estate and Technology sectors in the US, Europe and South Asia. It provides end-to-end product and service capabilities through its investments and companies in these sectors. TCG is one of the biggest PE groups in the country with significant brand presence abroad and in India.
About The Role
We are seeking a highly skilled and passionate Senior Data Engineer with strong expertise in Big Data technologies, Spark, Databricks, and modern AI-driven data platforms. The ideal candidate will play a key role in designing scalable data solutions, building enterprise-grade Lakehouse architectures, and driving innovation through AI-enabled engineering initiatives.
This role demands a strong engineering mindset, hands-on technical expertise, and the ability to rapidly prototype ideas, perform technical POCs, and deliver scalable, high-performance solutions. The candidate should be comfortable working across both traditional data engineering and emerging AI/GenAI ecosystems, including AI Agents and intelligent automation frameworks.
Key Responsibilities
- Design, develop, and optimize scalable data pipelines using Apache Spark and PySpark.
- Build and manage enterprise data platforms leveraging modern Lakehouse and Medallion Architecture principles.
- Work extensively on the Open Source Technologies like Airflow, Dremio, Postgres DB along with Databricks ecosystem including Delta Lake, Unity Catalog, Workflows, cluster optimization, and performance tuning.
- Drive Spark and SQL performance optimization initiatives for large-scale distributed workloads.
- Develop reusable frameworks, accelerators, and scalable engineering components using open-source technologies.
- Conduct technical POCs and evaluate emerging technologies, tools, and architecture patterns in Data Engineering and AI.
- Contribute to AI/GenAI initiatives including AI Agents, LLM integrations, intelligent workflows, and AI-driven automation solutions.
- Collaborate closely with Data Architects, AI Engineers, Analysts, and Business stakeholders to deliver high-impact solutions.
- Ensure engineering best practices around scalability, reliability, governance, observability, and cost optimization.
- 5–10 years of strong hands-on experience in Data Engineering and Big Data ecosystems.
- Deep expertise in:
- Apache Spark / PySpark
- SQL and Data Modelling
- Distributed Data Processing
- ETL/ELT Development
- Data Lakes and Lakehouse Architectures
- Strong understanding of Medallion Architecture (Bronze, Silver, Gold layers) and modern data platform design.
- Hands-on experience with the Databricks platform and Spark optimization techniques.
- Experience working with open-source technologies such as Kafka, Airflow, Docker, Kubernetes, Hive, Trino/Presto, etc.
- Exposure to cloud platforms including Amazon Web Services, Microsoft Azure, or Google.
- Practical exposure to AI Engineering concepts and AI-driven solution development.
- Experience building rapid POCs, technical accelerators, and scalable AI-enabled solutions.
- Understanding of AI/GenAI concepts including AI Agents, Prompt Engineering, RAG architectures, Vector Databases, and LLM-based applications.
- Strong analytical thinking, troubleshooting, and problem-solving capabilities.
- Opportunity to make an impact
- Culture of Innovation: A dynamic workplace that encourages experimentation, ownership, and continuous growth.
- Vibrant Workplace: Work from our Mumbai office, collaborate with brilliant minds in a lively vibe!
- Inclusive & Diverse: Talent matters, not labels.
- Meaningful Perks: Extra paid leaves for birthdays, anniversaries & more.
- Execution is King: We deliver with precision and speed.
- We Win & Fail Together: Teamwork over competition, always.
- We Test, Learn & Progress: Experiment, iterate, and grow.
- Respect at Workplace: A culture of inclusivity and trust.
- Intellectual Honesty: Data-driven, transparent decision-making.
- Time is Money: We value efficiency and smart work.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search