Data Engineer
Indexed description
Experience: 4+ Years
Role Summary
Build and maintain the enterprise data lake, design ETL pipelines, develop ML models for forecasting, and create AI agents/MCP integrations using LLM APIs.
Required Skills
- Python ETL — Pandas, NumPy, data modelling, API integrations
- SQL — Complex queries, schema design, performance tuning
- GCP — BigQuery, Cloud Storage, CloudRun, Secret Manager
- Data Lake Design — Ingestion from ERP/CRM systems (NetSuite, Salesforce), schema evolution, data quality
- REST API — Development and consumption (OAuth, webhooks)
- Git & CI/CD — Version control and deployment basics
- AI Agent Development — Tool-calling agents, MCP servers, LLM APIs (Claude, Gemini, OpenAI)
- Machine Learning — Time series forecasting, predictive modelling (Prophet, XGBoost, SARIMAX)
- BI Tools — Qlik or Looker
- Orchestration — Cloud Scheduler, Airflow, or cron-based job pipelines
- Build and maintain data lake on BigQuery — ingestion, transformation, scheduling
- Design and implement ETL pipelines (Python) across banking, ERP, and CRM sources
- Experiment with and deploy ML models for cash forecasting and business predictions
- Develop AI agents and MCP tool integrations using LLM APIs
- Ensure data quality, monitoring, and alerting across pipelines
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search