AI Infrastructure Engineer (Databricks)
Indexed description
Build the backbone for our GenAI initiatives. We need an engineer to manage Vector Search and Feature Stores. You will prepare our data so that our AI models can ""read"" and understand the enterprise.
Key Responsibilities:
- Prepare GenAI-compatible datasets: manage vector embeddings and index with Databricks Vector Search.
- Access and utilize data assets from the Databricks Marketplace for model training.
- Integrate Power BI/Looker with Databricks using Unity Catalog security.
- Prepare data for RAG (Retrieval Augmented Generation) architectures.
- Collaborate with data stakeholders to implement Delta Sharing.
Must-Have Skills & Experience:
- 3+ years of hands-on experience in data engineering or a similar role.
- Strong programming and debugging skills in Python.
- Solid hands-on experience with PySpark for large-scale data processing.
- Proven experience building ETL/ELT pipelines on Databricks.
- Proficiency with Delta Lake, Auto Loader, and Delta Live Tables (DLT).
- Experience with at least one major cloud platform: AWS, Azure, or GCP.
- Strong understanding of data modeling, data warehousing, and medallion architecture.
- Hands-on experience with performance tuning and optimization techniques.
- Familiarity with cloud-native data services for storage, processing, streaming, and serverless computing.
Good-to-Have Skills:
- Databricks certifications (e.g., Databricks Certified Professional).
- Exposure to machine learning concepts, MLflow, Feature Store, or GenAI-related datasets (vector embeddings, Vector Search).
- Experience with big data and streaming technologies such as Spark, Hadoop, Hive, Kafka.
- Experience with Apache Airflow or other orchestration tools.
- Knowledge of CI/CD pipelines and DevOps practices in cloud environments.
- Experience with ETL tools such as Informatica, Talend, Matillion, or Fivetran.
- Familiarity with dbt (Data Build Tool).
What’s in it for you?
- Competitive Compensation and Benefits (Performance Bonus, 13th Month Pay, Day 1 HMO & Life Insurance Coverage)
- Expanded maternity leave up to 120 days*
- Expanded paternity leave up to 30 days*
- Flexible Working Arrangements*
- Healthy and Encouraging Work Environment
- Company-sponsored trainings like upskilling and certification
- Employee Stock Purchase Pan
- Loyalty and Christmas Gift
- Inclusion and Diversity Benefits
*Terms and Conditions Apply.
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.
Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search