Sr Databricks Architect- AWS Background-15 years
Indexed description
Job Title: DATABRICKS Architect
Work Location: Irving TX/ Tampa, FL/ Edison, NJ
Duration: Full time
Job Description
Role Overview
- We are seeking a highly skilled Databricks Engineer with AWS expertise to support Data Services portfolio
- The role will be responsible for designing developing optimizing and supporting enterprise scale data platforms data pipelines and analytics solutions leveraging Databricks Lakehouse AWS Cloud and modern data engineering practices
- The candidate will work closely with data architects application teams business stakeholders and platform engineering teams to deliver scalable secure and high-performance data solutions
- Design develop and maintain scalable data pipelines using Databricks PySpark Spark SQL and Delta Lake
- Build and support enterprise data lake and Lakehouse solutions on AWS
- Develop batch and Realtime ingestion frameworks from multiple source systems
- Implement data transformation enrichment cleansing and validation processes
- Optimize Spark workloads for performance scalability and cost efficiency
- Design and implement data models supporting reporting analytics and downstream applications
- Integrate Databricks with AWS services including S3 Glue Lambda Redshift EventBridge and IAM
- Support data migration and modernization initiatives from traditional data warehouses to Databricks Lakehouse
- Implement CICD pipelines and Infrastructure as Code IaC using Terraform and Gitbased repositories
- Collaborate with security teams to ensure compliance with client governance risk and data security standards
- Troubleshoot production incidents and provide L3 operational support
- Participate in architecture reviews code reviews and technical governance activities
- Databricks
- Databricks Lakehouse Architecture
- Databricks Workflows
- Delta Lake
- Unity Catalog
- Databricks SQL
- Auto Loader
- Structured Streaming
- Databricks Performance Tuning
- Medallion Architecture
- AWS
- Amazon S3
- AWS Glue
- AWS Lambda
- AWS IAM
- Amazon Redshift
- AWS CloudWatch
- SNS SQS
- EventBridge
- KMS
- Secrets Manager
- Data Engineering
- PySpark
- Apache Spark
- Python
- SQL
- Data Warehousing Concepts
- ETLELT Design
- Data Modeling
- Data Quality Frameworks
- Batch RealTime Processing
- Snowflake
- Microsoft Fabric
- Google Cloud Platform BigQuery
- Kafka
- Airflow
- dbt
- Terraform
- Docker
- Kubernetes OpenShift
- Informatica
- Collibra
- Data Vault Modeling
- Dimensional Data Modeling
- Banking Domain Experience
- Strong experience within Banking and Financial Services
- Understanding of enterprise data governance regulatory reporting risk compliance and audit requirements
- Experience working in large global organizations with stringent security and operational standards
- Bachelors or Masters degree in Computer Science Engineering Information Systems or related discipline
- Databricks Certified Data Engineer Preferred
- AWS Certified Data Analytics or AWS Solution Architect Preferred
Short Term and Long-Term Disability Coverage
401(k) Plan with Company match
Life Insurance
Vacation Time, Sick Leave, Paid Holidays
Paid Paternity and Maternity Leave
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all Canada locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, colour, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search