Databricks Architect

LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence initiatives., LatentView Analytics enables leading global brands to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, optimize investment decisions, and turn unstructured data into valuable business assets.

Role : Databricks Architect

location: Detroit, Michigan, United States

Core technical skills

Advanced Apache Spark and PySpark/Scala for large-scale data processing, including performance tuning with Spark UI, partitioning, joins, caching, and shuffle optimization.

Deep Databricks platform expertise: notebooks, jobs/workflows, cluster configuration, Databricks SQL, and applying Medallion (Bronze/Silver/Gold) architecture patterns.

Delta Lake: ACID transactions, schema enforcement and evolution, MERGE operations, time travel, and design of performant Delta tables for lakehouse use cases.

Unity Catalog and governance: catalogs/schemas/tables, permission models, data lineage, and secure access patterns across workspaces and domains.

Strong SQL for data modeling, complex transformations, aggregates, and BI‑ready structures in a lakehouse context.

Azure platform skills: Azure Data Lake Storage, Azure Data Factory (or Synapse pipelines), Event Hubs/IoT, networking, identity and access, Key Vault, and monitoring.

Data modeling and warehousing: dimensional modeling, star/snowflake schemas, and performance-oriented design for analytics and reporting.

CI/CD and DevOps for data: Git-based workflows, automated testing, and deployment using Azure DevOps or GitHub Actions for Databricks pipelines and artifacts.

Recommended certifications and accreditations

Microsoft Certified: Azure Solutions Architect Expert or Azure Data Engineer Associate

Databricks certifications Data Engineer Associate/Professional, Hadoop Migration Architect.

At LatentView Analytics, we value a diverse, inclusive workforce and provide equal employment opportunities for all applicants and employees. All qualified applicants for employment will be considered without regard to an individual's race, color, sex, gender identity, gender expression, religion, age, national origin or ancestry, citizenship, physical or mental disability, medical condition, family care status, marital status, domestic partner status, sexual orientation, genetic information, military or veteran status, or any other basis protected by federal, state or local laws.