Senior Software Engineer — Distributed Compute / Spark Systems

Granica Senior Software Engineer — Distributed Compute / Spark Systems 3 Hours AgoSaved Hybrid Mountain View, CA, USA 160K-240K Annually Senior level 160K-240K Annually Senior levelArtificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data PrivacyBuild and optimize distributed compute infrastructure for large-scale analytical and AI workloads. Responsibilities include improving query execution, scheduling, resource allocation, reliability, workload routing, and compute efficiency across Spark and related systems. The role involves debugging performance bottlenecks, optimizing joins, scans, shuffles, caching, partitioning, and memory usage, and working with lakehouse formats and cloud object storage. Candidates will implement workload optimization algorithms and may contribute to open source or research.Top Skills: Adaptive Query ExecutionAmazon EmrAmazon S3Apache FlinkApache HiveApache HudiApache IcebergSparkAws GlueAzure Data Lake StorageC++CatalystDatabricksDatafusionDelta LakeDuckdbGoGoogle Cloud StorageJavaOrcParquetPrestoRustScalaSnowflakeSpark SqlTrinoVelox