Senior Software Engineer - Husky Storage

Datadog Senior Software Engineer - Husky Storage 9 Hours AgoSaved Easy Apply Hybrid 2 Locations Easy Apply 192K-240K Annually Senior level 192K-240K Annually Senior levelArtificial Intelligence • Cloud • Security • Software • CybersecurityDevelop and operate Husky, a petabyte-scale distributed columnar event store. Lead migration to Parquet and DataFusion, improve compaction, compression, indexing, storage tiering, caching, and cost efficiency. Scale event versioning with temporal database techniques, collaborate across ingestion, metadata, platform, and lakehouse teams, and help define service operations. Contribute to open-source software and support analytical workloads through Iceberg-compatible integrations.Top Skills: Amazon S3ArrowAzure Blob StorageDatafusionDelta EncodingDictionary EncodingGoGoogle Cloud StorageGorilla EncodingIcebergJavaKafkaKubernetesOrcParquetRleRust