AI-Enabled Data Engineer

TechTorch AI-Enabled Data Engineer Reposted 10 Hours AgoSaved Remote United States Mid level Mid levelArtificial Intelligence • Information TechnologyDesign, build, and operate scalable data pipelines and platforms (Snowflake, Databricks, Delta Lake). Implement dbt models, semantic layers, data quality, orchestration (Airflow/Dagster/ADF), and DevOps for data. Build AI-enabled pipelines for RAG, embeddings, vector stores and integrate LLMs into ETL. Ensure reliability, monitoring, and cost-effective cloud architectures across AWS and Azure.Top Skills: AdlsApache AirflowSparkAws GlueAws S3Azure Data FactoryAzure SynapseCi/CdClaude CodeDagsterDatabricksDatabricks Ai/Bi ToolingDatabricks WorkflowsDbtDelta LakeEmbedding PipelinesFeastFlinkInfrastructure As CodeKafkaLlmsMcpPgvectorPineconePrefectPysparkPythonQdrantRagRedshiftSnowflakeSnowparkSpark StreamingSQLTectonVector StoresWeaviate