大数据开发（Java/Spark/英文)

该职位来源于猎聘 We are seeking a skilled GCP Cloud Engineer to design, implement, and maintain secure, scalable applications and infrastructure for our Gen-AI platform hosted on GCP. This role requires expertise in cloud security, DevOps methodologies, and extensive experience with Java and Spring Boot development. Key Responsibilities: Design and maintain cloud security controls, ensuring compliance and addressing vulnerabilities. Build, deploy, and manage Gen-AI applications and Data security products to secure and implement governance policies on the data assets in the organization. Integrate security frameworks on modern high-performance analytics database and computation engines like Spark, Presto, Kafka, Elastic, and technologies in the stack. Implement and optimize CI/CD pipelines for Java/Spring Boot applications on GCP, including deployment to OpenShift. Manage GCP resources (VMs, storage, networking, databases) and automate tasks with Python scripting. Develop and deploy Java-based microservices using Spring Boot and Hibernate, focusing on scalable and high-performance solutions, with experience in Spark for data processing. Required Skills: Strong expertise in GCP services(Mandatory) (Compute Engine, GKE, Cloud SQL, IAM, DLP, Dataproc, Dataflow, Firewall rules etc.). Extensive experience with Java , Spring Boot, and Hibernate for microservices development. Integrating existing solutions to run in a hybrid cloud environment. Integrating and enabling frameworks to run on containerized platforms. Proficiency in CI/CD tools (Jenkins), Docker, Kubernetes/GKE, OpenShift, and Terraform. Solid understanding of cloud security, including network security, data protection, and compliance. Experience with Spark, relational and NoSQL databases, and scripting (Python, Bash). Demonstrated Python coding experience. Bachelor's or Master’s degree in Computer Science or related field; GCP certifications are strongly preferred. Good to Have: Elastic Search/Open Search. Apache Kafka. GenAI/AI/ML Experience. Python with Flask/Django. Data Security Big Data (CDP/Dataproc/Hive)