JobsAisle
I

Java Developer

Iilika Groups

Hyderabad, IndiaINR 250,000-500,000/moAED 11.0K-22.0K/moToday
IndiaJavaApache SparkDockerKubernetesDevOpsSpring BootMicroservicesAzure Data ServicesRedpandaCICDPrometheusGrafanaAzure MonitorIceberg TablesParquet FormatsFull Time

Skills Required

JavaAzureDockerKubernetesDevops

Job Description

Job Description As a Senior Lead Java Developer, you will be responsible for leading the design and development of scalable data pipelines using Java and Spark in a cloud-based environment. Your key responsibilities will include: - Architecting & developing distributed data processing systems with Apache Spark and Java. - Designing real-time & batch data pipelines integrated with Azure Data Services. - Implementing Redpanda (Kafka-like) integration for streaming data ingestion. - Optimizing Spark jobs for performance, scalability, and fault tolerance. - Ensuring seamless CI/CD, monitoring, and observability using Prometheus, Grafana, Azure Monitor. - Leading and mentoring a team, ensuring best practices in Java, Spark, and cloud-native development. Qualifications required for this role include: - 13+ years in software development with strong Java (JVM-based) expertise. - 5+ years working with Apache Spark for data processing. - Extensive experience with Azure Data Lake, Blob Storage, and Databases. - Strong expertise in distributed processing, streaming frameworks, and Redpanda/Kafka. - Experience with Spark performance tuning, partitioning, and storage optimization. - Hands-on experience with CI/CD, Docker, Kubernetes, and DevOps practices. - Strong understanding of cloud security best practices. If you are passionate about data engineering, distributed systems, and cloud technologies, apply now. As a Senior Lead Java Developer, you will be responsible for leading the design and development of scalable data pipelines using Java and Spark in a cloud-based environment. Your key responsibilities will include: - Architecting & developing distributed data processing systems with Apache Spark and Java. - Designing real-time & batch data pipelines integrated with Azure Data Services. - Implementing Redpanda (Kafka-like) integration for streaming data ingestion. - Optimizing Spark jobs for performance, scalability, and fault tolerance. - Ensuring seamless CI/CD, monitoring, and observability using Prometheus, Grafana, Azure Monitor. - Leading and mentoring a team, ensuring best practices in Java, Spark, and cloud-native development. Qualifications required for this role include: - 13+ years in software development with strong Java (JVM-based) expertise. - 5+ years working with Apache Spark for data processing. - Extensive experience with Azure Data Lake, Blob Storage, and Databases. - Strong expertise in distributed processing, streaming frameworks, and Redpanda/Kafka. - Experience with Spark performance tuning, partitioning, and storage optimization. - Hands-on experience with CI/CD, Docker, Kubernetes, and DevOps practices. - Strong understanding of cloud security best practices. If you are passionate about data engineering, distributed systems, and cloud technologies, apply now.