Sr. Big Data Engineer w/ Spark & Kubernetes

Job Description

Solution IT Inc. is looking for a Sr. Big Data Engineer w/ Spark & Kubernetes for one of its clients in Columbus, OH (Hybrid)

Job Title: Sr. Big Data Engineer w/ Spark & Kubernetes

Summary

Seeking a Sr. Software Engineer experienced in migrating Cascading/MapReduce workloads to Spark 3 on Kubernetes.

Lead the migration of Cascading/MapReduce to Spark 3.

Modify and optimize Scala/Spark code within IntelliJ IDE.

Conduct Scala code reviews and implement necessary upgrades.

Design and set up the Kubernetes environment for Big Data workloads.

Ensure efficient and scalable deployment of Spark 3 on Kubernetes.

Required Skills

Must have Strong expertise in Spark 3, Scala, and Big Data processing.

Hands-on experience with Cascading/MapReduce migration.

Proficiency in Kubernetes for deploying Spark workloads.

Experience with IntelliJ IDE and software development best practices

Must have excellent communication skills

Work Site: Columbus, OH (Hybrid)

Duration: 12+ months

Expected Start Date: Immediate - 2 weeks

Number of Positions: 01

Please send your responses back to

About Solution IT Solution IT is a national IT consulting company specializing in: Technology Staffing and Oracle E-Business Solutions based in Boston, Massachusetts.

Full-time

Hybrid remote