Overview

RESPONSIBILITIES:
Kforce has a client in search of a Software Engineer Big Data in Mountain View, California (CA).

Responsibilities:
* Managing Large Scale EMR Clusters in AWS Proficient in writing EMR Spark jobs; Iceberg to work with EMR
* Develop run books for problem diagnosis, resolution, and escalation

REQUIREMENTS:
* BS or higher in Computer Science or equivalent knowledge and experience; MS preferred
* Proficient in Java and strong in Scala Ability to integrate and patch big data open source technologies like Ubers Hudi and Netflixs
* In depth understanding of Hive Good understanding of Kafka and writing producers and consumers
* Experience in AWS big data technologies like EMR, EMR Consistent View, S3, Athena, Glue Catalog Extensive hands on experience with administering some of the following: Spark, EMR, Hive on Tez or Presto
* Ability to debug EMR streaming jobs consisting of Kafka, Spark, and Hive
* Operational mindset with ability to do Problem, SLA and Incident Management
* Experience installing and managing Kafka is good to have
* Strong critical thinking ability to assess complex problems, analyze options, navigate diverse perspectives, and develop optimal/acceptable solutions
* Ability to work independently with minimal supervision
* Contributions to Operational Standards and Requirements
* Experience managing infrastructure in AWS using EMR Proficient with automating repetitive tasks using Python, Ruby, JavaScript, or Bash Experience designing and deploying systems on AWS
* Enjoy a fast-paced, rapidly changing work environment
* Good communication skills, and a passion for clean code
* Experience with SQL and Python (boto3 Library)
* Experience with AWS products including EC2, S3, RDS Exposure to Big Data on AWS (Data Pipeline, Batch, Glue, S3, EMR/EC2)

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.


More Jobs: