Senior Spark & Python Developer Job at Mavens Guild, McLean, VA

Z0k4TkgrNnY0VjlHbzNjc1ljZEUvN3pOWkE9PQ==
  • Mavens Guild
  • McLean, VA

Job Description

What we would like to see:

In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm. Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.

A typical day as a Senior Spark Programmer:

  • Develop fault tolerant, streaming as well as batch data integration processes using Spark/PySpark, Java and performance enhanced SQL

  • Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools

  • Design and develop automation of data flow tasks and end-to-end process testing

  • Design and develop scalable frameworks to ingest, transform, store, and present loss prevention information to downstream systems

  • Implement and lead implementation of Agile best practices and a continuous integration ecosystem

  • Implement and lead implementation efforts of Spark/Python based solution architecture, scalable process frameworks, advanced analytics, and responsive RESTful services

What you will need to bring to the table:

  • 5+ years experience with processing of structured, unstructured and semi-structured data using in-memory cluster computing technologies, specifically with Spark

  • 5+ years experience as a Java programmer

  • 3+ years experience programming in Python (PySpark API)

  • 3+ years experience with cloud services offered through AWE, like EMR, Redshift, or S3

  • 3+ years experience in developing, testing and deploying RESTful APIs for high volume data streams

  • Experience with continuous integration tools like Jenkins

  • Experience working in a distributed computing infrastructure like Hadoop and/or Spark

  • Critical and analytical approach to solving technical problems 

  • Excellent interpersonal skills and ability to clearly communicate highly technical concepts to business stakeholders and technical developers alike

Job Tags

Contract work,

Similar Jobs

Belcan

Recruiter Job at Belcan

 ...link provided. Our overriding goal is to provide quality staffing solutions that help people, organizations, and communities succeed. Belcan is a leading provider of qualified personnel to many of the world's most respected enterprises. We offer excellent opportunities... 

UNICEF

Consultancy: Child Protection and Children and Armed Conflict Consultant - Ref.#581667 Job at UNICEF

 ...countries and territories, we work for every child, everywhere, every day, to build a...  ...every child, HOPE!Consultancy Title: Child Protection and Children and Armed Conflict...  ...insurance coverage). Their conditions of service will be governed by their contract and the... 

KamisPro

Senior Splunk Engineer Job at KamisPro

 ...native technologies is a plus. ~ Splunk Certified Administrator required; Splunk Certified Architect (preferred or in-progress). ~ CompTIA Security+ (DoD 8570 IAT II compliant). ~ Excellent verbal and written communication skills, and ability to collaborate in agile... 

Northwell Health

RN (Registered Nurse) FlexStaff Travel - OR (Operating Room) - Northwell Health - Lake Success, New York, United States Job at Northwell Health

 ...for early discharge planning and appropriate referrals for post-hospital care; Evaluates the effectiveness of teaching by feedback...  ...license to practice as a Registered Professional Nurse in New York State. BCLS, ACLS, preferred. *Additional Salary Detail... 

National Testing Network

Police Officer/Police Cadet-SYLVANIA, CITY OF Job at National Testing Network

 ...officers in Ohio at the time of testing and scoring 70% or higher will receive an additional five points on their passing score. Veterans' Preference: Veterans who achieve a passing score on the examination will receive an additional five points on their passing...