Role: Lead PySpark Engineer
Job type: Fulltime
Location: Owings Mill, MD
Roles & Responsibilities:
10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts
• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team
Develop, test and maintain high-quality solutions using PySpark /Python programming language.
· Participate in the entire software development lifecycle, building, testing and delivering high-quality
data pipelines.
· Collaborate with cross-functional teams to identify and solve complex problems.
· Write clean and reusable code that can be easily maintained and scaled.
· Keep up to date with emerging trends and technologies in Python development. Design and develop
business controls using AWS Glue and PySpark
· Integrate data from various sources into Amazon Redshift
· Optimize performance of data processing jobs and fine tune queries
Salary Range: $110,000 - $115,000 a Year
Pemberton Transportation Services, Inc. is based in Knoxville, TN. We are seeking to hire a new member for our Transportation Services department. The ideal candidate will have a team personality, the ability to multitask in a fast-paced industry, and strong communication...
Join STAT Home Health and become part of a team that provides excellent patient care, respects one another, and has a supportive... ...in the field.STAT Home Health is seeking Part-Time Home Health Registered Nurses (RN) with Psych experience to join one of the most respected...
...KBRs National Security Solutions team provides high-end engineering and advanced technology solutions to customers in the intelligence and national security communities. The role impacts national security by supporting strategic plans compliant with government standards...
...Building Service Engineer will perform the full range of skilled work necessary to operate, maintain, inspect, diagnose, and repair campus HVAC systems and equipment. The BSE will test, adjust, and calibrate boiler and air-conditioning machinery; tests, adjust, and calibrates...
Principal Consultant - Commercial Cloud Data Management & AI (1164)Senior Leadership Opportunity at Axtria: Business & Cloud Information... ...consistently featured on prestigious lists such as INC 5000, Deloitte FAST 500, NJBIZ FAST 50, SmartCEO Future 50, and the Red Herring...