PySpark Engineer Job at Tata Consultancy Services, Owings Mills, MD

aHVvMU1Pd0M3MlZxUFFPaEhWWGo1cUU2
  • Tata Consultancy Services
  • Owings Mills, MD

Job Description

Role: Lead PySpark Engineer

Job type: Fulltime

Location: Owings Mill, MD

Roles & Responsibilities:

10+ years of experience in big data and distributed computing.

• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts

• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).

• Proficiency in data modeling and ETL workflows.

• Proficiency with workflow schedulers like Airflow

• Hands on experience with AWS cloud-based data platforms.

• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.

• Strong problem-solving skills and ability to lead a team

Develop, test and maintain high-quality solutions using PySpark /Python programming language.

· Participate in the entire software development lifecycle, building, testing and delivering high-quality

data pipelines.

· Collaborate with cross-functional teams to identify and solve complex problems.

· Write clean and reusable code that can be easily maintained and scaled.

· Keep up to date with emerging trends and technologies in Python development. Design and develop

business controls using AWS Glue and PySpark

· Integrate data from various sources into Amazon Redshift

· Optimize performance of data processing jobs and fine tune queries

Salary Range: $110,000 - $115,000 a Year

Job Tags

Full time,

Similar Jobs

Tri-State Orthopaedics

Medical Billing/Accounts Receivable Specialist Job at Tri-State Orthopaedics

 ...Orthopaedics & Sports Medicine, a well-respected and busy orthopaedic practice, is recruiting for an enthusiastic full-time Medical Billing/Accounts Receivable Specialist to become part of their already AWESOME Billing Department located in their North Hills Corporate... 

Teal Energi

Process Controls Engineer Job at Teal Energi

 ...Summary: The Process Controls Engineer is responsible for all control systems within the...  ...Implement controls changes in an operating environment (graphics, logic, alarm setpoints...  ...Prefer experience at an LNG facility, a refinery, or a petrochemical facility ~ Prefer... 

Tutor Doctor - North County San Diego

Tutor, AP History Job at Tutor Doctor - North County San Diego

Description of the role: As a Tutor for AP History at Tutor Doctor - North County San Diego, you will provide personalized, one-on-one tutoring sessions to high school students. This role requires a strong knowledge and understanding of AP History curriculum and the ability... 

EVE Energy Co.,Ltd.

Finance Accounting Intern Job at EVE Energy Co.,Ltd.

 ...reporting, budgeting, and forecasting activities Support monthly closings, account reconciliations, and expense tracking Conduct market and financial analysis to support strategic initiatives Help prepare presentations and reports for internal stakeholders... 

The Christopher Group, Agile HR Business Solutions

VP of People and Culture Job at The Christopher Group, Agile HR Business Solutions

Primary Duties and Responsibilities: Promotes superior guest service Develop partnerships with all departments to foster property goals and guest service excellence Provides strong leadership to the property by executing programs for team members which foster...