Data Engineer

Job Description

Summary

Our client is seeking a Data Engineer with extensive AWS and Python/PySpark expertise to design, build, and optimize scalable data pipelines. This role supports enterprise analytics, reporting, and data product initiatives while ensuring data quality and operational excellence.

Key Responsibilities

• Build and maintain ETL pipelines using Python and PySpark on AWS compute services.
• Orchestrate workflows using AWS Step Functions, Lambda, and serverless components.
• Implement messaging and event-driven integrations using AWS SNS and SQS.
• Design, optimize, and maintain data storage and querying in Amazon Redshift.
• Develop performant SQL for transformations, validations, and reporting.
• Ensure data quality, monitoring, and error resolution across data pipelines.
• Collaborate with data users and technical teams to translate requirements into scalable solutions.
• Contribute to CI/CD workflows, infrastructure-as-code practices, and deployment documentation.

Required Qualifications

• 9+ years of relevant experience in data engineering.
• Strong proficiency with Python and PySpark for large-scale data processing.
• Hands-on experience with AWS services including Lambda, SNS, SQS, Glue, Redshift, and Step Functions.
• Solid SQL skills with experience in data modeling and query optimization.
• Experience with ETL best practices, data quality controls, and pipeline monitoring.
• Familiarity with Git and CI/CD workflows.

Tech Stack

• Python
• PySpark
• AWS Glue
• AWS Lambda
• AWS SNS/SQS
• Amazon Redshift
• AWS Step Functions
• SQL
• Git
• CI/CD

Compensation & Benefits

Competitive compensation aligned with market standards.
Health benefits, PTO, remote flexibility (varies by client).

Work Schedule

Monday–Friday, flexible hours, occasional on-call (if applicable).

About the Client

Our client is a growing technology-focused organization committed to building scalable digital solutions.

Why Join the Team?

• Work with modern AWS-native data technologies.
• Drive high-impact analytics and data engineering initiatives.
• Collaborative environment with opportunities for technical innovation.

How to Apply

Submit your resume to people@ignitetalentpartners.com. Shortlisted candidates will be contacted.