Senior Associate/ Manager - AWS Data Engineer (Contractual Role)

Location

Responsibilities

• Design, develop, and deploy data engineering solutions on AWS, leveraging AWS services such as S3, DynamoDB, and Redshift.
• Develop and maintain ETL processes using PySpark and AWS Glue, ensuring data quality and integrity.
• Collaborate with cross-functional teams to design and implement data pipelines, ensuring seamless integration with existing systems.
• Develop and maintain CI/CD pipelines using tools such as Jenkins or AWS CodePipeline, ensuring efficient and automated deployment of data engineering solutions.
• Write efficient and scalable SQL queries to extract insights from large datasets, using tools such as AWS Redshift or Amazon Athena.
• Troubleshoot and resolve issues related to data engineering solutions, ensuring minimal downtime and maximum uptime.
• Stay up-to-date with the latest AWS services and features, and apply this knowledge to improve existing solutions and develop new ones.

Requirements

• 6-13 years of experience in data engineering, with a focus on AWS and AWS services.
• Strong experience in developing and deploying data engineering solutions using Python, PySpark, and AWS Glue.
• Excellent knowledge of SQL and ability to write efficient and scalable queries.
• Experience with CI/CD pipelines and tools such as Jenkins or AWS CodePipeline.
• Strong understanding of cloud computing and data engineering principles.
• Excellent problem-solving skills and ability to troubleshoot complex issues.
• Strong communication and collaboration skills, with the ability to work with cross-functional teams.