AWS Senior Data Engineer - Glue, SQL, Python

Job Summary

The Senior Developer is responsible for managing and developing solutions using Amazon Glue, SQL, Python, and DevOps practices. The role involves implementing, and maintaining data pipelines and ETL processes to support business objectives efficiently.

Key Responsibilities

1. Develop and maintain data transformation processes using amazon glue for etl workflows.
2. Write complex sql queries to extract and analyze data from various databases and sources.
3. Build scalable and efficient python scripts for data processing and automation tasks.
4. Implement devops solutions to automate deployment, monitoring, and maintenance processes.
5. Collaborate within team to design and implement data solutions that meet business requirements.
6. Troubleshoot and optimize existing data pipelines for improved performance and reliability.
7. Stay updated with the latest industry trends and technologies related to data engineering and software development.

Skill Requirements

1. Proficiency in amazon glue for etl workflows and data processing.
2. Strong sql skills for querying, analyzing, and manipulating data.
3. Advanced knowledge of python programming for scripting and automation.
4. Experience with devops tools and practices for continuous integration and deployment.
5. Understanding of data modeling, data warehousing, and data lake concepts.
6. Good problem-solving and analytical abilities.
7. Strong communication and team collaboration skills.

Other Requirements

1.Relevant certifications in AWS, Python, SQL, or DevOps are a plus.