Data Engineer AWS | Python, SQL, Redshift & Data Lake

InfosysSao PauloMid Level
ActiveVerified 2d ago

Job description

Infosys Brazil is looking for professionals with a Senior AWS Data Engineer | Python, SQL, Redshift & Data Lake profile to join our team.Required Qualifications

Required Qualifications
  • Strong experience in Data Engineering within AWS environments.
Strong experience in Data Engineering within AWS environments.
  • Hands-on experience with Amazon S3, Amazon Redshift, AWS Lambda, and AWS Step Functions.
Hands-on experience with Amazon S3, Amazon Redshift, AWS Lambda, and AWS Step Functions.
  • Proven expertise in designing, developing, and maintaining scalable ETL/ELT data pipelines.
Proven expertise in designing, developing, and maintaining scalable ETL/ELT data pipelines.
  • Strong proficiency in Python for data processing, automation, and application development.
Strong proficiency in Python for data processing, automation, and application development.
  • Advanced SQL skills and solid understanding of Data Warehouse concepts.
Advanced SQL skills and solid understanding of Data Warehouse concepts.
  • Experience integrating data from REST APIs and JSON-based services.
Experience integrating data from REST APIs and JSON-based services.
  • Strong knowledge of data modeling and analytical schema design.
Strong knowledge of data modeling and analytical schema design.
  • Experience working with Medallion Architecture (Bronze, Silver, and Gold layers).
Experience working with Medallion Architecture (Bronze, Silver, and Gold layers).
  • Advanced English communication skills, with the ability to collaborate effectively in a global environment.
Advanced English communication skills, with the ability to collaborate effectively in a global environment.
  • Ability to work independently and interact directly with clients and cross-functional teams.
Ability to work independently and interact directly with clients and cross-functional teams.

Preferred Qualifications

Preferred Qualifications
  • Experience with AWS Glue, Amazon Athena, and Amazon EMR.
Experience with AWS Glue, Amazon Athena, and Amazon EMR.
  • Knowledge of data quality, monitoring, and observability tools.
Knowledge of data quality, monitoring, and observability tools.
  • Experience with event-driven architectures.
Experience with event-driven architectures.
  • Hands-on experience with streaming data pipelines using Kafka or Amazon Kinesis.
Hands-on experience with streaming data pipelines using Kafka or Amazon Kinesis.
  • Knowledge of CI/CD practices for data workflows and data platforms.
Knowledge of CI/CD practices for data workflows and data platforms.
  • Experience with Infrastructure as Code (Terraform or AWS CloudFormation).
Experience with Infrastructure as Code (Terraform or AWS CloudFormation).
  • Experience delivering enterprise Analytics and Data Lake solutions.
Experience delivering enterprise Analytics and Data Lake solutions.

Roles and Responsibilities

Roles and Responsibilities
  • Design, develop, and optimize data pipelines within AWS environments.
Design, develop, and optimize data pipelines within AWS environments.
  • Build and maintain data ingestion processes from APIs and various internal and external data sources.
Build and maintain data ingestion processes from APIs and various internal and external data sources.
  • Transform, process, and deliver data for analytical consumption using Amazon Redshift.
Transform, process, and deliver data for analytical consumption using Amazon Redshift.
  • Ensure data quality, integrity, availability, and governance across the entire data lifecycle.
Ensure data quality, integrity, availability, and governance across the entire data lifecycle.
  • Develop monitoring, alerting, and error-handling mechanisms for data pipelines.
Develop monitoring, alerting, and error-handling mechanisms for data pipelines.
  • Optimize storage, query performance, and processing efficiency across Data Lake and Data Warehouse platforms.
Optimize storage, query performance, and processing efficiency across Data Lake and Data Warehouse platforms.
  • Collaborate closely with Data Analysts, Data Scientists, Architects, and business stakeholders.
Collaborate closely with Data Analysts, Data Scientists, Architects, and business stakeholders.
  • Create and maintain technical documentation for data models, integrations, and pipeline processes.
Create and maintain technical documentation for data models, integrations, and pipeline processes.
  • Lead technical discussions with clients and global teams, ensuring successful delivery of data solutions.
Lead technical discussions with clients and global teams, ensuring successful delivery of data solutions.

Additional Information

Additional Information

Employment Type

Employment Type
  • Full-time, permanent position (CLT).
Full-time, permanent position (CLT).
  • Flexible working hours.
Flexible working hours.

Benefits

Benefits
  • Transportation allowance.
Transportation allowance.
  • Meal voucher.
Meal voucher.
  • Childcare assistance.
Childcare assistance.
  • Life insurance.
Life insurance.
  • Funeral assistance.
Funeral assistance.
  • Medical insurance.
Medical insurance.
  • Dental insurance.
Dental insurance.

Career Opportunities

Career Opportunities
  • Exposure to both national and international projects.
Exposure to both national and international projects.
  • Opportunity to work with global clients and multicultural teams.
Opportunity to work with global clients and multicultural teams.
  • Potential for international career mobility within Infosys.
Potential for international career mobility within Infosys.

Language Requirements

Language Requirements
  • Advanced English proficiency for collaboration with international stakeholders and global teams.
Advanced English proficiency for collaboration with international stakeholders and global teams.

About UsInfosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem. EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.

About UsEEO

Similar jobs