Technology Lead - Databricks

ActiveVerified 2d ago

Job description

Infosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong expertise in Azure data services, Databricks, PySpark, and modern data engineering practices to support enterprise analytics and data modernization initiatives.Required QualificationsInfosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong expertise in Azure data services, Databricks, PySpark, and modern data engineering practices to support enterprise analytics and data modernization initiatives.Required QualificationsAzure Databricks Data EngineerRequired Qualifications

Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.

Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.

Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.

Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.

At least 4 years of Information Technology experience

At least 4 years of Information Technology experienceAt least 4 years of Information Technology experience

Candidate must be located within commuting distance of Mississauga, ON / Calgary, AB / Burnaby, BC or be willing to relocate to one of these areas. This position may require travel.

Candidate must be located within commuting distance of Mississauga, ON / Calgary, AB / Burnaby, BC or be willing to relocate to one of these areas. This position may require travel.Candidate must be located within commuting distance of Mississauga, ON / Calgary, AB / Burnaby, BC or be willing to relocate to one of these areas. This position may require travel.Mississauga, ON / Calgary, AB / Burnaby, BCPreferred QualificationsPreferred QualificationsPreferred Qualifications

Design and develop scalable ETL/ELT pipelines using Azure Databricks and PySpark.

Design and develop scalable ETL/ELT pipelines using Azure Databricks and PySpark.Design and develop scalable ETL/ELT pipelines using Azure Databricks and PySpark.

Build and maintain data ingestion frameworks using Azure Data Factory (ADF).

Build and maintain data ingestion frameworks using Azure Data Factory (ADF).Build and maintain data ingestion frameworks using Azure Data Factory (ADF).

Develop batch and real-time data processing solutions using Spark and Event Hubs.

Develop batch and real-time data processing solutions using Spark and Event Hubs.Develop batch and real-time data processing solutions using Spark and Event Hubs.

Implement Delta Lake and Medallion Architecture (Bronze, Silver, Gold).

Implement Delta Lake and Medallion Architecture (Bronze, Silver, Gold).Implement Delta Lake and Medallion Architecture (Bronze, Silver, Gold).

Optimize Databricks workloads for performance, scalability, and cost efficiency.

Optimize Databricks workloads for performance, scalability, and cost efficiency.Optimize Databricks workloads for performance, scalability, and cost efficiency.

Develop data quality, validation, and reconciliation frameworks.

Develop data quality, validation, and reconciliation frameworks.Develop data quality, validation, and reconciliation frameworks.

Collaborate with business, analytics, and data science teams to deliver data solutions.

Collaborate with business, analytics, and data science teams to deliver data solutions.Collaborate with business, analytics, and data science teams to deliver data solutions.

Implement security, governance, and access controls using Unity Catalog and RBAC.

Implement security, governance, and access controls using Unity Catalog and RBAC.Implement security, governance, and access controls using Unity Catalog and RBAC.

Build CI/CD pipelines and automate deployments for data platforms.

Build CI/CD pipelines and automate deployments for data platforms.Build CI/CD pipelines and automate deployments for data platforms.

Troubleshoot production issues and support ongoing operational excellence.

Troubleshoot production issues and support ongoing operational excellence.Troubleshoot production issues and support ongoing operational excellence.Preferred CertificationsPreferred CertificationsPreferred Certifications

Microsoft Certified: Azure Data Engineer Associate (DP-203)

Microsoft Certified: Azure Data Engineer Associate (DP-203)Microsoft Certified: Azure Data Engineer Associate (DP-203)

Microsoft Azure Fundamentals (AZ-900)

Microsoft Azure Fundamentals (AZ-900)Microsoft Azure Fundamentals (AZ-900)

Databricks Certified Data Engineer Associate/Professional

Databricks Certified Data Engineer Associate/ProfessionalDatabricks Certified Data Engineer Associate/ProfessionalThe job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements.Estimated annual compensation range for the candidate based in the below location will be:Ontario - $ 92740 to $ 123375British Columbia - $ 90450 to $ 136500The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements.Estimated annual compensation range for the candidate based in the below location will be:Ontario - $ 92740 to $ 123375British Columbia - $ 90450 to $ 136500

Additional Required Qualifications

Additional Required Qualifications

• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.•Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.

About Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem. EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.

About UsEEO