Technology Lead - Databricks Admin

InfosysMississauga
ActiveVerified 2d ago

Job description

Infosys is seeking an experienced Databricks Administrator with strong expertise in managing, securing, and optimizing Databricks environments on cloud platform: AWS. The ideal candidate should have hands-on experience in cloud database administration, cluster management, workspace governance, performance optimization, CI/CD integrations, and platform reliability.The role supports our client’s enterprise data modernization initiatives by ensuring a robust, scalable, and secure Databricks platform for analytics and engineering teams.Required Qualifications:

Infosys is seeking an experienced Databricks Administrator with strong expertise in managing, securing, and optimizing Databricks environments on cloud platform: AWS. The ideal candidate should have hands-on experience in cloud database administration, cluster management, workspace governance, performance optimization, CI/CD integrations, and platform reliability.The role supports our client’s enterprise data modernization initiatives by ensuring a robust, scalable, and secure Databricks platform for analytics and engineering teams.Required Qualifications:Infosys is seeking an experienced Databricks Administrator with strong expertise in managing, securing, and optimizing Databricks environments on cloud platform: AWS. The ideal candidate should have hands-on experience in cloud database administration, cluster management, workspace governance, performance optimization, CI/CD integrations, and platform reliability.The role supports our client’s enterprise data modernization initiatives by ensuring a robust, scalable, and secure Databricks platform for analytics and engineering teams.Required Qualifications:Infosys isInfosys isDatabricks AdministratorRequired Qualifications:Required Qualifications:
  • Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
  • Candidate must be located within commuting distance of Mississauga, Ontario or be willing to relocate to the areas.
Candidate must be located within commuting distance of Mississauga, Ontario or be willing to relocate to the areas.Candidate must be located within commuting distance of Mississauga, Ontario or be willing to relocate to the areas.Candidate must be located within commuting distance of Mississauga, Ontario or be willing to relocate to the areas.Mississauga, Ontario
  • Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • At least 4 years of Information Technology experience
At least 4 years of Information Technology experienceAt least 4 years of Information Technology experiencePreferred Qualifications:Preferred Qualifications:Preferred Qualifications:Preferred Qualifications:
  • 6+ years of experience in cloud-based database and platform administration (AWS/Azure).
6+ years of experience in cloud-based database and platform administration (AWS/Azure).6+ years of experience in cloud-based database and platform administration (AWS/Azure).cloud-based database and platform administration
  • 3+ years hands-on experience administering Databricks environments.
3+ years hands-on experience administering Databricks environments.3+ years hands-on experience administering Databricks environments.Databricks environments
  • Strong understanding of autoscaling, job orchestration, and pipeline execution.
Strong understanding of autoscaling, job orchestration, and pipeline execution.Strong understanding of autoscaling, job orchestration, and pipeline execution.
  • Deep knowledge of cloud storage, networking basics, IAM, and security best practices.
Deep knowledge of cloud storage, networking basics, IAM, and security best practices.Deep knowledge of cloud storage, networking basics, IAM, and security best practices.cloud storage
  • Experience with Delta Lake, Unity Catalog, and workspace governance.
Experience with Delta Lake, Unity Catalog, and workspace governance.Experience with Delta Lake, Unity Catalog, and workspace governance.Delta Lake, Unity Catalog
  • Proficiency in scripting (Python, Shell, PowerShell) for automation.
Proficiency in scripting (Python, Shell, PowerShell) for automation.Proficiency in scripting (Python, Shell, PowerShell) for automation.
  • Experience with monitoring tools and log analytics (CloudWatch, Azure Monitor, Databricks Logs).
Experience with monitoring tools and log analytics (CloudWatch, Azure Monitor, Databricks Logs).Experience with monitoring tools and log analytics (CloudWatch, Azure Monitor, Databricks Logs).
  • Familiarity with DevOps and CI/CD (GitHub Actions, Azure DevOps, Jenkins).
Familiarity with DevOps and CI/CD (GitHub Actions, Azure DevOps, Jenkins).Familiarity with DevOps and CI/CD (GitHub Actions, Azure DevOps, Jenkins).
  • Databricks certifications (Admin, Associate Data Engineer, or Architect).
Databricks certifications (Admin, Associate Data Engineer, or Architect).Databricks certifications (Admin, Associate Data Engineer, or Architect).
  • Understanding of data engineering, ETL/ELT workflows, and big data concepts.
Understanding of data engineering, ETL/ELT workflows, and big data concepts.Understanding of data engineering, ETL/ELT workflows, and big data concepts.Key Responsibilities:Key Responsibilities:Key Responsibilities:Key Responsibilities:Databricks Platform & Workspace AdministrationDatabricks Platform & Workspace AdministrationDatabricks Platform & Workspace AdministrationDatabricks Platform & Workspace Administration
  • Manage and administer Databricks workspaces, clusters, pools, jobs, and user access controls.
Manage and administer Databricks workspaces, clusters, pools, jobs, and user access controls.Manage and administer Databricks workspaces, clusters, pools, jobs, and user access controls.Databricks workspaces
  • Implement and enforce cluster policies, workspace best practices, and governance standards.
Implement and enforce cluster policies, workspace best practices, and governance standards.Implement and enforce cluster policies, workspace best practices, and governance standards.cluster policies
  • Oversee Libraries, Repos, and Job scheduling within Databricks.
Oversee Libraries, Repos, and Job scheduling within Databricks.Oversee Libraries, Repos, and Job scheduling within Databricks.Libraries, Repos, and Job scheduling
  • Monitor and optimize runtime versions, cluster configurations, and performance.
Monitor and optimize runtime versions, cluster configurations, and performance.Monitor and optimize runtime versions, cluster configurations, and performance.Operational SupportOperational SupportOperational Support
  • Provide L2/L3 support for platform issues, job failures, cluster outages, and scheduled maintenance.
Provide L2/L3 support for platform issues, job failures, cluster outages, and scheduled maintenance.Provide L2/L3 support for platform issues, job failures, cluster outages, and scheduled maintenance.
  • Collaborate with Data Engineering, Security, Cloud Infra, and Governance teams.
Collaborate with Data Engineering, Security, Cloud Infra, and Governance teams.Collaborate with Data Engineering, Security, Cloud Infra, and Governance teams.
  • Support upgrades, migrations, patching, and operational improvements.
Support upgrades, migrations, patching, and operational improvements.Support upgrades, migrations, patching, and operational improvements.​​​​​​​DevOps, Automation & CI/CD​​​​​​​DevOps, Automation & CI/CDDevOps, Automation & CI/CD
  • Automate deployment processes using Git-based workflows (Repos/GitHub).
Automate deployment processes using Git-based workflows (Repos/GitHub).Automate deployment processes using Git-based workflows (Repos/GitHub).
  • Develop and maintain scripts for workspace automation.
Develop and maintain scripts for workspace automation.Develop and maintain scripts for workspace automation.
  • Manage CI/CD pipelines for notebooks, jobs, and Delta pipelines.
Manage CI/CD pipelines for notebooks, jobs, and Delta pipelines.Manage CI/CD pipelines for notebooks, jobs, and Delta pipelines.Performance Monitoring & OptimizationPerformance Monitoring & OptimizationPerformance Monitoring & Optimization
  • Troubleshoot cluster performance issues, job failures, and resource utilization.
Troubleshoot cluster performance issues, job failures, and resource utilization.Troubleshoot cluster performance issues, job failures, and resource utilization.
  • Optimize Spark configurations, autoscaling parameters, and workload management.
Optimize Spark configurations, autoscaling parameters, and workload management.Optimize Spark configurations, autoscaling parameters, and workload management.
  • Monitor audit logs, job runs, compute usage, and cost trends.
Monitor audit logs, job runs, compute usage, and cost trends.Monitor audit logs, job runs, compute usage, and cost trends.Security, Compliance & Access ManagementSecurity, Compliance & Access ManagementSecurity, Compliance & Access Management
  • Implement role-based access control (RBAC) and workspace governance aligned with corporate security standards.
Implement role-based access control (RBAC) and workspace governance aligned with corporate security standards.Implement role-based access control (RBAC) and workspace governance aligned with corporate security standards.role-based access control (RBAC)
  • Manage secrets, tokens, service principals, and integration with Azure AD / AWS IAM.
Manage secrets, tokens, service principals, and integration with Azure AD / AWS IAM.Manage secrets, tokens, service principals, and integration with Azure AD / AWS IAM.Azure AD / AWS IAM
  • Ensure compliance with data protection, logging, audit requirements, and enterprise governance.
Ensure compliance with data protection, logging, audit requirements, and enterprise governance.Ensure compliance with data protection, logging, audit requirements, and enterprise governance.​​​​​​​Cloud & Database Administration​​​​​​​Cloud & Database AdministrationCloud & Database Administration
  • Administer cloud-based databases (AWS/Azure), including provisioning, performance tuning, maintenance, and monitoring.
Administer cloud-based databases (AWS/Azure), including provisioning, performance tuning, maintenance, and monitoring.Administer cloud-based databases (AWS/Azure), including provisioning, performance tuning, maintenance, and monitoring.
  • Manage S3 / ADLS storage integrations, mount points, permissions, and lifecycle policies.
Manage S3 / ADLS storage integrations, mount points, permissions, and lifecycle policies.Manage S3 / ADLS storage integrations, mount points, permissions, and lifecycle policies.S3 / ADLS storage integrations
  • Support ingestion frameworks and ETL/ELT workflows using Spark, Delta Lake, and Databricks Asset Bundles (optional).
Support ingestion frameworks and ETL/ELT workflows using Spark, Delta Lake, and Databricks Asset Bundles (optional).Support ingestion frameworks and ETL/ELT workflows using Spark, Delta Lake, and Databricks Asset Bundles (optional).The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirementsEstimated annual compensation range for the candidate based in the below location will be:Ontario: $ 92740 to $ 123375The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirementsEstimated annual compensation range for the candidate based in the below location will be:Ontario: $ 92740 to $ 123375The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirementsEstimated annual compensation range for the candidate based in the below location will be:Ontario:The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirementsOntario:

Additional Required Qualifications

Additional Required Qualifications

Databrick Administration AWS/Azure SQL Database Administration

About Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem. EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.

About UsEEO