Job description
Job SummaryThe Principal Data Engineer handles the design, development, and maintenance of data pipelines, ETL processes, and database management to support AI and data science initiatives. This role involves ensuring data quality, scalability, and performance across all data engineering activities.Responsibilities and DutiesDesign, develop, and maintain data pipelines, ETL processes, and database systems to support AI and data science initiatives.Collaborate with data scientists, AI/ML engineers, and other stakeholders to understand data requirements and ensure data availability and quality.Implement data governance, security, and regulatory standards in all data engineering activities.Optimize data pipelines and processes for scalability, performance, and cost-efficiency.Monitor and ensure the performance and reliability of data systems, identifying and resolving issues as needed.Stay updated with the latest advancements in data engineering technologies and best practices.Mentor and provide guidance to junior data engineers and other team members.Prepare and present data engineering reports and documentation to senior management and stakeholders.Participate in project planning and contribute to the development of project timelines and deliverables.Perform other duties relevant to the job as assigned by the Head of Data & AI Engineering or senior management.RequirementsBachelor’s degree in Data Engineering, Computer Science, or a related fieldRelevant certifications (e.g., Google Cloud Professional Data Engineer, AWS Certified Big Data – Specialty) are preferredMinimum of 8 years of experience in data engineering or related fieldsExperience in designing and implementing data pipelines, ETL processes, and database systems for AI or technology-focused productsStrong programming skills in languages such as Python, SQLProficiency in data engineering tools and frameworks (e.g., Apache Spark, Kafka)Excellent problem-solving and analytical skillsStrong communication and interpersonal skillsAttention to detail and commitment to qualityIn-depth understanding of data engineering principles, ETL processes, and database managementFamiliarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data servicesKnowledge of data governance, security, and regulatory standardsAbility to manage multiple tasks and prioritize effectivelyStrong attention to detail and commitment to delivering high-quality workAbility to work independently and as part of a teamProgramming languages (e.g., Python)Data engineering tools and frameworks (e.g., Apache Spark, Kafka)Cloud platforms (e.g., AWS, Azure, Google Cloud)Data management systems (e.g., SQL, NoSQL databases)Collaboration and communication tools (e.g., Slack, Microsoft Teams)