Senior Staff Data Engineer (Data & AI solutions)

Palo Alto NetworksPetah Tikva, 02, ILSenior
ActiveVerified 4h ago

Job description

Our Mission

At Palo Alto Networks®, we’re united by a shared mission—to protect our digital way of life. We thrive at the intersection of innovation and impact, solving real-world problems with cutting-edge technology and bold thinking. Here, everyone has a voice, and every idea counts. If you’re ready to do the most meaningful work of your career alongside people who are just as passionate as you are, you’re in the right place.

Who We Are

In order to be the cybersecurity partner of choice, we must trailblaze the path and shape the future of our industry. This is something our employees work at each day and is defined by our values: Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the impact every individual can have. If you are passionate about solving real-world problems and ideating beside the best and the brightest, we invite you to join us!

We believe collaboration thrives in person. That’s why most of our teams work from the office full time, with flexibility when it’s needed. This model supports real-time problem-solving, stronger relationships, and the kind of precision that drives great outcomes.

Job Summary

IDIRA by Palo Alto Networks seeks an experienced Senior Staff Data Engineer to join our AI and Data Solutions unit and champion an AI-first strategy. You will spearhead the development of Data Lakehouse processes, model core product domains, and define data engineering best practices across the organization. Serving as a technical project lead, you will provide strong direction and collaborate with Data Science, Analytics, R&D, and IT teams to elevate onboarding workflows. This role demands a proactive approach to optimizing system capabilities and driving cross-functional data initiatives.

Key Responsibilities

  • Own the design, implementation, and optimization of scalable Data Lakehouse and Data Warehouse architectures across diverse cloud ecosystems.
  • Spearhead the development of robust ETL/ELT pipelines and data ingestion processes utilizing SQL, Python, PySpark, and DBT.
  • Apply advanced data modelling techniques to structure complex data assets into optimized facts, dimensions, and partitions.
  • Partner with cross-functional leadership across data science, analytics, R&D, and IT to identify requirements and improve workflows.
  • Orchestrate complex data workflows combining tools like Airflow and DBT with advanced Gen-AI development workflows using CloudCode.
  • Define, document, and popularize data engineering best practices, design patterns, and data quality standards across the unit.
  • Evaluate and implement modern data technologies spanning vendor-specific and open-source landscapes including GCP, AWS, and Apache Iceberg.
  • Provide technical direction and hands-on guidance to ensure high-performance execution, reliable pipeline delivery, and proactive problem-solving.

Qualifications

Required Qualifications

  • 5+ years of experience with advanced data modeling techniques and concepts (e.g., Facts, Dimensions, Partitions).
  • 5+ years of experience designing and implementing end-to-end data ingestion and ETL processes within Data Lakehouse architectures.
  • 5+ years of hands-on experience programming in SQL and Python, PySpark, Java, or Scala.
  • Demonstrated experience leading technical projects, driving stakeholder alignment, and navigating cross-functional dynamics.
  • Proven experience working within cloud environments (AWS or GCP), with a strong requirement for AWS.
  • Deep understanding of the modern data landscape and open-source tools (e.g., Iceberg, DBT, Airflow).
  • Proven capability in using and orchestrating Gen-AI workflows based on CloudCode and Cursor.

Preferred Qualifications

  • Deep expertise in the AWS ecosystem, including Glue, Athena, SageMaker, and EMR.
  • Advanced experience with Data Warehouse technologies, especially Apache Iceberg or BigQuery.
  • Leadership or mentorship experience within a data engineering or analytics unit.
  • Background or domain knowledge in cybersecurity is a strong advantage.

Our Commitment

We’re trailblazers that dream big, take risks, and challenge cybersecurity’s status quo. It’s simple: we can’t accomplish our mission without diverse teams innovating, together.

We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at [email protected].

Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

All your information will be kept confidential according to EEO guidelines.

Is role eligible for Immigration Sponsorship? No. Please note that we will not sponsor applicants for work visas for this position.

Similar jobs

General information Job Title Data Solutions Architect Ref # 9532 Location Edinburgh - 2 South Gyle Crescent, Edinburgh, EH12 9FQ Department IMS - Architecture Business Area Architecture Working time Full-Time Date Published 22-04-2026 Serving our customers, communities, and planet a little better every day. Salary – Between £80,000 – £90,000 + annual bonus & benefits Work Level – 2 Location – Edinburgh, Permanent Office Attendance – Our roles are hybrid; however, you should be able to travel to our Edinburgh office 2 days per week for this position. Closing Date – Applications close 6th May at 5pm We’re looking for a Data Architect to play a key role in shaping and delivering data services utilising our new Microsoft Fabric data platform within Tesco Insurance and Money Services. This is a pivotal role at a critical point in our data journey. You’ll provide key technical and architectural skills across data modelling, analytics and platform design, ensuring our data foundations are robust, governed and built for long term use. You’ll work closely with engineers, analysts, product teams and senior stakeholders to translate business and regulatory needs into clear, scalable data architectures. The role combines strategic design with a particular focus on high quality conceptual, logical and physical data models that underpin analytics, reporting, AI and operational use cases across the organisation. What you’ll be doing • Define and own data architecture patterns, standards and target state designs for our Microsoft Fabric platform, ensuring consistency across ingestion, storage, semantic modelling and consumption layers. • Lead the design and governance of enterprise and domain data models, from conceptual and logical models through to physical implementations optimised for Fabric (Lakehouse, Warehouse and semantic models). • Partner with data engineers, analytics engineers and platform teams to ensure data models are correctly implemented, performant and aligned to architectural intent. • Shape and assure the semantic layer (e.g. shared dimensions, facts and metrics), enabling trusted, reusable analytics and reducing duplication across teams. • Work with Product, Business and Data Owners to translate business concepts, KPIs and regulatory requirements into clear, well governed data structures. • Embed data quality, lineage, metadata and lifecycle management into all designs, aligned to data governance, privacy and regulatory obligations. • Provide architectural assurance across change initiatives, balancing speed of delivery with long term data integrity, resilience and operational sustainability. • Mentor and coach engineers and analysts on data modelling best practice, raising overall data architecture maturity across the organisation. We need you to have • Proven experience as a Data Architect working across modern analytics and data platforms. • Strong, hands on expertise in data modelling, including: o Conceptual and logical enterprise data models o Dimensional modelling (facts, dimensions, star/snowflake schemas) o Experience designing semantic layers for self service analytics • Experience designing data architectures on cloud based platforms, ideally Microsoft Fabric, Azure Synapse, or equivalent lakehouse style platforms. • Deep understanding of how data models support analytics, reporting, AI/ML and operational use cases, not just storage. • Ability to work effectively in Agile and product led environments, providing clear architectural direction without becoming a delivery bottleneck. • Strong stakeholder engagement skills, with the ability to explain complex data concepts clearly to both technical and non technical audiences. And if you have any of these, even better • Experience working in regulated or customer critical environments (e.g. financial services, insurance), with an understanding of data risk, privacy and regulatory constraints. • Knowledge of Microsoft Fabric components such as Lakehouse, Warehouse, Data Factory, OneLake and Power BI semantic models. • Experience aligning data architecture with data governance, ownership models and operating frameworks. • Background supporting or enabling AI / advanced analytics through well designed data foundations. What’s in it for you • Colleague pension scheme to support your future. • Private Medical Insurance (WL2+) and Virtual GP service for you and your family. • Performance related annual bonus. • Generous holiday allowance – minimum 7.2 weeks, with options to buy more. • Colleague Clubcard with up to 15% discount and a second card to share. • Enhanced family friendly policies, including maternity, shared parental and paternity leave. • Access to award winning learning and development opportunities to support your long term career. • Buy as You Earn and Save As You Earn share schemes. Everyone’s welcome We want all our colleagues to feel welcome and be themselves. We’re committed to building a more inclusive workplace and celebrating the diversity that makes us stronger. Interviews We know the importance of balancing work with life’s other commitments. Please talk to us at interview about the flexibility you need, as we’re committed to exploring part time and flexible working opportunities, at every level of the organisation. Interviews are expected to be held shortly after closing date. Why Tesco Insurance and Money Services? Seeing your impact all around you: there's no better feeling.Lucky for us, we get to feel it all the time. Because whatever our role, we're helping our colleagues and serving our customers, communities and planet a little better every day. We deal in the personal – from pet insurance for your best friend, and home insurance for peace of mind, to motor insurance for your dream car or travel money for that trip you’ve worked hard for.Everything we do is about making things better. Not just for others, but for you too. It's why you'll get bags of choice and plenty of development. It's why you'll always be heard and find balance that works for you. It's why you'll feel totally at home in a place where everyone's welcome.So, if you want a career where you can do good and feel good, you've found it. Let's make everyday a little better. Our story Making Insurance and Money Services more rewarding and offering great value and choice - because we know little wins can make a big difference.We began life in 1997 and now help more than 2 million customers protect what matters to them. We want to deliver a helpful service in everything we do and to make life easier for our customers. Our policies are really easy to manage online for our customers, but we know that being able to speak to our customer service staff when you need to is really important. This is why our customer service centres are open seven days a week.Delivering great customer service means having great people behind the scenes – people who understand our customers and are driven by doing the right thing for them. We offer colleagues a place where they can feel totally at home in a place where everyone's welcome, where they can be part of a great team focused on making a real difference for our customers. How to apply We value our people and diverse teams and believe the variety of backgrounds and experiences make us stronger to achieve our goals. Our colleagues are working hybrid, taking time to meet with colleagues in our offices for moments that matter, such as team catch ups, planning meetings and more. If you’re interested in finding out more about what a career at Tesco Insurance and Money Services looks like, click apply to find out more! Back to job list Apply

TescoEdinburgh - 2 South Gyle Crescent, Edinburgh, EH12 9FQ
full-timeSenior£80K–90K
Verified 12h agoPosted 5 months ago