Data Sustain Lead

Role description

Job description

The Sustain Engineer is responsible for BAU operations and L2L3 sustain support of the Customer Customer Marketing Data Layer data platform including automated monitoring incident triage DQ checks ETLpipeline troubleshooting and knowledge management The engineer will operate against the target sustain state automated monitoring via AWS Lambda SP mailer ServiceNowdriven incident management ConfluenceKEDBbased knowledge management chaostested resilience and be part of a rotational 24x7 shift model with US EST overlap Prior experience in a Support Program Project Application Data or Platform Sustain is strongly preferred

Must Have

BAU monitoring of data pipelines and marts health checks batch job monitoring SLA tracking

Incident triage and resolution using ServiceNow P1P4 adherence to response and resolution SLAs

ETL Data pipeline troubleshooting SAP BODS Informatica IICS Airflow Snowflake tasks streams

SQLbased root cause analysis and data reconciliation across source and target

Execution and continual improvement of runbooks SOPs and KEDB articles

Support automated monitoring ing stack AWS Lambda SP mailer CloudWatch custom DQ s

Change management via ServiceNow implementation verification and rollback of scheduled changes

Problem Management RCA authoring permanent fix tracking postincident review contribution

Knowledge Management creation and upkeep of Confluence pages KEDB entries runbooks

Scripting for automation and selfhealing Python Shell PowerShell

Willingness to work in rotational 24x7 shifts with US EST overlap and oncall rotation

Clear communication with onshore business stakeholders during incidents and status reviews

Nice to Have

Prior experience in an Application Data Platform Support Program or Project

Exposure to Snowflake administration Airflow DAG debugging dbt tests

AWS Cloud fundamentals Lambda S3 CloudWatch IAM

Chaos engineering Chaos Monkey testing exposure

Data Quality frameworks Great Expectations Soda custom SQL DQ suites

Banking BFSI domain exposure especially Customer Marketing data