Databricks Engineer, Genie Spaces & Medallion Architecture - 1614
$89/hrActive
Job description
This is a remote position. Onsite/ Hybrid/ Remote: Remote Duration: 1 MonthRate Range: Upto $89/hr on C2C or $82/hr on W2 Work Authorization: GC, USC, All valid EADs except H1B, OPT, CPT Must Have: Advanced Databricks engineering experience Delta Lake Data ingestion from new and diverse sources Medallion Architecture: Bronze, Silver, Gold Databricks Genie Spaces Genie Space debugging, query tuning, and performance optimization Advanced SQL and Spark/PySpark Responsibilities: Build and support Databricks pipelines for new data source ingestion. Design and develop Bronze, Silver, and Gold data layers. Optimize Delta Lake tables, queries, and platform performance. Debug Genie Spaces and improve natural language query response quality. Tune underlying SQL and data models used by Genie Spaces. Support short-term delivery needs across the Databricks platform. Qualifications: Strong hands-on Databricks and Delta Lake engineering background. Proven experience building Medallion Architecture in production. Experience integrating multiple data sources into centralized data platforms. Direct experience with Databricks Genie Spaces is required. Strong SQL, Spark, and data performance tuning experience. Nice to Have: Unity Catalog Databricks workflows Data governance and observability Lakehouse migration experienceThis is a remote position. Onsite/ Hybrid/ Remote: Remote Duration: 1 MonthRate Range: Upto $89/hr on C2C or $82/hr on W2 Work Authorization: GC, USC, All valid EADs except H1B, OPT, CPT Must Have: Advanced Databricks engineering experience Delta Lake Data ingestion from new and diverse sources Medallion Architecture: Bronze, Silver, Gold Databricks Genie Spaces Genie Space debugging, query tuning, and performance optimization Advanced SQL and Spark/PySpark Responsibilities: Build and support Databricks pipelines for new data source ingestion. Design and develop Bronze, Silver, and Gold data layers. Optimize Delta Lake tables, queries, and platform performance. Debug Genie Spaces and improve natural language query response quality. Tune underlying SQL and data models used by Genie Spaces. Support short-term delivery needs across the Databricks platform. Qualifications: Strong hands-on Databricks and Delta Lake engineering background. Proven experience building Medallion Architecture in production. Experience integrating multiple data sources into centralized data platforms. Direct experience with Databricks Genie Spaces is required. Strong SQL, Spark, and data performance tuning experience. Nice to Have: Unity Catalog Databricks workflows Data governance and observability Lakehouse migration experience
This is a remote position.
Onsite/ Hybrid/ Remote: RemoteOnsite/ Hybrid/ Remote:Duration: 1 MonthRate Range: Upto $89/hr on C2C or $82/hr on W2Duration: 11MonthRate Range: Upto $89/hr on C2C or $82/hr on W2Rate Range: Upto$89/hr on C2C or $82/hr on W2$89/hr on C2C or $82/hr on W2$89/hr on C2C or $82/hr on W2$89/hr on C2C or $82/hr on W2Work Authorization: GC, USC, All valid EADs except H1B, OPT, CPTWork Authorization:Must Have:
Must Have:- Advanced Databricks engineering experience
- Delta Lake
- Data ingestion from new and diverse sources
- Medallion Architecture: Bronze, Silver, Gold
- Databricks Genie Spaces
- Genie Space debugging, query tuning, and performance optimization
- Advanced SQL and Spark/PySpark
Responsibilities:
Responsibilities:- Build and support Databricks pipelines for new data source ingestion.
- Design and develop Bronze, Silver, and Gold data layers.
- Optimize Delta Lake tables, queries, and platform performance.
- Debug Genie Spaces and improve natural language query response quality.
- Tune underlying SQL and data models used by Genie Spaces.
- Support short-term delivery needs across the Databricks platform.
Qualifications:
Qualifications:- Strong hands-on Databricks and Delta Lake engineering background.
- Proven experience building Medallion Architecture in production.
- Experience integrating multiple data sources into centralized data platforms.
- Direct experience with Databricks Genie Spaces is required.
- Strong SQL, Spark, and data performance tuning experience.
Nice to Have:
Nice to Have:- Unity Catalog
- Databricks workflows
- Data governance and observability
- Lakehouse migration experience
{{cxPropField.consent_details.description}}
{{record.Posting_Title}}{{record.Posting_Title}}{{record.Posting_Title}}{{record.Posting_Title}}
{{record.Posting_Title}}{{record.Posting_Title}}{{record.Posting_Title}}
{{record.Posting_Title}}- {{record.Posting_Title}}
{{record.Posting_Title}}
{{record.Posting_Title}}{{candidate.Email}}{{candidate.Email}}{{candidate.Email}}{{candidate.Email}}
{{topMessage}}Job DetailsJob DetailsJob DetailsJob Details{{topMessage}}previousnext{{title}} {{score}}% Job Description {{unescape(sanitizeHTML(descriptionHTML))}}{{title}} {{score}}% Job Description {{unescape(sanitizeHTML(descriptionHTML))}}{{title}} {{score}}%{{title}}
{{title}}{{score}}%Job Description {{unescape(sanitizeHTML(descriptionHTML))}}Job Description
{{message}}Step {{curStepInMandatorySecPrompt}}/{{totalNumOfStepsInMandatorySecPrompt}}
For privacy and security purposes, please go through the following points and provide consent.Accept DeclineAccept DeclineAcceptDecline{{getI18n("zr.careers.publicpage.meta.joblisting")}}{{getI18n("zr.careers.publicpage.meta.joblisting")}}- {{getI18n("zr.careers.publicpage.meta.joblisting")}}
- {{getI18n("zr.careers.publicpage.meta.joblisting")}}
{{getI18n("zr.questionnaire.question.information.heading")}}
{{getI18n("zr.cw.autofill.head")}} {{cxPropBodyMessage}} {{getI18n("zr.careers.autopopulate.success")}}{{getI18n("zr.cw.autofill.head")}}
{{cxPropBodyMessage}}
{{getI18n("zr.careers.autopopulate.success")}}{{getI18n("zr.cw.apply.sign",cxPropCompanyInfo.name)}}
{{getI18n('zr.eeo.questionnaire.portal.maintitle')}}{{botName}}{{botName}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}