Aller au contenu
Toutes les missions
Veille marché · Freework Publiée il y a 1 semaine

Databricks Data Engineer

++Senior MDM / Databricks Data Engineer++Experience: 6--10+ YearsKey Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data GovernanceRole S...

Entreprise Response Informatics
Mode Royaume-Uni

Résumé

<p><strong>&#43;&#43;Senior MDM / Databricks Data Engineer&#43;&#43;</strong></p><br /><p><strong>Experience:</strong> 6--10&#43; Years</p><br /><p><strong>Key Skills:</strong> MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance</p><br /><p>Role Summary</p><br /><p>We are looking for an experienced <strong>MDM / Databricks Data Engineer</strong> to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on <strong>common IDs, Golden Records, entity resolution, data quality, governance, and cross-platform data integration</strong>.</p><br /><p>Key Responsibilities</p><br /><p>· Design and implement <strong>MDM solutions</strong>, including common IDs, Golden Records, entity matching, deduplication, and survivorship rules.</p><br /><ul><br /><li>Integrate data from multiple source systems into the <strong>Databricks Lakehouse</strong>.</li><br /><li>Develop and optimize data pipelines using <strong>Databricks, PySpark, SQL, and Delta Lake</strong>.</li><br /><li>Build and enhance <strong>Bronze, Silver, and Gold</strong> data layers.</li><br /><li>Implement <strong>data quality, standardization, reconciliation, and validation</strong> processes.</li><br /><li>Support <strong>Unity Catalog, data lineage, access controls, cataloguing, and data governance</strong>.</li><br /><li>Implement <strong>data masking and anonymization</strong> for sensitive data.</li><br /><li>Build trusted, reusable data layers for <strong>cross-platform analytics and intelligence</strong>.</li><br /><li>Collaborate with business, architecture, and engineering teams to define MDM and data integration requirements.</li><br /></ul><br /><p>Required Skills</p><br /><p>· Strong experience in <strong>Master Data Management (MDM)</strong> and data engineering.</p><br /><ul><br /><li>Hands-on expertise in <strong>Databricks, PySpark, SQL, Delta Lake, and Lakehouse architecture</strong>.</li><br /><li>Experience with <strong>Golden Records, common IDs, entity resolution, deduplication, and data quality</strong>.</li><br /><li>Good understanding of <strong>Unity Catalog, data governance, metadata, and lineage</strong>.</li><br /><li>Experience integrating data from multiple enterprise platforms.</li><br /><li>Knowledge of <strong>Medallion Architecture</strong> and data privacy/anonymization.</li><br /></ul><br /><p>Good to Have</p><br /><p>· Experience with <strong>Informatica MDM/IDMC, Reltio, Profisee, Semarchy</strong>, or similar MDM platforms.</p><br /><ul><br /><li>Cloud experience with <strong>Azure, AWS, or GCP</strong>.</li><br /><li>Exposure to large-scale data modernization or migration programs.</li><br /></ul>