Skip to content
Toutes les missions
Veille marché · Freework Publiée 1 month ago

Lead Data Engineer

Lead Data Engineer (AI \& Data Platforms) | Must Be DV Clearable | 5 Days Onsite Hands-on technical leadership building data and AI systems that actually workWe're looking for a Lea...

Entreprise Lorien
Mode Angleterre (Royaume-Uni)

Résumé

<p><strong>Lead Data Engineer (AI \&amp; Data Platforms) | Must Be DV Clearable | 5 Days Onsite</strong> <strong>Hands-on technical leadership building data and AI systems that actually work</strong></p><br /><p>We&#039;re looking for a <strong>Lead Data Engineer</strong> to join a growing enterprise data and AI capability, playing a critical role in designing, building, and operating production-grade data platforms and AI-enabled solutions.</p><br /><p>This is <strong>not a line-management role</strong>. Instead, it is a senior, hands-on technical leadership position for someone with deep data engineering experience who leads through delivery, technical judgement, and engineering excellence rather than hierarchy.</p><br /><p>You will work across complex environments spanning legacy platforms, modern cloud services, advanced analytics, machine learning, and emerging AI technologies. The challenge isn&#039;t greenfield experimentation; it&#039;s building robust production systems, operationalising AI capabilities, improving what exists, and helping teams use data and AI safely, effectively, and at scale.</p><br /><p>We&#039;re particularly interested in engineers who have helped organisations establish the foundations for AI-led development, including data platforms, ML pipelines, governance frameworks, deployment processes, and production support models.</p><br /><p><strong>What You&#039;ll Be Doing</strong></p><br /><p>You&#039;ll act as a senior technical anchor for both data engineering and AI-enablement initiatives, contributing directly while guiding others through example.</p><br /><p>You will:</p><br /><ul><br /><li>Design, build, and enhance enterprise-scale data platforms, pipelines, and services</li><br /><li>Lead complex data engineering work end-to-end, from problem definition and exploration through build, testing, deployment, and operational support</li><br /><li>Build and maintain cloud-native data platforms that support analytics, machine learning, and AI workloads</li><br /><li>Develop robust data pipelines supporting both traditional analytics and AI/ML use cases</li><br /><li>Work directly with technical and non-technical stakeholders to translate operational problems into scalable data and AI solutions</li><br /><li>Design data models, integration patterns, and storage structures that support long-term maintainability and reusability</li><br /><li>Help establish engineering frameworks for AI-led development, including environments, CI/CD processes, testing strategies, governance controls, and deployment standards</li><br /><li>Support the operationalisation of machine learning and AI solutions into production environments</li><br /><li>Improve data sharing, onboarding of new data sources, and interoperability across teams and systems</li><br /><li>Evaluate and introduce new tools, frameworks, and technologies where they deliver genuine value</li><br /><li>Build robust, production-grade solutions rather than proofs of concept</li><br /><li>Treat metadata, lineage, observability, governance, data quality, and security as first-class engineering concerns</li><br /><li>Diagnose and resolve complex data and platform issues in challenging enterprise environments</li><br /><li>Contribute to a supportive engineering culture focused on quality, delivery, and continuous improvement</li><br /></ul><br /><p><strong>What We&#039;re Looking For</strong></p><br /><p>This role is for a genuine practitioner who enjoys doing the work and raising standards around them.</p><br /><p><strong>Essential Experience</strong></p><br /><ul><br /><li>Significant hands-on experience as a Senior or Lead Data Engineer working on complex, enterprise-scale systems</li><br /><li>Strong Python and Spark skills with evidence of building and maintaining production data pipelines</li><br /><li>Deep understanding of the full data engineering lifecycle: ingestion, transformation, storage, serving, and reuse</li><br /><li>Strong experience designing integrations across diverse data sources, platforms, and legacy environments</li><br /><li>Experience building and supporting cloud-based data platforms, preferably within AWS environments</li><br /><li>Proven experience designing scalable data models and architectures</li><br /><li>Solid understanding of data governance, security, compliance, and operational controls</li><br /><li>Experience with modern engineering practices including source control, automated testing, CI/CD, infrastructure as code, and deployment automation</li><br /><li>Ability to communicate effectively with both highly technical and non-technical stakeholders</li><br /><li>Experience supporting machine learning or AI workloads through production-grade data engineering solutions</li><br /></ul><br /><p><strong>Highly Desirable</strong></p><br /><ul><br /><li>Strong AWS data platform experience (S3, Glue, EMR, Redshift, Athena, Lambda, Bedrock, SageMaker or equivalent)</li><br /><li>Experience operationalising machine learning models into production environments</li><br /><li>Experience with MLOps, model deployment, model monitoring, model lifecycle management, and automated validation processes</li><br /><li>Experience supporting Generative AI solutions, including RAG architectures, vector search, LLM integration, AI orchestration, or agentic workflows</li><br /><li>Databricks experience, including Unity Catalog, MLflow, Delta Lake, Lakehouse architecture, and AI tooling</li><br /><li>Experience working within secure, regulated, or government environments</li><br /><li>Exposure to large-scale enterprise data and AI platforms</li><br /></ul><br /><p><strong>If you&#039;re passionate about building enterprise-scale data platforms, enabling AI adoption, and solving genuinely difficult engineering challenges, we&#039;d love to hear from you. Apply now.</strong></p><br /><p>Guidant, Carbon60, Lorien \&amp; SRG - The Vertage Group Portfolio are acting as an Employment Business in relation to this vacancy.</p>