Lead Data Engineer


Rodney Williams

Salary from



City of London




Share this

Position: Lead Data Architect

Location: York or London (Hybrid working)

Benefits: Up to £110,000 DOE + Bonus and more

Are you an experienced architect looking for an opportunity within a globally recognised company? Our client are market leads within the insurance space and are currently on the lookout for a Lead Data Architect to scale and drive the team.

As a Lead Data Architect, you will assist in architecting and building new data solutions and initial PoCs using SaaS and PaaS-based services on Azure. This role requires somebody with a strong understanding of how to set up the suitable tools and technologies in the cloud to securely process an array of data.


  • Working with senior stakeholders to understand high value business problems that can be solved through the application of data processing and analytical systems
  • Helping to architect, setup and support a new cloud-based analytics platform for the business
  • Helping to create and manage a specialist Data Engineering practice for the Re & ILS’s business
  • Ensuring your team supports the Data Science Team by building data pipelines for specific insights and provides them with an environment for their R&D and experimentation
  • Providing robust, secure and scalable production data analytics solutions
  • Understand business requirements and refine into development tasks and estimate their complexity
  • Research, evaluate and adopt new technologies with a right tool for the job mentality
  • Prototype, fail rapidly and iterate
  • Focus on both speed of delivery and quality, with suitable pragmatism – ensuring your solutions are always “appropriate” and not overly complex or over-engineered
  • Quick progression of projects from PoC to post-production stage
  • Communication and presentation of ideas to colleagues in all parts of the wider business
  • Recruitment, Mentoring & code reviews for the Data Engineering Team

Essential skills:

  • Passion for and experience of building data analytical platforms to deliver business value.
  • Ability to setup secure, automated and scalable data platforms/technologies within Microsoft Azure.
  • Solid experience working with ELT/ETL tools like Data Factory, Matillion and SSIS.
  • Solid experience working with Azure Storage and Azure Data Lake.
  • Good understanding of different types of data (i.e., structured, semi-structured and unstructured data) and the considerations that should be made in how they are stored.
  • Solid experience of working with and implementing BI solutions on platforms like Tableau and Power BI.
  • Solid understanding on how to incorporate data lineage, discovery and governance within production solutions, with experience in tools such as Purview, Informatica, or Apache Atlas.
  • Solid experience of data management and validation techniques.
  • Excellent working knowledge of T-SQL.
  • Track record of taking initiative and delivering projects end-to-end; clear evidence of being self-driven and motivated.
  • Immense curiosity, high energy and desire to go the extra mile to make a difference.
  • Having an awareness of trends in the data engineering space.
  • Leading and nurturing the team.

If you wish to apply for this position, please email us at apply@som-3.com