Senior Data Engineer (Data Quality, PySpark, Databricks)

PEXA
Columbia County, Wisconsin
Full time
3 days ago
Hi, we’re Smoove, part of the PEXA Group.Our vision is to simplify and revolutionise the home moving and ownership experience for everyone. We are on a mission to deliver products and services that remove the pain, frustration, uncertainty, friction and stress that the current process creates. 
We are a leading provider of tech in the property sector - founded in 2003, our product focus has been our conveyancer two-sided marketplace, connecting consumers with a range of quality conveyancers to choose from at competitive prices via our easy-to-use tech platform. We are now building out our ecosystem so consumers can benefit from our services either via their Estate Agent or their Mortgage Broker, through smarter conveyancing platforms, making the home buying or selling process easier, quicker, safer and more transparent
Why join Smoove?Great question! We pride ourselves on attracting, developing and retaining a diverse range of people in an equally diverse range of roles and specialisms – who together achieve outstanding results. Our transparent approach and open-door policy make Smoove a great place to work and as our business expands, we are looking for ambitious, talented people to join us.
We are looking for a technically proficient Senior Data Engineer to join our growing Data team.
Your primary focus will be on ensuring data quality, stability, and reliability — from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports.
You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready.Our data platform is built using Databricks, with data pipelines written in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs.
This includes work with complex, nested data structures, ensuring they are reliably parsed and transformed. Experience in managing sensitive data (PII) and implementing GDPR policies is required.
You’ll work closely with analysts, engineers, and business stakeholders to ensure that datasets are not only accurate but also trusted.
You will collaborate with product and engineering teams to incorporate data from new products into our core business datasets, ensuring that these new sources meet our data standards and are quickly usable for business intelligence.
You’ll help put controls in place — such as access policies, metadata layers, and automated data quality checks — to ensure long-term stability. Experience with a data governance platform like Alation is desirable. 
While predominantly remote / home based the team meet up to 20-25 days per year for meaningful collaboration in either Leeds or Thame.

Key Responsibilities

Skills & Experience Required

Sound like you? We at Smoove are ready so if this role sounds like you, apply today.  GDPR Compliance Digital Completion UK Limited (trading name “PEXA”), Optima Legal Services Limited (trading name "Optima Legal") and Smoove Limited (a holding company which comprises of the following wholly owned trading Subsidiary companies: United Legal Services Limited, United Home Services Limited, Legal-Eye Limited, and Amity Law Limited) are all owned directly by DigCom UK Holdings Limited, which is a wholly owned Subsidiary of PEXA Group Limited in Australia (ACN 140 677 792; ASX: PXA) (referred to collectively as “PEXA Group”).
When we process your applicant personal data for recruitment purposes, we do so as a controller. If as part of the recruitment process, we share your personal data with another company within the PEXA Group, that company may process your personal data as either an independent controller or, in certain circumstances, a joint controller. By applying for this role, you consent to us processing your personal data in accordance with the UK General Data Protection Regulation ("UK GDPR") and the Data Protection Act 2018, and further information can be found in our privacy noticehttps://pexa.co.uk/applicant-policy/.
Apply
Other Job Recommendations:

Data Engineer - Operational Data

Frasers Group
Derbyshire, England
  • Think without limits - Think fast, think fearlessly, and...
  • Own it and back yourself - Own the basics, own your role and...
1 week ago

Senior Quality Engineer

S&P Global
  • Working with a team of highly skilled, ambitious and...
  • Using a wide range of cutting-edge technology to innovate...
2 weeks ago

Data Quality Administrator

Living Well Partnership
Southampton, England
  • Accurate processing of safeguarding data, including read...
  • Preparing safeguarding reports and coordinating clinician...
4 weeks ago

NW Regional Compliance and Data Quality Officer

HM Courts & Tribunals Service
Tameside, England
£29,617 - £37,502
  • Liaise with the wider network of Compliance and Data...
  • For moves to or from another employer or moves across the...
4 weeks ago

Data Quality Specialist

LV=
Bournemouth, Christchurch and Poole, England
£43,221 - £54,728
  • Design and run data profiling, data quality assessments,...
  • Collaborate with data owners, data stewards, data...
4 weeks ago