Search suggestions:

part time
full time
retail
receptionist
hr
van driver
warehouse operative
temporary
warehouse
chef
cleaner
team member
work from home
Wales
Scotland
London
City of London
England
Manchester
Surrey
Southampton
York
Bristol
Newcastle upon Tyne
Northern Ireland
Apply

Data Engineer

Techruiter
City of Edinburgh, Scotland
Full time
1 week ago
If data is what excites you, this is the role for you! Process over 350gb an hour, almost half a million incoming events a second and maintain petabytes of storage.
This role will see you join the global leader in location-based data, analytics and advertising. This award winning client helps some of the biggest and best known global brands understand and reach their future customers, driving real business outcomes.My client is a truly global company, with over 20 offices across 5 continents. The team is currently around 200, spread across all locations. This opportunity will enable you to understand and impact every aspect of their product. Headquartered in London, with a Tech Hub in Edinburgh, they are VC backed, financially successful, and undergoing continued growth. 
What tech are they using: Spark, Flink, Kafka, ScyllaDB, Redshift, Druid, BigQuery, and Postgres.. But like any good engineering team, they are always looking for better ways to do things.
Join a team that is passionate about what they do, supporting each other and improving as a team. They are growing their engineering team and are excited about the challenges that lay ahead as they look to reach the next 10x scale and intelligence.
You: 5+ years commercial Engineering experienceExpert in Python or Scala Use of Spark, Hadoop or Kafka Orchestration frameworks, like Luigi, Airflow, or OozieA full understanding of data analytics and ingestion engineeringHands-on implementation and architectural familiarity with streaming, relational, and non-relational databases and systemsAWS, GCPExcellent working understanding of server-side LinuxDegree in Computer Science, Software Engineering, or similar
Bonus:Familiarity with Cassandra, ScyllaDB, HBase, or similar datastoresPostgreSQL, BigQuery, RedShift 
Benefits:An extra bank-holidayFree eye testsChildcare vouchersCycle schemeDay off on your birthday!Competitive packagesEarly finish Friday - because you deserve itPensions - saving for the future?Some office-centric perks are being re-evaluated in light of our shift to remote working
Save Apply
Report job
Other Job Recommendations:

Senior Data Engineer (Data Quality, PySpark, Databricks)

PEXA
Columbia County, Wisconsin
  • Ensure end-to-end data quality, from raw ingested data to...
  • Optimise PySpark-based data transformation logic for...
1 week ago

Data Engineer - Operational Data

Frasers Group
Derbyshire, England
  • Think without limits - Think fast, think fearlessly, and...
  • Own it and back yourself - Own the basics, own your role and...
2 weeks ago

ACE Data Privacy/Data Protection Officer

Gilead Sciences
England
£30,548 - £38,680
  • Serve as a resource to ACE country counsel for...
  • Work with IT Security to manage procedures for vetting and...
2 weeks ago

Data Engineer

Iress
Gloucestershire, England
  • Data Architecture and Design Contributions: Actively...
  • Data Pipeline Development and Support: Provide technical...
2 days ago

Energy Migration Senior Data Engineer (6-month contract)

Utility Warehouse
City of London, England
  • Designing and building scalable, reliable and robust data...
  • Data modelling - bringing a structure to raw data that is...
2 days ago