Big Data jobs and careers

As the use of data in business gets more and more prevalent the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.

Why consider a career in Big Data?

Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.

Typical role titles include

Data Engineer
Big Data Engineer
Data Developer
BI Engineer
BI Developer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Hadoop Developer
Data factory Developer
Hadoop Engineer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Platform Engineer
Data Warehouse Engineer
DWH Engineer
DWH Programmer
DWH Developer
Datawarehouse Developer
Datawarehouse Engineer
Datawarehouse Programmer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Hadoop Architect
Hadoop Specialist
Big Data Specialist
Big Data Lead
Head of Big Data
Data Architecture specialist
Head of Data Architecture

Career progression example

Junior Data Engineer
Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
Data Architect

Is it right for me? The skills it takes…

The skills needed can be split into 3 categories; programming skills, data science understanding and problem-solving.

Programming skills: Java | Python | Golang | Cython | Software Design – A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries – e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis, Redshift.

 What qualifications does it take?

A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. Demonstrable experience working with large data sets or alternatively candidates will work in Business Intelligence and then do online courses /self-learning/ get trained up on Big Data Engineering and Architecture and can move into these roles through this route.

Our Data, Insight & Analytics recruitment team

  • Principal Recruiter

    Data Platform & Architecture

    View profile

    Scott Rogers

  • Senior Recruiter

    Data, Insight & Analytics

    View profile

    Tegan Fenn

  • Head of Data

    Insight & Analytics

    View profile

    Alex Cosgrove

JOB
SEARCH

Our latest Data, Insight & Analytics jobs

We connect ambitious organisations with their greatest assets, equally ambitious talent.

Microsoft Fabric Consultant

  • Oxford
  • Contract
  • Up to £600 p/day "Inside IR35"

Full details

3 Months Initial - Remote Work

Potential to extend.

Remote work (from the UK).

Full details

09th Dec

Senior Marketing Data Analyst

  • Bristol
  • Permanent
  • 35,000 - 45,000

Full details

Drive Marketing Insights with PowerBI on marketing data science projects!

Collaborate with senior marketing stakeholders to shape data-driven strategies.

Flexible, remote-first role with opportunities for professional development.

Full details

12th Nov

Lead Data Scientist

  • Bristol
  • Permanent
  • £80K - £90K dependent on experience

Full details

Leading Financial Services Business

Join a growing and friendly Data Science team.

Work across multiple business units on end to end ML projects.

Full details

08th Nov

LOAD MORE JOBS

Salary guides:

  • -
    Data, Insight and Analytics Day Rate Guide

    Average salaries and day rates typically received for Data, Insight and Analytics roles.

  • -
    Data, Insight and Analytics Salary Guide

    Average salaries and day rates typically received for Data, Insight and Analytics roles.

  • -
    Data, Insight and Analytics Within Data Engineering & Development

    Average salaries and day rates for roles within data engineering & development.

  • -
    Data, Insight and Analytics within Data Science

    Average salaries and day rates typically received for Data, Insight and Analytics roles within Data Science.

COMMUNITIES

MotherBoard is a Business Charter, Community and Event Series driving tangible change for mums working in the tech industry. GreenTechSW is a community that provides expert insight and thought provoking discussion on how technology can improve our physical environment and battle the massive, urgent issue of climate change. Tech Ethics Bristol is passionate about building a fair and equal society, where technology is a catalyst for positive change.

PURPOSE