Big Data jobs and careers

As the use of Big Data in business gets more and more prevalent the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.

Why consider a career in Big Data?

Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.

Typical Big Data role titles include

Data Engineer
Big Data Engineer
Data Developer
BI Engineer
BI Developer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Hadoop Developer
Data factory Developer
Hadoop Engineer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Platform Engineer
Data Warehouse Engineer
DWH Engineer
DWH Programmer
DWH Developer
Datawarehouse Developer
Datawarehouse Engineer
Datawarehouse Programmer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Hadoop Architect
Hadoop Specialist
Big Data Specialist
Big Data Lead
Head of Big Data
Data Architecture specialist
Head of Data Architecture

Big Data Career progression example

Junior Data Engineer
Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
Data Architect

Is it right for me? The skills it takes…

The skills needed can be split into 3 categories; programming skills, data science understanding and problem-solving.

Programming skills: Java | Python | Golang | Cython | Software Design – A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries – e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis, Redshift.

 What qualifications does it take have a career in Big Data?

A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. Demonstrable experience working with large data sets or alternatively candidates will work in Business Intelligence and then do online courses /self-learning/ get trained up on Big Data Engineering and Architecture and can move into these roles through this route.

Our Data, Insight & Analytics recruitment team

  • Principal Recruiter

    Data Platform & Architecture

    View profile

    Scott Rogers

  • Lead Senior Recruiter

    Data, Insight & Analytics

    View profile

    Tegan Fenn

JOB
SEARCH

Our latest Data, Insight & Analytics jobs

We connect ambitious organisations with their greatest assets, equally ambitious talent.

Senior Machine Learning Engineer

Purpose Driven

  • London
  • Permanent
  • 100,000 - 150,000

Full details

Lead the future of AI-driven climate intelligence

Drive cutting-edge AI and ML innovation in the climate-tech space.

Join a high-growth, well-funded startup with well-known clients.

Full details

26th Mar

Senior ML Engineer

Purpose Driven

  • New York, US
  • Permanent
  • $125,000 - $200,000

Full details

Lead the future of AI-driven climate intelligence

Drive cutting-edge AI and ML innovation in the climate-tech space.

Join a high-growth, well-funded startup with well-known clients.

Full details

26th Mar

GIS Data Engineer

Purpose Driven

  • Bath
  • Permanent
  • 35,000 - 50,000

Full details

Join a growing team using technology to drive sustainability forward!

Work on cutting-edge geospatial projects that make a real impact.

A collaborative, supportive team where your ideas will be valued.

Full details

25th Mar

LOAD MORE JOBS

Salary guides:

  • -
    Data, Insight and Analytics Within Data Engineering & Development

    Average salaries and day rates for roles within data engineering & development.

  • -
    Data, Insight and Analytics within Data Science

    Average salaries and day rates typically received for Data, Insight and Analytics roles within Data Science.

  • -
    Data, Insight and Analytics Salary Guide

    Average salaries and day rates typically received for Data, Insight and Analytics roles.

  • -
    Data, Insight and Analytics Day Rate Guide

    Average salaries and day rates typically received for Data, Insight and Analytics roles.

COMMUNITIES

MotherBoard is a Business Charter, Community and Event Series driving tangible change for mums working in the tech industry. GreenTechSW is a community that provides expert insight and thought provoking discussion on how technology can improve our physical environment and battle the massive, urgent issue of climate change. Tech Ethics Bristol is passionate about building a fair and equal society, where technology is a catalyst for positive change.

PURPOSE