Logo for Scrumconnect Consulting

Data Engineer (SC Eligible/ SC Cleared)

Role overview

Summary

This role is for a Data Engineer to build and maintain data pipelines and platforms for public sector projects at Scrumconnect Consulting. You will ensure data reliability and security while collaborating with various teams to meet data needs.

Qualifications

  • Proven experience as a Data Engineer or in a similar role.
  • Strong SQL skills and experience with relational databases such as PostgreSQL, SQL Server or Oracle.
  • Programming experience in Python (or Scala or Java).
  • Experience building ETL/ELT pipelines.
  • Experience with cloud data platforms such as AWS or Azure.

Responsibilities

  • Design, build and maintain scalable data pipelines (ETL/ELT) to collect, transform and load data from a range of sources.
  • Develop and manage data storage solutions, including data warehouses and data lakes.
  • Ensure data quality, accuracy and consistency through validation, testing and monitoring.
  • Work with Data Architects, Analysts and Developers to understand data needs and deliver reliable solutions.

Key facts

Hard skills

Other skills

  • Problem Solving
  • Communication

About the company

Scrumconnect Consulting logo

Scrumconnect Consulting

  • IT Services & Consulting
  • SME
  • 201–500
Scrumconnect, an acclaimed consultancy firm, sets the gold standard in crafting sophisticated, user-centric software solutions underpinned by data-driven insights. Our robust software solutions have cast a global footprint, influencing over 50M individuals via 64 robust digital offerings. As trusted allies in public sector transformation, we've partnered with 20% of the top 75 Govt Services, yielding savings exceeding £24 million for UK taxpayers. Our mission is simple: transform public services into exceptional digital experiences. Our vision is far-sighted. Through digital channels, we aim to democratize public service access, ensuring convenience, wider accessibility, and cost efficiency. As we move forward, we envision ourselves to be an esteemed SME in UK public sector transformation, collaborating with at least 8 central government departments.In the next 5 years, we aspire to grow by expanding our consulting business. We're dedicated to achieving a 99% Customer Net Promoter Score and plan to create 750 new jobs across the UK.Our core values of openness, integrity, excellence, learning, and unwavering commitment guide us in every endeavor. As a testament to our work, we have bagged prestigious accolades- Special Award - Organisational Exit from Pandemic, 'Digital Transformation Project of the Year' at the UKIT Awards and the 'Digital, Data and Technology Award' at the Civil Service Awards. Scrumconnect was born out of an identified gap in the digital transformation landscape. Traditional consultancies often overlooked key areas like design thinking, user-centric designing, customer experience, and product innovation. To disrupt this paradigm, we developed our unique model. We handpick high-performing teams for each project, streamlining talent acquisition and retention to deliver value swiftly and efficiently. Our success lies in this novel approach - bringing together the finest minds Join us at Scrumconnect, and be part of the revolution

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About Scrumconnect

Scrumconnect Consulting is a multi-award-winning UK digital consultancy. We help public and private sector organisations design and deliver better digital services, working in agile, multidisciplinary teams on services used by millions of people every day. Our growing Newcastle office is at the heart of our presence in the North East.

Role overview

We are looking for a Data Engineer to join us on a public sector project.You will build and maintain the data pipelines and platforms that power our digital services, making sure data is reliable, secure and ready for analysis.

This is a remote role with one day a week in our Newcastle office, where you will connect with the wider team. It suits someone looking for flexible, work without compromising on interesting, meaningful projects.

Key responsibilities

  • Design, build and maintain scalable data pipelines (ETL/ELT) to collect, transform and load data from a range of sources.

  • Develop and manage data storage solutions, including data warehouses and data lakes.

  • Ensure data quality, accuracy and consistency through validation, testing and monitoring.

  • Work with Data Architects, Analysts and Developers to understand data needs and deliver reliable solutions.

  • Optimise data workflows for performance, scalability and cost.

  • Follow data security, privacy and governance standards.

  • Document pipelines, data models and processes clearly.

  • Troubleshoot and resolve data issues quickly and effectively.

Essential skills and experience

  • Proven experience as a Data Engineer or in a similar role.

  • Strong SQL skills and experience with relational databases such as PostgreSQL, SQL Server or Oracle.

  • Programming experience in Python (or Scala or Java).

  • Experience building ETL/ELT pipelines.

  • Experience with cloud data platforms such as AWS or Azure (for example, S3, Glue, Redshift, Azure Data Factory or Synapse).

  • Understanding of data modelling and data warehousing concepts.

  • Experience with version control (Git).

  • Good problem-solving and communication skills.

  • Able to work independently and remotely, and to travel to Newcastle once a week.

Desirable skills and experience

  • Experience with Apache Spark, Databricks or Kafka.

  • Familiarity with orchestration tools such as Airflow.

  • Experience with CI/CD for data pipelines and Infrastructure as Code.

  • Knowledge of data governance and data quality frameworks.

  • Experience in Agile delivery teams, ideally on public sector projects.

What we offer

  • Flexible part-time hours with mostly remote working.

  • Meaningful work on digital services that make a real difference to the public.

  • A growing, award-winning consultancy with a strong North East presence.

  • Opportunities to learn new tools and grow your career.

  • A collaborative, inclusive team where your ideas are valued.

Our Commitment to Diversity & Inclusion

At Scrumconnect Consulting, we believe diversity drives innovation. We are committed to fostering an inclusive workplace where everyone feels respected, valued, and supported.

We actively encourage applications from women, people with disabilities, individuals from under-represented communities, and those seeking flexible working arrangements.

As a Disability Confident Level 1 employer, we provide reasonable adjustments throughout the recruitment process and employment to ensure equal opportunity for all.




Salary: 65-70K

Related jobs

See all Data Engineer jobs

Other jobs at Scrumconnect Consulting