Match score not available

Data Engineer - 6 month Contract

Remote:

Full Remote

Contract:

Freelance

Work from:

United Kingdom

Offer summary

Qualifications:

Experience with Azure services, Proficient in data pipelines and ETL, Knowledge of Apache Spark and Kafka, Background in machine learning projects.

Key responsabilities:

Design and maintain large-scale data pipelines
Develop ETL processes for data ingestion and transformation
Implement real-time data streaming
Collaborate with teams to ensure data quality

bigspark

11 - 50 Employees

See more bigspark offers

Job description

Data Engineer (6 month contract) UK Remote

£450-£500 per day Inside IR35

bigspark, a UK based consultancy delivering next level data platforms and solutions with a focus on exciting technologies including Apache Spark, Apache Kafka and working on projects within Machine Learning, Data Engineering, Streaming and Data Science is looking for a Data Engineer to join our team on a contract basis in a remote, work from home capacity.

We provide the backbone for modern analytics to our clients through expertise in DevOps, distributed computing, machine learning and adoption of proven open source projects. We specialise in backend development, infrastructure automation and performance engineering for data workloads at scale.

Your Skills and Experience

Design, develop, and maintain large-scale data pipelines using Azure Databricks, Data Lake, Data Factory, and other Azure services.

Develop ETL processes to ingest, transform, and clean structured and unstructured data for use in analytics and reporting.

Implement real-time data streaming and batch processing solutions using Azure Databricks and integrate with Azure Event Hub or Azure Stream Analytics as needed.

Collaborate with cross-functional teams to integrate data from multiple sources, ensuring data quality and consistency.