We are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture, optimizing data flow, and supporting cross-functional teams. The ideal candidate has extensive experience in handling big data and enjoys creating data systems from the ground up.
Key Responsibilities:
Design and develop key components of our data pipeline for extracting, transforming, and loading data from various sources using modern Big Data technologies.
Implement internal process improvements by automating manual tasks, optimizing data delivery, and enhancing scalability.
Collaborate with executives, product teams, and design teams to address data-related technical issues and ensure their infrastructure needs are met.
Work closely with machine learning, data, and analytics teams to innovate and improve functionality in our data systems.
Qualifications:
Bachelor’s degree in Engineering, Computer Science, or related field.
11+ years of experience as a Data Engineer.
5+ years of hands-on experience with Apache Spark and a deep understanding of Big Data fundamentals.
Strong coding skills in Scala, Python, Java, or other languages, with the ability to switch between them as needed.
Proficiency in SQL and experience with relational databases like Postgres or MySQL.
Experience with cloud technologies, specifically DataBricks.
Familiarity with various data formats including Delta Tables, Parquet, CSV, and JSON.
Comfortable working in a Linux shell environment and writing scripts when needed.
Experience working in Agile development environments.
Knowledge of Machine Learning is a plus.
Ability to work independently and deliver stable, reliable, and efficient software.
Strong written and verbal communication skills in English.
Proven ability to collaborate with cross-functional teams in a dynamic work environment.
If you are excited about the opportunity to help redesign data architecture and build scalable data solutions, apply today!
