Match score not available

Data Platform Engineer

Remote: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

2+ years experience Spark/Scala/Java, 1+ year experience Kafka/Spark Streaming, Strong database fundamentals, Experience in building ETL pipelines, Knowledge of Kubernetes and cloud deployments.

Key responsabilities:

  • Drive insights from data for AI workflows
  • Build scalable and secure data infrastructure
  • Devise transformation systems for data stores
  • Streamline data access with tools and apps
  • Influence design with stability and scalability in mind
Niyati Tech logo
Niyati Tech
2 - 10 Employees
See more Niyati Tech offers

Job description

Company Overview:
Niyati Tech is a leading player in the Information Technology & Services industry, specializing in providing innovative solutions to enterprises.

Role and Responsibilities:
The Data Platform Engineer at Niyati Tech will play a crucial role in driving insights from data, accelerating machine learning at scale, and building innovative AI workflows. The responsibilities include building highly-scalable and secure data infrastructure, developing transformation systems for various data stores, and building tools and applications to streamline data management and access. The role also involves reviewing and influencing design and architecture with stability, maintainability, and scale in mind, identifying patterns, providing solutions to a class of problems, and handling dependencies with minimal oversight.

Candidate Qualifications:
The ideal candidate should have a good understanding of distributed systems, scalability, and availability, along with at least 2 years of experience in Spark/Scala/Java, 1 year of experience in Kafka and Flint/Spark Streaming, 2 years of experience in Airflow, and experience in building ETL pipelines on a large scale. Strong database and storage fundamentals, experience with cloud deployments, and basic working knowledge of Kubernetes are also required.

Required Skills:
  • Airflow
  • Pyspark
  • Spark/Scala/Java

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Data Engineer Related jobs