Match score not available

Database Developer - Pyspark

Remote: 
Full Remote
Work from: 

Offer summary

Qualifications:

Proficiency in Python, JSON data structures, SQL, database systems, Experience with PySpark, Apache Spark, distributed computing frameworks.

Key responsabilities:

  • Designing, developing custom query builder for efficient JSON data processing
  • Collaborating with cross-functional teams to create scalable solutions, implementing data models and schemas for optimal storage
Supersourcing logo
Supersourcing https://supersourcing.com/
201 - 500 Employees
See more Supersourcing offers

Job description

We are seeking a talented Database Developer with expertise in JSON data processing and PySpark to join our team. The ideal candidate will play a crucial role in designing and developing a custom query builder for efficient JSON data processing using PySpark.

This is a fantastic opportunity to work with cutting-edge technologies and contribute to the development of innovative data processing solutions. As a Database Developer, you will collaborate with cross-functional teams, including data scientists and analysts, to understand business requirements and translate them into efficient and scalable solutions. You will be responsible for designing and implementing data models and database schemas for optimal storage and retrieval of JSON data.

Additionally, you will develop and maintain data pipelines and workflows, ensuring the accuracy and reliability of processed data through validation and quality checks. The successful candidate will have a strong proficiency in Python programming language and extensive experience with PySpark and Apache Spark for data processing.

A solid understanding of JSON data structures, SQL, and database systems is also required. Experience with distributed computing frameworks and knowledge of data processing best practices will be highly beneficial.

If you are passionate about building custom query builders, leveraging PySpark for JSON data processing, and thrive in a collaborative and innovative environment, we would love to hear from you.

Join our dynamic team and contribute to the development of cutting-edge data processing solutions.


Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Verbal Communication Skills
  • Teamwork

Data Engineer Related jobs