Offer summary

Qualifications:

Proficiency in Python and PySpark for large-scale data processing., Experience with Databricks platform and its tools., Strong scripting skills and understanding of Apache Spark architecture., Educational background in computer science, data science, or related fields..

Key responsibilities:

Develop and maintain data processing workflows using PySpark and Databricks.

Collaborate with data scientists and engineers to implement AI functionalities.

Optimize data pipelines for performance and scalability.

Support data analysis and reporting tasks within the team.

Elfonze Technologies is an IT service and consulting firm established in 2021. It started with delivery centers in Bengaluru and Denver, and by the end of its first year, it had a strong focus on Oracle Enterprise Consulting. The following year, the company expanded to Bhubaneswar and introduced an Electronics System Design and Manufacturing (ESDM) vertical. In 2023, Elfonze diversified its product portfolio with innovative solutions and strategic partnerships. It opened a Pune office and launched Connected Supply Chain Services. Key achievements include expansion to four locations, diversification into five verticals, serving over 50 global clients, a 400% growth rate, a strong team of over 200, and high client satisfaction. The founders' century of combined experience in IT and enterprise consulting has been fundamental to Elfonze's success. The company operates in multiple verticals including IT services, consulting, product development, and more, showcasing its adaptability and commitment to excellence.

Job description

This is a remote position.

Python & PySpark

PySpark is a Python API for Apache Spark, enabling large-scale data processing.
Python is essential for scripting and integrating with Spark, especially when using libraries like pyspark-ai to incorporate AI functionalities into Spark workflows .

Databricks

Databricks provides a unified analytics platform that integrates with Apache Spark.
It supports Python and PySpark for data processing and offers tools for deploying machine learning models.
The English SDK for Apache Spark allows for natural language interactions with Spark DataFrames, facilitating tasks like data transformation and analysis .

Required profile