Key Facts

Remote From:

Fixed term

English

Hard Skills

Apache Spark Apache Spark Databricks Python (Programming Language) Performance Systems Analysis Data Modeling Microsoft Azure Data Cleansing Data Integration Data Transformation Cloud Computing Big Data Analytics SQL (Programming Language) Data Architecture Unstructured Data Data Warehouse Architectures ETL (Extract Transform Load) Data Lakes Data Architecture

Other Skills

•
Teamwork
•
Collaboration
•
Communication

Roles & Responsibilities

Strong experience with Databricks, Python, and PySpark
Hands-on experience with Apache Spark and big data processing
Proficiency in SQL and working with Azure cloud platform
Experience with ETL development and performance tuning

Requirements:

Develop and maintain scalable data pipelines using Databricks, PySpark, and Python
Work with structured and unstructured data in cloud-based environments
Implement data transformation, cleansing, and integration solutions
Collaborate with data engineers, analysts, and stakeholders to meet business requirements

Veracity Software Inc

About Veracity Software Inc

The definition of Veracity is accuracy and habitual truthfulness. This truly defines our brand in simplistic terms. At Veracity, we believe in doing everything in the ‘Right Way’, which means you have to challenge your own innovations and solutions all the time. Our strength lies in our employees, and with the right blend of business and technical expertise, we set the bar high for Veracity. From inception, Veracity focused on building cloud based SaaS solutions while using the latest and most advanced technology stack. We have delivered cloud based customized solutions and services to various clients across both North America and India. We have a global headquarter in Woodbridge, NJ while our offshore office is in Pune, India. We believe in bringing Global talent together, which helps us in delivering cost effective, yet highly scalable and efficient solutions. With the vision of trying to be one of the trusted IT partners as well as one of the most respected solution providers with an onsite/offshore model, Veracity is equipped with the right set of highly skilled individuals who have expertise in delivering the most effective business services and solutions for our clients. Veracity’s mission is to become the Trusted IT Partner for various businesses across globe.

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

Role: Databricks engineer with Python, Pyspark experience
Canada/Remote
Contract
The below mentioned JD can be used as reference:
Skilled Databricks Engineer with expertise in Python and PySpark to design, develop, and optimize data pipelines and workflows. Experience working with Apache Spark, ETL processes, and big data architectures Azure environment.

Key Responsibilities:
• Develop and maintain scalable data pipelines using Databricks, PySpark, and Python
• Work with structured and unstructured data in cloud-based environments
• Implement data transformation, cleansing, and integration solutions
• Collaborate with data engineers, analysts, and stakeholders to meet business requirements

Requirements:
• Strong experience with Databricks, Python, and PySpark
• Hands-on experience with Apache Spark and big data processing
• Proficiency in SQL and working with cloud Azure cloud platform
• Experience with ETL development and performance tuning
• Knowledge of data lake, data warehouse, and data modeling principles

Ready to apply?

APPLY

Share ·