Azure Databricks Senior Data Engineer

unlimited holidays - extra parental leave
Work set-up: 
Full Remote
Contract: 
Full time
Experience: 
Senior (5-10 years)
Work from: 
India

Offer summary

Qualifications:

Bachelor's degree in Engineering, Computer Science, or related field., Minimum of 6 years' experience in Data Management, Data Engineering, and Data Governance., Hands-on experience with Python, Pyspark, and Databricks on Azure., Strong understanding of Data Warehousing, Data Governance principles, and working with various databases..

Key responsibilities:

  • Design, develop, and maintain large-scale data engineering solutions.
  • Collaborate with stakeholders to gather requirements and resolve data issues.
  • Provide technical leadership and mentor junior team members.
  • Ensure timely delivery of projects adhering to quality standards.

Exusia logo
Exusia SME http://www.exusia.com/
201 - 500 Employees
See all jobs

Job description

Description

Sr Data Engineers & Tech Leads – PythonPysparkDatabricks

Department: Sales and Delivery Team Empower

Industry: Information Technology & Services, Computer Software, Management Consulting

Location: WFH India Remote

Experience Range: 6 10 years

Basic Qualification: Bachelor of Engineering or Equivalent

Travel Requirements: Not required

Website: www.exusia.com

Exusia, a cuttingedge digital transformation consultancy, and is looking for top talent in Data Engineering space with specific skills in PythonPysparkDatabricks to join our global delivery teams Industry Analytics practice in India.


What’s the Role?


Fulltime job to work with Exusias clients to design, develop and maintain large scale data engineering solutions. The right candidates will also get a chance to work across the entire data landscape including Data Governance, Metadata Management and will work closely with client stakeholders to capture the requirements, design and implement Analytical reporting, Compliance and Data Governance solutions.


Criteria for the Role!

· Have a minimum of 6 years’ experience in Data Management, Data Engineering & Data Governance space with hands on project experience using Python, Pyspark & Databricks

· Should have worked on large data initiatives and should have exposure to different flavours of Spark including PysparkSpark SQLScalaJava

· Education Qualification – Bachelor of Science (preferably in Computer and Information Sciences or Business Information Technology) or an Engineering degree in the above areas


Key Responsibilities:


· Work with business stakeholders to gather and analyze business requirements, building a solid understanding of the Data Analytics and Data Governance domain

· Document, discuss and resolve business, data and reporting issues within the team, across functional teams, and with business stakeholders

· Should be able to work independently and come up with solution design

· Build optimized data processing and data governance solutions using the given toolset

· Provide hands on technical leadership and work on multiple projects if required

· Collaborate with delivery leadership to deliver projects on time adhering to the quality standards

· Contribute to talent recruitment, competency building and providing mentorship to junior resources for these skills




Requirements

Mandatory Skills:

· Must have strong Data Warehousing Data Engineering background

· Strong conceptual understanding of Data Management & Data Governance principles

· Experience working with multiple databases like OracleSQL ServerOther DBs

· Exposure to Microsoft Azure storage and compute services and should have hands on experience with Databricks on Azure

· Handson experience using Python and Pyspark and should have completed min 2 projects

· Handson experience using Databricks and should be fluent with Pyspark & Spark SQL

· Exposure to Delta lake

NicetoHave Skills

· Exposure to BFSI domain and Data Governance is a big plus

· Exposure to Java & Scala

· Understanding of data governance tools like ASG & Collibra is an added advantage

· Exposure to cloud platforms like AWS, Azure & GCP


Exusia (http:www.exusia.com) is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business outcomes and providing strategy and execution capabilities around digital, analytics and cloud solutions. The company has established its leadership position by solving some of the worlds largest and most complex data engineering and analytical problems in the healthcare, financial, telecommunications, consumer products and high technology industries.


Exusia’s mission is to transform the world through the innovative use of information.

Over the past 3 years, Exusia was recognized by Inc. 5000 and by Crain’s publications as one of the fastest growing privately held companies in the world. Since the company’s founding in 2012, Exusia has experienced an impressive seven years of revenue growth and has expanded its operations in the Americas, Asia and Africa. Exusia has recently also been recognized by publications such as the CIO Review, Industry Era, Insight Success and the CIO Bulletin for the company’s innovation in IT Services, the Telecommunications and Healthcare industries and its entrepreneurship. The company is headquartered in Miami, Florida, United States with development centers in India.


Interested applicants should apply by forwarding their CV to: elevate@exusia.com


Required profile

Experience

Level of experience: Senior (5-10 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Hard Skills

Apache SparkData EngineeringDatabricksPython (Programming Language)Oracle CRMMicrosoft AzureApache SparkMicrosoft SQL Server Data Engine (MSDE)Data Warehouse ArchitecturesData GovernanceJava (Programming Language)gRPCAWS Cloud ServicesScala (Programming Language)

Other Skills

  • Teamwork
  • Communication
  • Problem Solving
Are you interested?

Data Engineer Related jobs

See more Data Engineer jobs