Expert-level experience in Scala Spark and Databricks with solid exposure to clusters and transformations in Azure Cloud
Strong experience with Azure Data Factory (ADF) orchestration to integrate data from on-premise applications
Proficiency in Python scripting with Snowflake (and SQL/Teradata) for loading and transforming data
Java Spring Boot expertise for API customization or building new APIs
Requirements:
Design, develop, and optimize Databricks workloads using Scala Spark in Azure Cloud, including cluster management and transformations
Build and maintain APIs with Java Spring Boot to support data services
Implement data integration and orchestration using Azure Data Factory to ingest on-prem data and orchestrate ETL/ELT pipelines
Develop Python scripts for data loading into Snowflake and transforming data for downstream analytics
Job description
Mandatory Skills
Java Spring Boot 4
Python 4
ADF 5
Azure Functions 4
Scala Spark 5
Data Bricks 5
Snowflakes 3
SQL 3
Must have very strong experience(expert level-5) in Scala Spark, Databricks with solid exposure to cluster and transformations in Azure Cloud
Must have strong Orchestration tool ADF experience to get data from on-prem applications & integration services
Must have good experience in Python scripts & Snowflakes(alternate SQL/Teradata) where data will be loaded into
Knowledge on transforming data and parse it and load into snowflakes for downstream data analytics consumption
Java spring boot knowledge for the API customization or writing new APIs.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
