Key Facts

Remote From:

Full time

English

Hard Skills

Azure Databricks SQL (Programming Language) Python (Programming Language) Apache Spark Data Modeling Data Engineering Microsoft Azure Test Automation PyMOL Semi-Structured Data Azure Blob Storage Unstructured Data Azure Data Factory CI/CD DevOps Data Collection Data Architecture

Roles & Responsibilities

Experience handling data engineering projects involving batch and streaming ingestion.
Proficiency in SQL development, data modeling, and managing both structured and unstructured data.
Expertise in PySpark and Python; hands-on experience with Azure Data Factory, Azure Databricks, and Azure Storage.
Proficient in CI/CD and DevOps practices, productionizing data pipelines, and testing automation (e.g., Pytest).

Requirements:

Oversee and manage data engineering projects for batch and streaming ingestion.
Develop, model, and manage SQL databases.
Implement and maintain data pipelines using Azure tools and Python.
Establish and maintain CI/CD pipelines and DevOps practices for production-grade data solutions, including automated testing.

Georgia IT, Inc.

About Georgia IT, Inc.

Georgia IT, Inc. provides IT Consulting for a wide range of IT services and custom build turn-key enterprise solutions. GIT specializes in improving business scalability and efficiency through BSM and SBA Solutions. GIT transforms business with service management and service automation solutions. We are BMC & HP partners. GIT Services include custom built enterprise software and customer-centric web portals, network design and implementation, remote and site-to-site VPN, network and server security assessment and setup, server and desktop virtualization, and many others. GIT also provides IT Consulting in many areas such as Disaster Recovery Planning, Enterprise Data Backup Strategy, Long Term Strategic IT Planning and Augmentation Professional Services Solutions. Professional Services Specialties: Business Process Integration, Software Integration & Development, Web portal, Networking, Remote and site-to-site VPN, Virtualization Solutions, Product Development Please contact us Hrus@georgiait.com / uthay@georgiait.com/470-798-5000 x 1010 / (732) 890-2535 direct

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

Position: Databricks Devops Engineer
Location: Remote
Duration: long term
Rate: DOE

U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time

Requirements:

Experience handling data engineering projects involving batch and streaming ingestion.
Proficiency in managing both structured and unstructured data.
Strong background in SQL development and data modeling.
Expertise in PySpark and Python.
Knowledge and experience with Azure Data Factory, Azure Databricks, and Azure Storage.
Familiarity with healthcare data and the healthcare domain.
Proficient in CI/CD, DevOps practices, and productionizing data pipelines.
Experience with testing automation, ideally using Pytest or similar frameworks.

Responsibilities:

Oversee and manage data engineering projects for both batch and streaming ingestion.
Develop, model, and manage SQL databases.
Implement and maintain data pipelines using Azure tools and Python.
Ensure data solutions align with healthcare standards and requirements.
Establish and maintain CI/CD pipelines and DevOps practices for production-grade solutions.
Automate testing processes within data pipelines.