Logo for Infinity-Outsourcing

ADF with Data Bricks, Snowflake Lead

Infinity-Outsourcing

Role overview

Qualifications

  • 10+ Years of Experience
  • Experience in building Meta data driven framework using Databricks
  • Experience in Snow-Pipe and Snow-SQL
  • Ability to write complex SQL queries and optimize SQL code

Responsibilities

  • Design and build the data ingestion pipeline
  • Maintain large, complex data processing pipelines using Databricks and Azure Data Factory
  • Provide operational and functional support for managing enterprise data
  • Implement data quality checks and validation processes to ensure data accuracy

About the company

Infinity-Outsourcing logo

Infinity-Outsourcing

Outsourcing & Offshoring

Unlock Your Potential with Infinity OutsourcingAt Infinity Outsourcing, we're not just a company; we're a platform for growth, learning, and career advancement. Our "Career Column" is a dedicated space where we share insights, guidance, and opportunities to help you excel in your professional journey.Your Success, Our MissionAt Infinity Outsourcing, we're more than just a recruitment and training company; we're your partners in career growth. Our "Career Column" reflects our commitment to your success. We believe that informed and empowered individuals are better equipped to navigate the ever-evolving professional landscape.Explore our "Career Column" regularly to stay informed, motivated, and prepared for the opportunities that lie ahead. Your career journey begins here.Unlock your potential with Infinity Outsourcing. Join us on the path to professional excellence

Company details

Company typeScaleup
IndustryOutsourcing & Offshoring
Company size201 - 500

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Position: ADF with Data Bricks, Snowflake Lead

Salary: $120,000 around with QPLC

Location : Remote

Visa independent Preferred

10+Years of Exp Need

Responsibilities :​

  • Designing and building the data Ingestion Pipeline ​
  • Designing, building and maintain large, complex data processing pipelines using Databricks and Azure Data Factory in Azure to meet enterprise Data requirements​
  • Providing operational and functional support on creating, storing, managing, and maintaining enterprise data, including the ability to incorporate policies and procedures for centrally managing and sharing data through the data life cycle​
  • Identifying, designing, and implement internal process improvements: automating manual processes, optimizing data delivery, and re-designing for flexibility and scalability​
  • Building the infrastructure required for extraction, transformation, and loading of data from a wide variety of cloud and on-premises data sources. ​
  • Working with stakeholders including to assist with data-related technical issues and support their data infrastructure needs. ​
  • Working closely with data architecture, data governance and data analytics teams to ensure pipelines adhere to enterprise standards, usability, and performance.​
  • Experience in building Meta data driven framework using Databricks​
  • Experience in Snow-Pipe and Snow-SQL
  • Write complex SQL queries, stored procedures, and user-defined functions in Snowflake to support data processing and analytics requirements.​
  • Optimize SQL code and query performance by understanding query execution plans, indexing strategies, and query optimization techniques.​
  • Implement query performance tuning and indexing strategies to improve overall system performance.​
  • Data Quality and Governance:​
  • Implement data quality checks and validation processes to ensure the accuracy, consistency, and integrity of data in Snowflake.​
  • Collaborate with data governance teams to enforce data quality standards and compliance with data regulations.​
  • Implement and maintain data security measures in Snowflake to ensure data privacy and compliance.​
  • Document data models, ETL processes, data transformation rules, and best practices for future reference and knowledge sharing.​
  • Participate in code reviews, quality assurance, and documentation reviews.​

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Other jobs at Infinity-Outsourcing

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.