Logo for ICONMA

Senior Data Engineer (Azure Databricks / Data Engineering)

ICONMA

Role overview

Qualifications

  • University or post-graduate degree
  • 7 + years relevant experience in data engineering
  • Deep hands-on experience with ADLS, ADF, Azure Databricks, Azure SQL, and Airflow
  • Strong communication, facilitation, and stakeholder management skills across business and technology teams.

Responsibilities

  • Leverage deep technology expertise in data engineering, Azure Databricks, Python, SQL, and cloud data platforms.
  • Execute on Engineering strategy for automation of data ingestion, transformation, and deployment activities.
  • Partner with Operations team for automated/self-serve data pipeline integration.
  • Act as the expert and innovator for data engineering practices and platform standards.

About the company

ICONMA logo

ICONMA

Human Resources, Staffing & Recruiting

We provide Professional Staffing Services & Project-Based Solutions for a broad range of Fortune 500 organizations. ICONMA is a certified Woman-Owned staffing company and was founded in 2000. ICONMA’s corporate headquarters is in Troy, Michigan, and has 15+ locations worldwide. What makes ICONMA stand out in a fiercely competitive industry? *We provide integrated, full lifecycle services across a broad range of business and technical platforms. *No single company can duplicate our full range of staffing and permanent recruiting services nationwide. *Proven track record of attracting and retaining exceedingly skilled professional workers in a highly competitive market. SERVICES OFFERED Staff Augmentation (Contract, Contract to Hire, Direct Hire, Single Source) Data Analysis Project-Based Services & Solutions Hire Train Deploy Service Model Offshore Staff Augmentation Payroll Services AREAS OF EXPERTISE - Information Technology - Engineering - Business Professional - Accounting/Finance - Admin/Clerical/Call Center - Healthcare/Clinical/Scientific - Marketing/Creative mail linkedin@iconma.com Phone (888) 451-2519 Website http://www.iconma.com

Company details

Company typeLarge
IndustryHuman Resources, Staffing & Recruiting
Company size1001 - 5000

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Our Client, a Banking company, is looking for a Senior Data Engineer (Azure Databricks / Data Engineering) for their Toronto, ON /Remote location.
 
Responsibilities:
  • Customer
  • Leverage deep technology expertise in data engineering, Azure Databricks, Python, SQL, and cloud data platforms for own area of specialization to deliver and ensure that all areas across the organization that provision, manage and support various technologies have the necessary tools, processes and documentation required to effectively execute on their respective mandates
  • Execute on Engineering strategy as it relates to the introduction of tools and the automation of data ingestion, transformation, notebook execution, job scheduling, and deployment activities across Azure Databricks, ADF, Airflow, API services, and Azure-based data platforms
  • Partner with the Operations team to automatically integrate with appropriate tools and processes as part of automated/self-serve data pipeline, notebook job, and API service releases
  • Work with partners across Technology and apply in-depth understanding of relevant business data needs to identify and leverage synergies across the various areas
  • Act as the expert or lead innovator and agent of change for the programs and services under management, driving modern data engineering practices, reusable frameworks, and platform standards
  • Work with other teams to implement best practices for engineering and management, including enterprise-grade software development, reusable engineering frameworks, and AI integration into the SDLC through reusable prompts, skills, instructions, and agents
  • Work with vendor platform providers and engineering peers to keep abreast of trends, products, frameworks, and applications
  • Identify and effectively manage stakeholder engagement and impacts across the enterprise
  • Interpret client needs, assess engineering related requirements, and identify solutions to non-standard requests
  • Shareholder
  • Apply best practices and knowledge of internal / external business issues to improve products or services in own discipline
  • Monitor and control costs within own work
  • May interact with governance and control groups, (e.g. regulatory / operational risk, compliance, and audit) to provide subject matter expertise and consult on risk issues / items related to Engineering technology and tools
  • May develop and/or contribute to negotiations of third-party contracts/agreements
  • Maintain knowledge and understanding of external development, engineering and emerging solutions, market conditions, and their impact, with particular focus on cloud data engineering, Databricks capabilities, API enablement, and scalable data processing patterns
  • Proactively identify emerging technologies and innovative solutions for building more robust platform domains, including data platforms capable of handling multi-millions of records daily with strong reliability, governance, and performance
  • Employee / Team
  • Continuously enhance knowledge/expertise in own area and keep current with emerging industry trends, new technologies and best practices in the external market that can contribute to delivering effective client solutions across Azure Databricks, ADLS, ADF, Azure SQL, Airflow, SQL, API service development, and modern data engineering tooling
  • Prioritize and manage own workload in order to deliver quality results and meet timelines
  • Support a positive work environment that promotes service to the business, quality, innovation, and teamwork and ensure timely communication of issues/ points of interest
  • Participate in knowledge transfer with senior management, the team, other technical areas and business units
  • Work effectively as a team, supporting other members of the team in achieving business objectives and providing client services
  • Identify and recommend opportunities to enhance productivity, effectiveness and operational efficiency of the business unit and/or team through reusable data engineering components, automated orchestration, AI-assisted SDLC practices, and scalable processing frameworks
  • Breadth & depth
  • Expert knowledge of specific domain or range of engineering frameworks, technology, tools, processes and procedures, as well as organization issues, with specialization in Azure Databricks, Python notebook development, job orchestration, SQL, API service layers, ADLS, ADF, Azure SQL, Airflow, Unity Catalog, and Lakeflow
  • Expert knowledge of client  applications, systems, networks, innovation, design activities, best practices, business / organization, Bank standards, and may fulfill a governance role across enterprise data ecosystems, data governance, and scalable cloud platform implementations
  • Expert knowledge and experience in own discipline as a senior data engineer building enterprise-grade software, reusable frameworks, and robust data services; integrates knowledge of business and functional priorities
  • Acts as a key contributor in a complex and critical environment delivering scalable data solutions that support processing of multi-millions of records daily
  • May provide leadership to teams or projects; shares expertise
  • Applies in-depth skills and broad knowledge of the business to address complex problems and non-standard situations involving large-scale data ingestion, transformation, orchestration, API enablement, and governed analytics platforms
  • Generally, reports to a Senior Manager or above
 
Requirements:
  •  
  • Education
  • University or post-graduate degree
  • Strong academic background (e.g., computer science, engineering, math)
  • Must have skills:
  • 7 + years relevant experience in data engineering
  • Azure Databricks
  • Python notebooks
  • Job orchestration
  • SQL development,
  • API service layer implementation
  • Deep hands-on experience with ADLS, ADF, Azure Databricks (with Unity Catalog and Lakeflow), Azure SQL, and Airflow
  • Strong communication, facilitation, and stakeholder management skills across business and technology teams.
  • Nice to have skills:
  • Integrating AI into the SDLC using reusable prompts, skills, instructions, and agents
  • Building enterprise-grade software and frameworks
  • Designing scalable solutions capable of handling multi-millions of records daily.
 
Why Should You Apply?

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Data Engineer Related jobs

CanadaData Engineer

Other jobs at ICONMA

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.