Offer summary

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, or related field., Over 10 years of experience in data engineering with strong expertise in Python, PySpark, and AWS services., Proven leadership skills with the ability to mentor and guide technical teams., Experience with distributed data processing frameworks and cloud-based architecture..

Key responsibilities:

Provide technical leadership in designing and implementing data engineering solutions.

Develop and optimize ETL pipelines using AWS services like Glue and Lambda.

Create scalable distributed data processing frameworks for large datasets.

Collaborate with stakeholders to understand requirements and communicate progress effectively.

Job description

Job Title: Tech Lead
Location: Remote Canada
Job Title: Tech Lead Data Engineering Job Summary: We are looking for a highly skilled and motivated Tech Lead of Data Engineering to spearhead the development of scalable and efficient data engineering solutions. The ideal candidate will possess deep expertise in Python, PySpark, AWS services, and streaming data platforms, with a proven ability to integrate complex data sources and develop distributed data processing frameworks. This role requires a strong technical leader who can guide the team, solve complex challenges, and deliver optimal solutions that align with client requirements. Healthcare experience is an added benefit.

Key Responsibilities:Technical Leadership:

Provide handson technical leadership to the team in designing and implementing data engineering solutions.

Lead by example in adopting best practices for coding, testing, and deployment.

ETL Development:

Design and develop robust ETL pipelines using AWS Glue, Lambda, and other AWS services to process large volumes of data efficiently.

Implement complex data transformations and integrate data from multiple sources such as APIs, databases, and streaming platforms.

Distributed Data Processing:

Develop distributed data processing frameworks to ensure performance and scalability in handling large datasets.

Optimize the performance of data processing jobs for both batch and realtime workloads.

Solutioning & Architecture:

Provide optimal data engineering solutions aligned with client requirements and business objectives.

Collaborate with architects to design scalable and secure data solutions leveraging AWS cloud services.

AWS Expertise:

Utilize AWS services (e.g., S3, Glue, Lambda, Kinesis, DynamoDB) to build efficient and scalable cloudbased solutions.

Stay updated with the latest AWS services and features to continuously improve system performance and cost efficiency.

Stakeholder Collaboration:

Work closely with clients, business analysts, and other stakeholders to understand requirements and translate them into technical solutions.

Communicate progress, challenges, and solutions effectively to both technical and nontechnical stakeholders.

Qualifications:
Education:

Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.

Experience:

10+ years of experience in data engineering.

Strong handson expertise in Python, PySpark, and AWS services for data processing and integration.

Extensive knowledge of distributed data processing frameworks and best practices.

Skills:

Strong problemsolving and solutionoriented mindset to deliver optimal results.

Excellent knowledge of data integration techniques and cloudbased architecture.

Proficient in implementing complex data transformations and scalable data workflows.

Exceptional team leadership and mentoring abilities.

Strong communication skills for effective stakeholder collaboration.

Preferred Qualifications:
AWS Certified Solutions Architect certification or equivalent.

Familiarity with Terraform or CloudFormation for AWS infrastructure as code.

Wealth Management domain experience.

Why Join Us?
Be a key player in building cuttingedge data engineering solutions for largescale projects.

Work with a talented and collaborative team in a dynamic environment.

Competitive salary, benefits, and opportunities for career growth.