Logo for Matrix-IFS

Data engineer

Role overview

Summary

This role focuses on developing and maintaining production-grade data pipelines within Matrix's platform. You will collaborate with customers and technical teams to deliver reliable data solutions that support machine learning and analytics use cases.

Qualifications

  • Strong hands-on experience with Python, including Pandas.
  • Experience with Apache Spark and PySpark for distributed data processing.
  • Strong SQL skills and experience analyzing large datasets.
  • Practical experience with Apache Airflow and workflow orchestration.
  • Familiarity with Hadoop ecosystem technologies such as Hive, Impala, HDFS, and Sqoop.

Responsibilities

  • Implement, maintain, and support production data pipeline flows based on solution designs and business requirements.
  • Design and develop use-case-specific data flows, machine learning pipelines, and data tools for analytics and data science teams.
  • Build and optimize data processing workflows using Apache Spark, PySpark, Python, SQL, Git, and Apache Airflow.
  • Analyze structured and semi-structured datasets to support pipeline design and implementation.

Key facts

Hard skills

Key skills for this role

Other skills

  • Problem Solving

About the company

Matrix-IFS logo

Matrix-IFS

  • IT Services & Consulting
  • XLarge
  • 10,001+
Matrix International Financial Services is a leading global specialist, providing business and technology solutions specifically for the complex needs of the global Financial Industry and Capital Markets. Headquartered in Jersey City, New Jersey Matrix-IFS offers specialized Consulting, Systems Integration and Managed Services which include Trade Surveillance, Business Intelligence (BI), AML / Case Management, Fraud Risk Prevention, Compliance, Financial Operational Risk, Cloud and Cyber-Risk Management, and Advisory Services. More than 50 financial institutions, both top-tier & local banks, rely on Matrix-IFS’ solutions. Matrix-IFS is a division of Matrix IT Ltd (Symbol MTRX.TA), which has over 11,000 employees worldwide, and offices in the U.S., UK, Israel, Eastern Europe, India, and Australia. For more details visit www.matrix-ifs.com. Matrix-IFS has developed and nurtured a broad expertise across multiple solution platforms and operational models. With our intimate knowledge of the predominant case management, compliance and fraud detection solutions on the market today including; Actimize™, Oracle™ Mantas™, Norkom™, Fortent™ and NASDAQ OMX™ SMARTS™, we help institutions establish the technology foundation of a top-performing fraud and compliance organization, and put in place the processes and resources to ensure our clients realize the financial, business and regulatory benefits of an industry-leading fraud and compliance program.Matrix-IFS (formerly known as Matrix-Exzac) operates globally with offices in New Jersey, Florida, UK, Israel and Australia.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Description

Data Engineer

Brazil or Argentina

We are seeking an experienced Data Pipeline Engineer to develop, implement, and maintain production-grade data pipelines within the platform. The role involves building scalable data flows, supporting machine learning and analytics use cases, and optimizing large-scale data processing environments.

The ideal candidate will have strong hands-on experience with Python, PySpark, Apache Spark, SQL, and big-data technologies, along with an understanding of data pipeline architecture and production operations. The candidate will collaborate closely with customers and internal technical teams to deliver reliable, business-focused data solutions.

Key Responsibilities

  • Implement, maintain, and support production data pipeline flows within the platform based on solution designs and business requirements.
  • Design and develop use-case-specific data flows, machine learning pipelines, and data tools for analytics and data science teams.
  • Build and optimize data processing workflows using Apache Spark, PySpark, Python (Pandas), SQL, Git, and Apache Airflow.
  • Work with Hadoop ecosystem technologies, including Hive, Impala, HDFS, and Sqoop.
  • Analyze structured and semi-structured datasets to understand data characteristics and support pipeline design and implementation.
  • Optimize big-data pipelines, processing architectures, and datasets to improve performance, scalability, and reliability.
  • Deploy and manage data processing workloads in Kubernetes-based environments.
  • Collaborate with customers and cross-functional teams to understand requirements and deliver effective technical solutions.
  • Apply a business-oriented approach when designing and implementing data workflows.
  • Leverage Large Language Models (LLMs), agentic coding, LLM cost optimization, and AI agent development to accelerate delivery and build data tools for internal and external use cases.

Required Skills and Experience

  • Strong hands-on experience with Python, including Pandas.
  • Experience with Apache Spark and PySpark for distributed data processing.
  • Strong SQL skills and experience analyzing large datasets.
  • Practical experience with Apache Airflow and workflow orchestration.
  • Familiarity with Hadoop ecosystem technologies such as Hive, Impala, HDFS, and Sqoop.
  • Experience with Git and production data pipeline development.
  • Understanding of structured and semi-structured data formats.
  • Experience optimizing data pipelines and workloads in Kubernetes environments.
  • Exposure to LLMs, agentic coding, AI agents, and LLM cost optimization.
  • Strong problem-solving and customer collaboration skills.

 Why Join Us?

You’ll work with a talented global team, contribute to meaningful technical initiatives, and help shape a high performing DevOps culture.

Matrix is a global, dynamic, and fast growing technology services and consulting company with over 17,000 employees worldwide. Founded in 2001, Matrix has grown through significant organic expansion and strategic acquisitions, executing some of the largest and most impactful technology projects in the market.

We specialize in the design, development, and implementation of advanced technologies, software solutions, and digital products. Our services include infrastructure and consulting, IT outsourcing and offshore delivery, training and assimilation programs, and acting as a trusted implementation and delivery partner for the world’s leading software vendors.

With deep expertise across both the private and public sectors—spanning Finance, Telecom, Healthcare, Hi Tech, Education, Defense, and Security—Matrix serves a strong customer base in Israel alongside a continuously expanding global client portfolio.

At Matrix, our people are at the heart of our success. We are a community of talented, creative, and dedicated professionals who are passionate about innovation and excellence. We actively attract, develop, and retain top talent, recognizing that every employee’s contribution is critical to our continued growth and future success.

Matrix’s success is built on a challenging and engaging work environment, competitive compensation and benefits, and meaningful career development opportunities. We foster a diverse, inclusive culture that encourages collaboration, continuous learning, and growth—together.

Join the winning team. Be challenged, grow your career, and enjoy the journey in a highly respected global organization.

To learn more, visit: www.matrix-ifs.com


Requirements


Related jobs

See all Data Engineer jobs

Other jobs at Matrix-IFS