Logo for Meazure Learning

Senior Data Engineer

Roles & Responsibilities

  • 5-8+ years of experience as a data engineer or in a related role, with a proven track record of building and maintaining data systems
  • Strong experience with cloud ecosystems (Azure: Data Factory, Synapse, ADLS, Databricks; AWS: Glue, Redshift, S3, Lambda) and proficiency in Python, SQL, and PySpark
  • ETL/ELT design, development, and optimization, including complex data transformations and data quality validation
  • BI analytics integration and data modeling expertise, including Power BI (DAX), data modeling, performance tuning, and familiarity with data cataloging and lineage tools

Requirements:

  • Data Pipeline Development: design, build, and maintain scalable data pipelines to process data from multiple sources; use Azure Data Factory, AWS Glue, or Apache Airflow; implement ETL/ELT with Python, SQL, PySpark; ensure data quality validation and automated monitoring; integrate data from APIs, SaaS, and on-prem sources
  • Data Modeling and Architecture: design data models supporting BI/analytics; manage data warehouses and data lakes (Snowflake, Azure Synapse, Redshift; ADLS, S3, Delta Lake); implement partitioning, clustering, indexing; align with enterprise data architecture and Data Mesh/Lakehouse principles
  • Collaboration and Cross-Functional Support: work with data scientists, analysts, and BI teams to ensure data availability; collaborate with DevOps and platform teams for CI/CD and IaC deployment via Terraform or CloudFormation; provide data solutions and troubleshoot issues
  • Continuous Improvement and Best Practices: optimize data workflows for performance, scalability, and cost; monitor and tune data processing performance; maintain documentation; promote CI/CD, version control (Git), and Agile methodologies; stay updated with cloud-native and AI-driven data management trends

Job description

At Meazure Learning, we aim to empower open-minded, inquisitive, and driven people, and we love how each new addition to the team adds to our culture. Here, you can positively impact the careers of millions of test-takers and reshape the education technology landscape by working toward one vision:

“To provide life-long learners across the globe the freedom to pursue their academic dreams and career aspirations safely, securely, and conveniently.”

Our Vision starts with our values—Hungry, Humble, and Smart. We are looking for team members who model drive for results, think of the organization and team first without ego or agenda, and lead with emotional intelligence. This is the foundation of success for all employees at Meazure Learning.

The Role:

The Sr. Data Engineer I will be responsible for designing, building, and maintaining scalable data pipelines and systems to support the organization’s data-driven initiatives. This role will work closely with data scientists, analysts, and other stakeholders to ensure data is easily accessible, clean, and reliable for analysis and reporting. The Sr. Data Engineer I will help drive improvements in data architecture and performance, ensuring that data can be leveraged for actionable insights to drive the business forward.

The Responsibilities:

Data Pipeline Development:

  • Design, build, and maintain scalable and reliable data pipelines to process and transform large volumes of data from various sources. Should have experience using tools such as Azure Data Factory, AWS Glue, or Apache Airflow.
  • Work with cross-functional teams to understand data requirements and ensure that data is collected, processed, and stored in an optimal way for analytics and reporting.
  • Implement and optimize ETL / ELT processes to ensure efficient and accurate data delivery to stakeholders using Python, SQL, and PySpark, integrating data from APIs, SaaS systems, and on-premises sources.
  • Implement data quality validation frameworks and automated monitoring for data accuracy and timeliness.

Data Modeling & Architecture:

  • Design and implement data models that support business intelligence and analytics needs, ensuring data is structured efficiently and meets reporting and analytical requirements. Should have practical exposure to Snowflake, Azure Synapse, or Redshift.
  • Develop and manage data warehouses and data lakes using Azure Data Lake Storage (ADLS), S3, or Delta Lake, ensuring performance, scalability, and cost optimization.
  • Implement data partitioning, clustering, and indexing strategies to enhance query performance.
  • Collaborate with data architects to define and evolve the enterprise data architecture and adopt Data Mesh or Lakehouse principles where applicable

 Collaboration & Cross-Functional Support:

  • Work closely with data scientists, data analysts, and other teams to understand data needs and ensure data is available for analysis and reporting.
  • Work closely with BI teams to ensure seamless data flow and integration with visualization tools such as Power BI, Tableau, or Looker.
  • Collaborate with DevOps and platform teams to ensure CI/CD integration and infrastructure-as-code (IaC) deployment using Terraform or CloudFormation.
  • Provide technical expertise to other departments by developing data solutions that support key business objectives.
  • Troubleshoot and resolve data-related issues, ensuring the reliability and accuracy of the data.

Continuous Improvement & Optimization:

  • Optimize data workflows for performance, scalability, and cost efficiency, leveraging Spark optimization, Snowflake query tuning, and auto-scaling techniques.
  • Expertise in Snowflake architecture, including virtual warehouses, time travel, and query optimization.
  • Continuously monitor and improve data pipeline performance, addressing any bottlenecks or inefficiencies.
  • Stay current with emerging trends in data engineering, cloud-native architecture, and AI-driven data management

Documentation & Best Practices:

  • Create and maintain thorough documentation of data pipeline workflows, data models, and architectural decisions.
  • Promote data engineering best practices and contribute to establishing standards for data quality, security, and governance.
  • Promote CI/CD, version control (Git), and Agile methodologies in data engineering workflows.

The Desired Attributes:

  • Advanced Data Engineering Skills: Strong experience with Azure (ADF, Synapse, ADLS, Databricks) and/or AWS (Glue, Redshift, S3, Lambda) cloud ecosystems. Proficiency in Python, SQL, and PySpark, with experience building modular, reusable data frameworks.
  • ETL / ELT Experience: Solid understanding and experience building, maintaining, and optimizing ETL / ELT pipelines, including handling complex data transformations.
  • BI & Analytics Integration: Hands-on experience with Power BI, including DAX, data modeling, and performance tuning. Familiarity with data cataloging and lineage tools.
  • Data Architecture Expertise: Knowledge of data modeling, database design, and big data technologies, with the ability to design scalable data infrastructure.
  • Problem-Solving and Analytical Thinking: Strong ability to diagnose and solve technical issues and optimize data processing workflows.
  • Collaboration Skills: Ability to work well within cross-functional teams and with business stakeholders to understand their data needs. Ability to communicate complex technical concepts clearly and effectively to non-technical stakeholders.
  • Attention to Detail: Strong focus on data quality and accuracy to ensure that data is reliable and suitable for analytics.
  • Experience: At least 5-8 years of experience as a data engineer or in a related role, with a proven track record of building and maintaining data systems.
  • Educational Background: A degree in Computer Science, Engineering, Data Science, or a related field, or equivalent professional experience.

The Benefits:

  • Company-Sponsored Health Insurance 
  • Competitive Pay
  • Remote work
  • Healthy Work Culture
  • Career Growth Opportunities
  • Learning and Development Programs
  • Referral Award Program
  • Company-Provided IT Equipment (for remote team members)
  • Transportation Program (for on-site team members)
  • Company-Provided Meals (for on-site team members)
  • 14 Company-Provided Holidays
  • Generous Leave Program

Learn more at www.meazurelearning.com     


 Meazure Learning is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: Meazure Learning is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Meazure Learning are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Meazure Learning will not tolerate discrimination or harassment based on any of these characteristics.

 


Monday through Friday
2:00 PM - 11:00 PM IST

Data Engineer Related jobs

Other jobs at Meazure Learning

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.