Offer summary

Qualifications:

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field., 5–10 years of experience in data engineering or related roles., Expertise in Azure Databricks, Delta Lake, and Spark, with strong proficiency in Python., Experience with Azure Data Lake, Azure Data Factory, and related Azure services..

Key responsibilities:

Design, build, and maintain large-scale, distributed data pipelines using Azure Databricks and Py Spark.

Develop and optimize data workflows and ETL processes in Azure Cloud environments.

Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

Monitor and troubleshoot data pipelines for performance and reliability issues.

Job description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Data Engineer

Locations- Kochi/Chennai/Coimbatore/Mumbai/Pune/Hyderabad

Job Overview: We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. The ideal candidate will have deep expertise in Azure Databricks and Python, and experience building scalable data pipelines. Familiarity with Data Fabric architectures is a plus. You’ll work closely with data scientists, analysts, and business stakeholders to deliver robust data solutions that drive insights and innovation.

Key Responsibilities:

• Design, build, and maintain large-scale, distributed data pipelines using Azure Databricks and Py Spark.

• Design, build, and maintain large-scale, distributed data pipelines using Azure Data Factory

• Develop and optimize data workflows and ETL processes in Azure Cloud environments.

• Write clean, maintainable, and efficient code in Python for data engineering tasks.

• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

• Monitor and troubleshoot data pipelines for performance and reliability issues. • Implement data quality checks, validations, and ensure data lineage and governance.

• Contribute to the design and implementation of a Data Fabric architecture (desirable).

Required Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

• 5–10 years of experience in data engineering or related roles.

• Expertise in Azure Databricks, Delta Lake, and Spark. • Strong proficiency in Python, especially in a data processing context.

• Experience with Azure Data Lake, Azure Data Factory, and related Azure services.

• Hands-on experience in building data ingestion and transformation pipelines.

• Familiarity with CI/CD pipelines and version control systems (e.g., Git).

Good to Have:

• Experience or understanding of Data Fabric concepts (e.g., data virtualization, unified data access, metadata-driven architectures).

• Knowledge of modern data warehousing and lakehouse principles. • Exposure to tools like Apache Airflow, dbt, or similar.

• Experience working in agile/scrum environments.

• DP-500 and DP-600 Certifications

What We Offer:

• Competitive salary and performance-based bonuses.

• Flexible work arrangements.

• Opportunities for continuous learning and career growth.

• A collaborative, inclusive, and innovative work culture.

www.orioninc.com

(21) Orion Innovation: Company Page Admin | LinkedIn

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

What information we collect during our application and recruitment process and why we collect it;
How we handle that information; and
How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.

Required profile