Key Facts

Remote From:

India

Category: Data Engineer

Full time

Senior (5-10 years)

English

Hard Skills

Data Engineering MongoDB MySQL Build Pipeline Data Quality Data Integrity Python (Programming Language) Informatica

Other Skills

•
Communication
•
Teamwork
•
Mentorship

Roles & Responsibilities

Proficiency in MongoDB
MySQL experience
Snowflake SQL knowledge
Python knowledge (including ETL frameworks like Rivery or Informatica)

Requirements:

Understand the business requirements
Write code and implement the proposed solutions
Create data pipelines, versioning and change management
Manage the complexity inherent in versioned data pipelines

3Pillar

About 3Pillar

3Pillar Global builds breakthrough software products that power digital businesses. 3Pillar is an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing and Information Services. Leveraging a lean and agile approach, 3Pillar delivers value-generating, digital solutions with specialized product strategy and management, user experience design, as well as software and data engineering expertise across mobile, cloud, and disruptive technologies. For more information on the company and our services, please visit https://www.3pillarglobal.com. For current job openings in North America, APAC, LATAM and EMEA, please visit https://www.3pillarglobal.com/career-opportunities/.

Company type: Large

Industry:

Founded: 2018

Company size: 1001 - 5000

Website LinkedIn See all jobs →

Job description

Snowflake Senior Data Engineer

🌟 Accomplished Tech Visionary:

Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🔮🌐

Key Responsibilities:

Understanding the business requirements

Writing code and implementing the proposed solutions

Creating data pipelines, versioning and change management

Manage the complexity inherent in versioned data pipelines

Develop ETL/ELT processes to help extract and manipulate data from multiple sources.

Design, build and maintain batch or real-time data pipelines in production.

Automate data workflows such as data ingestion, aggregation, and ETL processing.

Logging and instrumentation of pipelines and services.

Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.

Train and mentor junior engineers.

Job Description: Data Engineer

NoSQL-to-RDBMS Mapping: Flatten and normalize complex, nested JSON data from MongoDB into structured relational tables.

Pipeline Development: Build and manage reliable ETL pipelines to ingest data from MongoDB, process it via Snowflake, and load it into MySQL.

Database Optimization: Design, index, and tune target MySQL databases to ensure high performance and strict data integrity.

Snowflake Utilization: Leverage Snowflake's variant handling capabilities to efficiently stage, parse, and transform semi-structured data.

Technical Stack: Proficiency in MongoDB, MySQL, Snowflake SQL, good to have Python (including ETL frameworks like rivery or informatica).

What is it like working for 3Pillar Global?

At 3Pillar, we offer a world of opportunity:

Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach.
You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams.
We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.
Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
We are an equal opportunity employer. It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally.