Match score not available

Senior Data Engineer

extra holidays - fully flexible
Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

Minimum of 5+ years of experience as a data engineer or in a similar role., Advanced SQL skills and experience with relational databases and database design., Strong Python skills with hands-on experience in data-related libraries like Pandas and NumPy., Experience with cloud Data Warehouse solutions and Big Data technologies..

Key responsabilities:

  • Understand business requirements and write code to implement solutions.
  • Create and manage data pipelines, ensuring versioning and change management.
  • Develop ETL/ELT processes for data extraction and manipulation from multiple sources.
  • Train and mentor junior engineers while ensuring data accuracy and compliance.

3Pillar logo
3Pillar Large http://www.3PillarGlobal.com/
1001 - 5000 Employees
See all jobs

Job description

🌟 Accomplished Tech Visionary: 

Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🔮🌐

We are 3PILLAR GLOBAL 

We build breakthrough software products that power digital businesses. We are an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing, Information Services, and Retail. 

Our key differentiator is our Product Mindset. Our development teams focus on building for outcomes and all of our team members around the globe are trained on the Product Mindset’s core values – Minimize Time to Value, Solve For Need, and Excel at Change. Our teams apply this mindset to build digital products that are customer-facing and revenue-generating. Our business-minded approach to agile development ensures that we align to client goals from the earliest conceptual stages through market launch and beyond. 

Key Responsibilities
  • Understanding the business requirements
  • Writing code and implementing the proposed solutions
  • Creating data pipelines, versioning and change management
  • Manage the complexity inherent in versioned data pipelines
  • Develop ETL/ELT processes to help extract and manipulate data from multiple sources.
  • Design, build and maintain batch or real-time data pipelines in production.
  • Automate data workflows such as data ingestion, aggregation, and ETL processing.
  • Logging and instrumentation of pipelines and services.
  • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
  • Train and mentor junior engineers.

  • Minimum Qualifications
  • Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
  • Advanced SQL skills and experience with relational databases and database design.
  • Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
  • Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
  • Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
  • Proficiencient in data pipeline and workflow management tools e.g. Airflow
  • Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
  • Experience with the AWS/Azure/GCP data engineering services
  • Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM or,
    Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
  • Very good exposure of working on Data Lakes & Data Warehouses solutions
  • Excellent problem-solving, communication, and organizational skills.
  • Proven ability to work independently and with a team.
  • Ability to guide other data engineers.

  • Additional Experience Desired
  • Experience working with data ingestion tools such as Fivetran, stitch, or Matillion.
  • Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.
  • Familiarity with machine learning technologies.
  • Experience in Java or Scala

  • BENEFITS
  • Medical Insurance benefits as per company policy. 
  • Life Insurance as per company policy
  • 15 days of paid vacation, sick leave and paid holidays as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Sick leave and paid holidays as per local law
  • Christmas and Middle year bonuses as per local law
  • Monthly productivity bonus as per local law
  • Discounts in local shops
  • Direct deposit of payroll.
  • Paid professional certifications

  • #Li-remote

    What is it like working for 3Pillar Global?
  • At 3Pillar, we offer a world of opportunity:
  • Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach. 
  • You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams. 
  • We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.
  • Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
  • We are an equal opportunity employer. It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally. 

  • Join us and be a part of a global tech community! 🌍💼  Check out our Linkedin site and Careers page to learn more about what it’s like to be part of our #oneteam! 

    Required profile

    Experience

    Industry :
    Spoken language(s):
    English
    Check out the description to know which languages are mandatory.

    Other Skills

    • Organizational Skills
    • Teamwork
    • Communication
    • Problem Solving

    Data Engineer Related jobs