Data Engineer (Scala/Python)

We are looking for a highly skilled Data Engineer, and we are delighted that you want to be part of our team!

We're consistently choosing to help customers overcome their IT challenges providing consulting expertise to support IT strategy, outsourced operations, staff augmentation and digital transformation for companies such as ArcelorMittal, Air Liquide, Volvo Group, MLSE and many more. Take a look at our website, you can see some of the exciting work we are doing: https://www.metait.ca/

Why build your carrer at Meta?

We offer autonomy, clear goals and a dynamic and challenging environment, where professionals have the opportunity to interact with different technologies, participate in all types of projects, bring new ideas and work from anywhere in Brazil and (why not?) anywhere in the world. In addition, we are one of the best companies to work for in Brazil according to Great Place to Work and one of the 10 fastest growing technology companies in the country for 3 consecutive years, according to Anuário Informático Hoje.

Key Responsibilities

• Design, build, and maintain scalable and efficient data pipelines using Scala and Python.
• Develop and manage data processing workflows utilizing AWS services such as EMR, Athena, and Snowflake.
• Implement and optimize data storage solutions using Cassandra/AstraDB.
• Leverage Apache Spark for distributed data processing tasks.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions.
• Ensure data quality, consistency, and integrity across all data pipelines and systems.
• Perform data extraction, transformation, and loading (ETL) operations from various data sources.
• Monitor and troubleshoot data pipelines and workflows to ensure reliability and performance.
• Implement best practices for data governance, security, and compliance.
• Stay current with industry trends and emerging technologies in data engineering.
  
  

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering.
• Proficiency in Scala and Python programming languages.
• Strong experience with AWS services, including EMR, Athena, and Snowflake.
• Hands-on experience with Apache Spark for big data processing.
• Proficient in working with NoSQL databases like Cassandra/AstraDB.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Familiarity with data governance and security best practices.
  
  

About The Position

• Full-time job - 40h/week.
• Independent Contractor.
• 100% Remote Latam based.
• Able to work on CST time zone.
  
  

How’d the process work?

We have an interview with Meta IT’s HR team, your future Manager here at Meta, and if approved, a final interview directly with the client’s team.

To apply for this position, please submit your resume highlighting your relevant experience and why you are interested in this role. Only shortlisted candidates will be contacted for further evaluation. Thank you for considering this opportunity with our company.

What are our values?

• We are people serving people
• We all think and act like owners
• We are hungry for performance
• We grow and learn together
• We pursue excellence and simplicity
• We have innovation and creativity in our DNA
  
  

All people are welcome regardless of their condition, disability, ethnicity, religious belief, sexual orientation, appearance, age or others. We want you to grow up with us in a welcoming environment full of opportunities.

Did you relate? Then, #ComeBeMeta!