Somente para BR [COPE] - Senior Data Engineer

Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

Minimum 7 years of experience with Python for data analysis and transformation., Proficiency in Python 3+ and libraries like Pandas, NumPy, SciPy., Deep experience with SQL and relational databases such as Oracle, Postgres, or MS SQL Server., Degree or equivalent in computer science, engineering, or related fields..

Key responsibilities:

  • Develop and optimize large datasets using Python and SQL.
  • Troubleshoot data processes and develop improvement solutions.
  • Design and maintain data models, schemas, and documentation.
  • Collaborate with cross-functional teams and mentor other developers.

FoodChain ID logo
FoodChain ID Food & Beverages SME https://www.foodchainid.com/
501 - 1000 Employees
See all jobs

Job description

Title: Senior Data Engineer

Job Duties:

· Use Python and SQL to efficiently create, extract, transform, and optimize very large datasets.

· Troubleshoot data and data processes and develop solutions for improvement.

· Develop and maintain data models, schemas, and documentation.

· Contribute as a hands-on engineer while sometimes taking the lead in the technical design and solution.

· Collaborate daily with data scientists, food scientists, product owners, team members, API developers, architects, and DevOps engineers.

· Advise other developers, both junior and senior, and share best practices.

This job description is not intended to be all-inclusive. Employees may be asked to perform additional tasks as required, that may or may not be related to their primary duties.

Required Qualifications:

· Minimum 7 years’ experience using Python for analyzing, extracting, creating, and transforming large datasets.

· Proficiency in Python 3+ and common Python libraries for data engineering and data science, specifically Pandas, NumPy, and SciPy.

· Deep experience with SQL and relational data using Oracle, Postgres, or MS SQL Server.

· Solid understanding of database design principles, data modeling, and data warehousing concepts.

· Excellent troubleshooting skills and instincts.

· Curious, self-motivated, and self-directed; comfortable working within an Agile software development team with short, iterative delivery cycles.

· College degree or equivalent experience in computer science, software development, engineering, information systems, math, food science, or other applicable field of study.

Preferred Qualifications:

· NoSQL database design and development using MongoDB, AWS DynamoDB, or Azure Cosmos DB.

· Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage/processing

· Exposure to Terraform or other Infrastructure-as-Code tooling.

· Proficient in Azure DevOps for source code and pipeline management.

Location: Remote

Job Type: Full Time

Required profile

Experience

Industry :
Food & Beverages
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Troubleshooting (Problem Solving)
  • Self-Motivation
  • Curiosity

Data Engineer Related jobs