Offer summary

Qualifications:

Bachelor's degree in computer science or related field., 6+ years of experience as a data engineer with hands-on project experience., Proficient in data architecture concepts and coding in Python., Familiarity with tools like AWS, Kafka, and Agile methodologies..

Key responsibilities:

Build and maintain Data Lake, Data Warehouse, and Data Catalog.

Develop ETL specifications for data integration and manage data flows.

Participate in data profiling, cleaning, and quality management.

Run proof-of-concepts to evaluate new tools for data products.

Job description

Experience: 6 to 8 years

Work Type: Remote (Currently WFH)

Employement Type: FullTime

Responsibilities:

You shall be part of a growing team of Data Engineers, Data Scientists, Data Architect and Data Steward within Farm & Field Data Products (FFDP - Data specialization for Farm & Field initiatives within Digital Ag Solutions)
Your core deliverables will be to build and maintain Data Lake, Data Warehouse, Data Catalog, Data & Analytics APIs, experimentation workbench for Data Science, Geospatial Analysis, and Business Intelligence
You shall work closely with different Product and Engineering teams within DAS to build data flows, pipelines with traceable linkage, and lineage
You shall study the input data source to develop ETL specifications for data integration development and implementation
Input Data Source could be Kafka Events, streaming data from IoT Sensors, Weather APIs, CSV Files, Image Files, Bulk Data Stores, Batch-loading
Proficient in data transformations on source data, perform joins and aggregations, build Data Warehouse, feature engineering for Machine Learning and Business Intelligence
Participate in Data Profiling, Data Cleaning and Quality Management to support Data Stewards and Data Scientists in the team
You would help run proof-of-concepts to evaluate new tools/software to recommend as potential features to Yara Farm and Field Data Products

Desired Candidate Requirements:

Bachelor's degree in computer science, information technology, or a field related to computer science
6+ years experience working as a data engineer with hands-on experience in data engineering projects such as writing SQL queries, data pipelining, API provisioning, database optimization/maintenance, etc.
Knowledge of data architecture concepts such as database systems, schemas, schema registry, data warehousing, etc.
Worked with scalable architectures (micro-services, event-driven, data-mesh, Kubernetes, etc.) Able to code in Python, our preferred tech stack
Experience with Kafka, Kafka Connect, KSQL is preferred
Comfortable working with our tools: AWS, Github, Helmcharts, Jira
Aligned with our principles: agile, customer-centric, lean, service-oriented architecture, selforganization, transparency
Hands-on experience in metadata management, data modelling, data analysis, data integration tools
Preferable experience in the Agriculture Technology domain
Good communication and presentation skills
Experience in Agile (Scrum) way of working
Experience in working with cross-geography teams

Required profile