Job Title: Data Engineer
Years of Experience: 5+ Years
Relevant Experience: 5 Years
Headcount: 1
Job/Work type: Remote
Location: PAN India
Time Zone: IST (12pm to 9pm)
Project Name:---
Client:-- I-Vereve
End Client:---
Mandatory Skills: SQL and Python scripts,Postgress
Job Description:
Job Description:
Data Engineer
- The candidate would need at least significant geospatial data experience or significant experience in dataiku,
- experience in optimizing database (Postgress)
- data structuring according to business priorities
Also, I'm sharing with you a more thorough description of the role below.
- The data engineer's mission is to always keep up to date all the basic data essential to the functioning of the AI: market data, local town planning plans, land registry, buildings, topography, etc.
- He or she is responsible for the data architecture : maintaining existing automation of dataflows (mostly in Dataiku, but some also in Dagster). As well as continuing to build new dataflows and to automate in Dataiku (SQL and Python scripts) the data flows that had remained manual .
- He or she is also responsible to enhance monitoring and alerting of our databases and dataflow.
- Arbitrations and architectural vision: formalization and updating of the conceptual data model used, graph of functional dependencies, and regular interactions with developers and product owners for the evolution of the model.
R&D: improvement/automation of current business scripts, construction and industrial production of new indicators linked to the business division, and use of APIs and web services.
Profile
- Autonomy, rigor, proactivity, and a true curiosity for the business logic behind data models are essential qualities of the position.
- Significant experience in designing and managing complex databases.
- Excellent technical level in PostgreSQL DBMS and SQL spatial queries, knowledge of GDAL/OGR libraries
OR
- Significant experience working with Dataïku software
- Must have significant experience with ETLs or very good knowledge of Python.
- Execution of scripts in Bash shell, Python, SQL, network concepts/API/web applications. Experience of working in a Kubernetes environment is very appreciated.
Most of the team is based in Paris, so we would need the candidate to adapt to working during French office hours.
