Data Engineer

We are looking for Data Engineers of all levels ( Junior, Middle, Senior ) to build, optimize and maintain conceptual and logical database models. You should know how to analyze system requirements and implement migration methods for existing data. Hands-on experience with SQL and Oracle is required. Ideally, you are familiar with predictive analysis and data visualization techniques using relevant tools (e.g. Tableau, D3.js and R.)

What you will be doing:

• Deliver across the entire software delivery life cycle in an agile fashion – concept, design, build, deploy, test, release through to post implementation support for new data pipelines and data science products.
• Profile data, build data pipelines and orchestrate data flows.
• Design, creation and testing of CI/CD pipelines for each product.
• Ensure all deliverables are well documented, re-usable, tested and conform to agreed architecture design patterns and coding standards.
• Undertake analytical activities required to support the development and maintenance of systems.
• Provide support on key products should there be an incident / problem related to a developed product that requires a development fix.
• Support the project/backlog delivery events; planning / user story estimation, daily stand-ups, sprint reviews/ demos & retrospectives.
• Support / collaborate with the data science and platform teams by taking ownership of driving forward relevant stories (updating the ticket on the Kanban board & Jira).
• Passionate about building, maintaining and optimizing scalable ML/data science-based data products.

What you will need:

• Strong educational background with a minimum of bachelors in computer science
• Strong hands-on experience with of Python and/or Java to build data pipelines and orchestrate data flows.
• Proven experience using R, Python or SQL.
• Azure Data Services (Data Factory, Databricks, Synapse Analytics)
• Good understanding of data profiling and data types such as JSON and XML
• Hands-on experience with data storage systems such as Azure Blob Storage and Azure Data Lake.
• Good knowledge of version control system such as Git for code check in and PR’s
• Solid experience of T-SQL (stored procedures, functions)
• Integration and ETL experience
• Experience deploying code as part of CI/CD pipelines in Azure DevOps stack
• Experience of provisioning the Azure PAAS/IAAS environments through CI/CD pipelines
• Understanding of general infrastructure, networking & security best practices
• Experience of using AzureML and Databricks.

Benefits:

• Opportunities for immense growth
• Remote job: freedom and flexibility
• Competitive Salaries
• Be a part of large global teams
• Opportunities to learn new in-demand skills