Offer summary

Qualifications:

Bachelor's degree in information science, Computer Science, Mathematics, Statistics, or related fields., 5+ years of work experience in data engineering., Hands-on experience with cloud platforms like AWS or Azure., Proficiency in Python, Spark, and data management technologies..

Key responsibilities:

Design and develop data management and persistence solutions.

Build and enhance data pipelines from various sources.

Ensure high data quality and integrity in data processing.

Collaborate on deploying and maintaining data infrastructure.

Job description

This is a remote position.

6+ years’ work experience and bachelor’s degree in information science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.

Hands-on engineer who is curious about technology, should be able to quickly adopt to change and one who understands the technologies supporting areas such as Cloud Computing (AWS, Azure(preferred), etc.), Micro Services, Streaming Technologies, Network, Security, etc. 3 or more years of active development experience as a data developer using Python-spark, Spark Streaming, Azure SQL Server, Cosmos DB/Mongo DB, Azure Event Hubs, Azure Data Lake Storage, Azure Search etc.
Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities.
Build, test, and enhance data curation pipelines integration data from wide variety of sources like DBMS, File systems, APIs and streaming systems for various KPIs and metrics development with high data quality and integrity.

3+ years of experience working with source code control systems and Continuous Integration/Continuous Deployment tools.

Required profile