Data Engineer

The Data Engineer will be responsible for designing, building, and maintaining the infrastructure required for data collection, processing, and storage. This person will also be responsible for ensuring that the systems are scalable, efficient, and accurate. The ideal candidate should have experience in Java, Python or another programming language, database technologies and the ability to troubleshoot and optimize large datasets.

Responsibilities:

• Design and implement data processing pipelines, data warehouses, and data lakes.
• Build distributed, scalable, and high-performance data infrastructure.
• Collaborate with data scientists and analysts to optimize data retrieval and querying.
• Develop data models and schemas that support data structure optimization and ease of data access.
• Develop and maintain scripts and automation tools for data processing and analysis.
• Develop and maintain data quality checks, validation and error-handling routines.
• Monitor performance and provide solutions to optimize data pipelines, databases, and systems.
• Collaborate with a cross-functional team to support business needs and generate insights.
• Stay current with latest data technologies and trends.

Qualifications:** - Bachelor's or Master’s degree in Computer Science, Software Engineering, or related field. - 3+ years of experience in data engineering or a related field. - Experience with software development in Java or Python. - Experience with database technologies such as SQL and NoSQL. - Experience with ETL/ELT tools such as Airflow, NiFi, etc. - Excellent problem solving, troubleshooting, and analytical skills. - Strong communication and collaboration skills. - Familiarity with cloud computing platforms such as AWS, Azure or Google Cloud Platform.

The Data Engineer opportunity is used to fill high-volume roles or frequently hired positions to be used for future openings. By filling out an application you are joining our LiveMarket, where you have the opportunity to be matched with openings that are the right fit for you. The responsibilities and requirements of each role vary by opportunity. Our team will help guide you on how to best showcase your skills and match you to the right opportunity for you!