Bachelor's degree in data engineering, big data analytics, computer engineering, or related field.
Proficiency in Python, C++, Java, R, and SQL; familiarity with Hadoop or an equivalent framework.
Proven experience as a data engineer, software developer, or similar; excellent analytical and problem-solving skills.
Master's degree in a relevant field is advantageous; capacity to manage a pipeline of duties with minimal supervision and work both independently and in a team.
Requirements:
Liaise with coworkers and clients to elicit requirements and translate them into data engineering tasks.
Design, build, and optimize infrastructure to enable big data access, storage, and analysis.
Reformulate existing frameworks to improve performance and reliability; test structures to ensure fitness for use; detect and correct errors.
Prepare raw data for manipulation by data scientists; ensure backups and easy accessibility; stay up-to-date with industry standards and advancements.
Job description
Liaising with coworkers and clients to elucidate the requirements for each task.
Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
Reformulating existing frameworks to optimize their functioning.
Testing such structures to ensure that they are fit for use.
Preparing raw data for manipulation by data scientists.
Detecting and correcting errors in your work.
Ensuring that your work remains backed up and readily accessible to relevant coworkers.
Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.
Data Engineer Requirements:
Bachelor's degree in data engineering, big data analytics, computer engineering, or related field.
Master's degree in a relevant field is advantageous.
Proven experience as a data engineer, software developer, or similar.
Expert proficiency in Python, C++, Java, R, and SQL.
Familiarity with Hadoop or suitable equivalent.
Excellent analytical and problem-solving skills.
A knack for independence and group work.
Scrupulous approach to duties.
Capacity to successfully manage a pipeline of duties with minimal supervision.
