Data Engineer (pre-senior)

Job Description: 

We are seeking a highly skilled Senior Developer to join our team. The ideal candidate will have strong experience in SQL, Python, and data engineering, with a focus on troubleshooting, documenting, and resolving data issues. You will play a critical role in ensuring the integrity of our data pipelines and will work closely with other teams to address and escalate issues as necessary.

Key Responsibilities:

• Correct and convert SQL queries as needed to meet project requirements.
• Gather and analyze relevant information regarding reported issues.
• Trace and identify the origin of specific issues within our data pipelines.
• Provide initial feedback to the issue reporter, ensuring clear and timely communication.
• Document all aspects of the issue, including actions taken, timelines, time spent, and any impediments encountered.
• Summarize findings and escalate issues to the core Data Engineering (DE) team for further action when necessary.
• Follow existing Standard Operating Procedures (SOPs) or develop new ones to address unique challenges.
• Make intuitive connections between data inputs and outputs to identify and resolve potential issues.

Required Skill Set:

• SQL: Proficiency in writing and optimizing SQL queries is essential.
• Python: Strong experience with Python for data manipulation and automation.
• HANA Studio: Experience with HANA Studio, including working with native SQL.
• Airflow: Experience with Apache Airflow for workflow management and automation.
• Data Issue Tracing: Ability to independently trace and communicate data issues and propose solutions.
• Communication: Strong English communication skills, both written and verbal, are necessary for effective collaboration and documentation.

Additional Qualifications:

Ability to follow detailed SOPs and develop new ones as needed.

Strong problem-solving skills and the ability to make intuitive connections between data inputs and outputs.