Data Pipeline Engineer

Our client is looking for a Data Pipeline Engineer to develop, configure and maintain data movement between various data sources and the data warehouse.

Responsibilities:

• Assemble large, complex data sets that meet functional / non-functional business requirements
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
• Build processes supporting data transformation, data structures, metadata, dependency and workload management
• Perform system administration functions for various data analytics applications (ELT, data lake, user-facing reporting applications, etc.)

Qualifications:

• Minimum of 3 Years experience in using ELT tools and developing data pipelines
• Experience working with Snowflake
• Helpful but not required: experience working with integrate.io
• Helpful but not required: experience working with NetSuite
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Understanding of retail, either financial planning or merchandising/inventory planning a plus
• Experience identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
• Ability to perform root cause analysis on external and internal processes and data to identify errors, opportunities for improvement and answer questions
• Curious; willing to learn and research. Able to quickly learn new applications. Able to expand your own knowledge through a variety of sources. Learns quickly when facing new problems; a relentless and versatile learner; open to change; analyzes both successes and failures for clues to improvement; experiments and will try new ways to find solutions; enjoys the challenge of unfamiliar tasks; quickly grasps the essence and the underlying structure
• Solves difficult problems with effective solutions; asks good questions and probes all fruitful sources for answers; can see underlying or hidden problems and patterns; is excellent at honest analysis; looks beyond the obvious and doesn't stop at the first answers
• Strong organizational skills and attention to detail
• Team Player - Creates strong morale and spirit in his/her team; shares wins and successes; fosters open dialogue; lets people finish and be responsible for their work; acts as if real success is the success of the whole team; creates a feeling of belonging in the team