Senior Data Engineer

This is a remote position.

Overview

We are looking for a Senior Data Engineer with a passion for data to join our Operational Business Intelligence team in the Product Innovation and Consumer Creation organization.

You will build scalable data pipelines and implement Enterprise solutions ready for cloud deployment. You will partner with users to research and enable Business Intelligence tools (Cognos, Tableau, Alteryx, etc…) to gain business insight from data.

You will be reporting to the Engineering Director and working in an Agile Scrum environment with support of an assigned Scrum Master, a dedicated product management, and a team of data engineers developing new capabilities, enhancements, and providing ongoing maintenance.

RESPONSIBILITIES

·         Design and build cloud-based data pipelines, reusable components, frameworks, and libraries at scale to support data and BI products

·         Design and implement product features in collaboration with Business and Technology partners

·         Identify and tackle issues concerning data management to improve data quality

·         Clean, prepare and optimize data for ingestion and consumption

·         Collaborate on the implementation of new data management features and re-structure of the current data architecture

·         Implement automated workflows and routines using workflow scheduling tools

·         Build continuous integration and production deployment pipelines

·         Collaboratively review design, code, test plans and implementation performed by other data engineers on the team in support of maintaining data engineering standards

·         Analyze and profile data for designing scalable solutions

Requirements

QUALIFICATIONS

·         MS/BS in Computer Science, Information Systems, or related technical subject area, or equivalent combination of education and experience and training

·         3+ years of experience in cloud environments preferably AWS (RDS, Lambda, Glue, S3, DynamoDB)

·         3+ years of experience using Python or similar languages like Scala or Java

·         Experience with data warehousing concepts, SQL, and SQL Analytical functions

·         Experience working with NoSQL data stores such as HBase or DynamoDB

·         Experience with data warehouse technical architectures, infrastructure components, ETL/ ELT, Business Intelligence, and reporting tools

·         Experience with cloud data warehouses like Snowflake or Amazon Redshift

·         Experience building real-time streaming data pipelines

·         Strong understanding of data structures, algorithms, and architecture patterns

·         Proficient in modern build strategies, Continuous Integration, unit testing, static analysis, and automated integration tests

·         Ability to define solutions, provide estimates on effort and risk, and evaluate technical feasibility

·         Passion for data solutions and willing to pick up new programming languages, technologies, and frameworks

·         Demonstrated ability to work independently and manage numerous projects

·         Proven track record of solving problems and getting things done in a fast-paced and dynamic environment