Director, Index Pipeline Engineering

Overview 
The Director of the DataOps Engineering Index Data Pipeline Chapter leads a global team of talented engineers who are responsible for building and maintaining the core infrastructure that ingests third party benchmark data and transforms it into investable portfolios. You will support, maintain, design, develop, and deploy scalable and reliable systems that process tens of thousands of indexes into multiple Aladdin BlackRock and client instances every day. Partner with a wide range of product, technical, business and leadership stakeholders to define and build the future state for index data at BlackRock. 

Responsibilities 

• Manage, mentor, and grow a team of index pipeline engineers, ensuring high performance and career development. This includes hiring, onboarding, coaching, and providing feedback to the team members. 

• Establish and enforce best practices, code quality standards, agile development methods, CI/CD procedures and testing frameworks for pipeline development. 

• Architect and implement solutions that optimize performance, reliability, and scalability. 

• Provide level-3 support to troubleshoot issues related to index pipeline operations, availability, and latency. Triage complex operational and performance problems in legacy code bases (Perl, Python, Sybase, proprietary).  

• Collaborate and negotiate with other engineering leaders, product managers, operations personnel, senior leadership and business stakeholders to prioritize the development backlog. 

• Research and evaluate innovative technologies and trends in data engineering and transform legacy processes onto our Enterprise Data Platform (Snowflake, dbt, Airflow, Python). 

• Manage and oversee the work of contingent workers. Manage budget and turnover with outsourcing providers.  
   

Qualifications 

• BS/MS in Computer Science or related field, or equivalent work experience. 

• A graduate degree in Finance or MBA is highly desirable. 

• Experience in Financial Services (Investment Banking, Treasury or Asset Management in particular). 

• Experience with Financial Service vendor data and data exchange mechanisms. 

• Excellent communication, collaboration, and problem-solving skills. 

• Outstanding managerial skills with the ability to navigate challenging team dynamics across global time zones. 

• Must be able to manage up, down and across to negotiate priorities, resources and joint development. Must be able to build and nurture a broad network beyond your management chain.  

• 12+ years of experience in big data, data warehousing, data lakes, data architecture, data engineering, with at least 5 years in a significant leadership role. 

• Strong knowledge of ETL / ELT tools and processes, relational databases, advanced SQL development, data modeling and advanced data pipeline architectures. 

• Development experience in multiple programming languages ideal, proficiency in Python highly desirable. Exposure to Perl would be very beneficial.  

• Must have strong understanding of and experience with DataOps concepts, CI/CD, ADO/Git repo management, release management and Agile software development practices.   

• Experience with big data technologies, such as Hadoop, Spark, Kafka, or Elasticsearch. 

• Experience with cloud platforms, such as AWS, GCP, or Azure, and data warehouse solutions, such as Snowflake. Azure and Snowflake strongly preferred.