Logo for IRI

VP II AI, Machine Learning|US Remote*

Key Facts

Remote From: 
Full time
Mid-level (2-5 years)
202 - 210K yearly
English

Other Skills

  • Collaboration
  • Accountability
  • Curiosity
  • Communication

Roles & Responsibilities

  • Design and implement highly scalable ETL applications using Hadoop and Big Data ecosystems.
  • Develop new scripts, tools, and methodologies to streamline and automate ETL workflows.
  • Deliver big data solutions using Spark, Python, Scala, SQL, and Hive.
  • Work within complex technical environments that include ETL Spark applications in PySpark and Scala.

Requirements:

  • Design and implement highly scalable ETL applications using Hadoop and Big Data ecosystems.
  • Develop new scripts, tools, and methodologies to streamline and automate ETL workflows.
  • Deliver big data solutions using Spark, Python, Scala, SQL, and Hive.
  • Collaborate closely with Data Science, QA, Operations, and other teams to meet aggressive deadlines.

Job description

Let’s be unstoppable together!

 

Circana is a leading provider of technology, AI, and data solutions for consumer packaged goods companies, manufacturers, and retailers. Our predictive analytics and Liquid Data® platform help clients measure market share, uncover consumer behavior, and drive growth—powered by six decades of expertise and an expansive, high-quality data set.

 

At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives.  We’re a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. With us, you can always bring your full self to work.  Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified™ by Great Place To Work®. This prestigious award is based entirely on what current employees say about their experience working at Circana. Learn more at www.circana.com.

 

Role Overview

The Senior Big Data Engineer is responsible for designing, building, and delivering highly scalable big data and ETL solutions across distributed environments. This role supports projects at various and unanticipated client worksites throughout the United States, with headquarters based in Chicago, IL. The engineer works closely with cross-functional teams to develop, test, and deploy data solutions that meet business and operational needs, leveraging modern big data frameworks, cloud platforms, and agile development practices. Telecommuting is permitted.

 

Job Responsibilities

  • Design and implement highly scalable ETL applications using Hadoop and Big Data ecosystems.
  • Develop new scripts, tools, and methodologies to streamline and automate ETL workflows.
  • Deliver big data solutions using Spark, Python, Scala, SQL, and Hive.
  • Design and create use cases and scenarios for functional, integration, and system testing.
  • Collaborate closely with Data Science, QA, Operations, and other teams to meet aggressive deadlines.
  • Participate in daily Agile/Scrum meetings and conduct code reviews.
  • Coordinate with cross-functional operational teams to manage end-to-end data delivery.
  • Write efficient, reusable, and well-documented code.
  • Prepare technical design documentation for implemented solutions.
  • Identify and resolve data pipeline issues and provide timely solutions for incorrect or undesired system behavior using ILD solutions.
  • Work within complex technical environments that include:
    • ETL Spark applications in PySpark and Scala
    • Spark architecture, data frames, and performance tuning
    • Hadoop ecosystem tools such as Flume, MapReduce, and HDFS
    • Relational databases (Oracle, PostgreSQL)
    • Big Data querying tools (Hive, Pig, Impala)
    • Databricks, distributed computing principles, and Lambda Architecture
    • Cloud platforms such as Microsoft Azure

Requirements

  • Design and implement highly scalable ETL applications using Hadoop and Big Data ecosystems.
  • Develop new scripts, tools, and methodologies to streamline and automate ETL workflows.
  • Deliver big data solutions using Spark, Python, Scala, SQL, and Hive.
  • Design and create use cases and scenarios for functional, integration, and system testing.
  • Collaborate closely with Data Science, QA, Operations, and other teams to meet aggressive deadlines.
  • Participate in daily Agile/Scrum meetings and conduct code reviews.
  • Coordinate with cross-functional operational teams to manage end-to-end data delivery.
  • Write efficient, reusable, and well-documented code.
  • Prepare technical design documentation for implemented solutions.
  • Identify and resolve data pipeline issues and provide timely solutions for incorrect or undesired system behavior using ILD solutions.
  • Work within complex technical environments that include:
    • ETL Spark applications in PySpark and Scala
    • Spark architecture, data frames, and performance tuning
    • Hadoop ecosystem tools such as Flume, MapReduce, and HDFS
    • Relational databases (Oracle, PostgreSQL)
    • Big Data querying tools (Hive, Pig, Impala)
    • Databricks, distributed computing principles, and Lambda Architecture
    • Cloud platforms such as Microsoft Azure

     Circana Behaviors

    Beyond technical skills, experience, and role-specific attributes, these shared behaviors are fundamental to our culture and success. We seek individuals who consistently demonstrate and champion these behaviors in their daily work:

    • Stay Curious: Being hungry to learn and grow, always asking the big questions.
    • Seek Clarity: Embracing complexity to create clarity and inspire action.
    • Own the Outcome: Being accountable for decisions and taking ownership of our choices.
    • Center on the Client: Relentlessly adding value for our customers.
    • Be a Challenger: Never complacent, always striving for continuous improvement.
    • Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect, and integrity.
    • Commit to each other: Contributing to making Circana a great place to work for everyone.

     

    Location: This position can be located in the following area(s): US Remote

    The below range reflects the range of possible compensation for this role at the time of this posting. We may ultimately pay more or less than the posted range. This range may be modified in the future. An employee’s position within the salary range will be based on several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, performance, shift, travel requirements, sales or revenue-based metrics, any collective bargaining agreements, and business or organizational needs. The salary range for this role is $202,000 USD to $210,000 USD

    This job is also eligible for bonus pay.

    We offer a comprehensive package of benefits including paid time off, medical/dental/vision insurance and 401(k) to eligible employees.

    An offer of employment may be conditional upon successful completion of a background check in accordance with local legislation and our candidate privacy notice. Your current employer will not be contacted without your permission.

    You can apply for this role through the Circana careers website or Intranet site for internal candidates. This role is subject to AI-assisted screening. Circana uses artificial intelligence (AI) to assess resumes for alignment with job requirements by helping locate details in resumes that relate to the job description.

    This position is expected to remain open for approximately 30 days and may close earlier if sufficient qualified candidates are identified.

     

    Related jobs

    Other jobs at IRI

    We help you get seen. Not ignored.

    We help you get seen faster — by the right people.

    🚀

    Auto-Apply

    We apply for you — automatically and instantly.

    Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

    AI Match Feedback

    Know your real match before you apply.

    Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

    Upgrade to Premium. Apply smarter and get noticed.

    Upgrade to Premium

    Join thousands of professionals who got noticed and hired faster.