Data Engineer, AI/ML (3 months contract)

About the Role

This is a temporary contractor position with an estimated duration of 3 months.

Rocket Lawyer is seeking an experienced, passionate data engineer for Rocket Data Platform. In this role, you will build a highly reliable, trustworthy data lakehouse that is leveraged across the organization to derive insights and make real-time decisions. You will be bringing your skills to drive new data projects, build reliable data pipelines, set up strong monitoring and alerting systems, and build data solutions to support a diverse set of use cases.

We value a fun, collaborative, team-oriented work environment, where we celebrate our accomplishments. 

Responsibilities

• Design and develop data pipelines using tools like Apache Airflow or by leveraging Snowflake's external tables functionality.

• Translate HiveQL queries to Snowflake SQL, ensuring compatibility and efficient data processing.

• Utilize dbt to model and transform data within Snowflake, adhering to best practices for data governance and maintainability.

• Configure and manage data pipelines in GCP to orchestrate data movement and processing tasks.

• Collaborate with data analysts and stakeholders to understand data requirements and ensure a successful migration outcome.

• Monitor and optimize data pipelines for performance and scalability.

• Develop and implement automated testing procedures to validate data quality and integrity after migration.

• Document the migration process and provide ongoing support for the migrated data warehouse on Snowflake.

Requirements

• Minimum 5+ years of experience as a Data Engineer with a proven track record of successful data warehouse/data lake implementation and management.

• Deep understanding of leveraging Snowflake to build highly performant and resilient datawarehouse.

• Strong expertise in HiveQL, SQL, and experience with data warehousing/lake house concepts (dimensional modeling, data quality, etc.).

• Strong programming knowledge in python.

• Experience with Apache Spark for large-scale data processing (a plus).

• Proficiency in dbt for data modeling and transformation in Snowflake preferred.

• Experience working with Google Cloud Platform (GCP) and its data storage services (GCS, BigQuery - a plus).

• Excellent written and verbal communication skills with the ability to collaborate effectively with cross-functional teams.

• Strong problem-solving skills and a passion for building efficient and scalable data solutions.

• Snowflake certification preferred.

Preferred Qualifications:

• Strong understanding of data architectures and patterns.

• Experience in DataOps implementation and support

• Experience in MLOps implementation and support.

• Experience in building and supporting AI/ML platform.