Roles & Responsibilities

Python
PL/SQL
DBT (Data Build Tool)
Airflow

Requirements:

Design, build, and maintain data pipelines using Python, DBT, and Airflow on GCP/BigQuery
Implement data transformations, data modeling, and optimization for large-scale datasets
Collaborate on data ingestion from multiple sources and ensure data quality and governance
Document ETL processes and monitor performance, contributing to cloud-native data processing initiatives

Job description

Job Title: Senior Data Enginee

Mandatory Skills: Python, PL/SQL, DBT, Airflow, BigQuery, do not send resume if candidate is not meeting the requirements.

Technical Skills:

Python: Programming, ETL scripting, business logic implementation, and experience with data manipulation libraries (pandas, NumPy).
PL/SQL: Data transformation, view/table creation, and persistence layer interactions.
Data Transformation Tools: DBT (Data Build Tool) for creating models and documentation.

Orchestration and Data Processing Tools
Orchestration: Airflow, Dataflow, and Cloud Composer.
Data Ingestion: Cloud Functions, Cloud Run, SFTP mechanisms, and Falcon (for database connections).

Cloud Platform:

Google Cloud Platform (GCP) and BigQuery experience.
Experience with cloud-native data processing.

Additional Desired Skills:

Understanding of householding and data segmentation logic.
Ability to work with streaming and batch data.
Experience with data integration from multiple sources (e.g., Reltio, external databases).
Familiarity with incremental data loading and partitioning strategies.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.