Role overview

Qualifications

Good Understanding of GCP Composer (Apache Airflow)
Proficient in either Java or Python programming languages
DB design experience with Excellent RDBS-PLSQL knowledge
Knowledge on Angular (Good to Have)

Responsibilities

Manage Airflow DAGs and troubleshoot Airflow-related issues
Monitor and optimize Composer performance and scalability
Maintain GCP infrastructure including services like Google Cloud Storage, BigQuery, Cloud Dataflow, Cloud Dataproc, Cloud Functions, and Cloud Run
Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources

Key facts

Full time
Senior (5-10 years)
Platform Engineer
English

Hard skills

Google Cloud Platform (GCP) gRPC Terraform Apache Airflow BigQuery Google Cloud Dataproc Jenkins Relational Database Management Systems PL/pgSQL Angular (Web Framework)

Other skills

Communication
Collaboration
Problem Solving

About the company

Diverse Lynx

We are a WBENC and NMSDC certified company helping our clients in their Diversity spending on Staffing or Contingent Workforce Services. Established in 2002 and headquartered out of Princeton-NJ, our 2000+ associates’ strength globally helps clients with talent across Technology, Healthcare, Life Sciences, Aerospace, Automotive, Energy, Pharmaceuticals, Retail, Telecom, Manufacturing and Engineering domains. Our presence in USA, Canada & India helps us support clients in IT, Non-IT, Healthcare, Hospital and Clinical hiring, across the globe.

Company details

Company typeLarge

Company size1001 - 5000

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Job Title - Sr. GCP Platform Engineer

Location – Hanover, VA(Remote)

Job Details:

Role Overview:

Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .

• Have Good Understanding of GCP Composer (Apache Airflow) environments.

• Manage Airflow DAGs and troubleshoot Airflow-related issues.

• Monitor and optimize Composer performance and scalability.

• Maintain GCP infrastructure including services like:

o Google Cloud Storage (GCS)

o BigQuery (BQ)

o Cloud Dataflow ( Apache Beam )

o Cloud Dataproc

o Cloud Functions

o Cloud Run

• Have Good Understanding of:

o IAM and service account permissions

o Secret Manager

• Monitor GCP usage and quotas, and proactively prevent quota-related issues.

• Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).

• DB design experience (with Excellent RDBS-PLSQL knowledge )

• Design Springboot APIs

• Analyze, design, create Dockerfile

• Knowledge on Angular ( Good to Have )

• Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.

• Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.

• Ensure security, compliance, and cost-efficiency across the cloud environment.

• Document system configurations, procedures, and best practices.

• Proficient in either Java or Python programming languages.

• Knowledge on DNS and SSO configuration setup

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.