Key Facts

Remote From:

Full time

English

Hard Skills

Apache Spark SQL (Programming Language) gRPC Python (Programming Language) Data Modeling Query Optimization Code Analysis Data System Data Validation Apache Airflow Linux Software Engineering Relational Databases Git (Version Control System) Design Documentation Data Collection Unit Testing ETL (Extract Transform Load) Data Architecture

Other Skills

•
Teamwork
•
Communication

Roles & Responsibilities

Strong experience with Python and PySpark for data engineering
Experience with Google Cloud Platform (GCP)
Strong experience with relational SQL databases
Experience with data transformation tools (DBT)

Requirements:

Establish scalable, efficient, automated processes for data analysis, data model development, validation, and implementation
Work closely with analysts/data scientists to understand impact to the downstream data models
Write efficient and well-organized software to ship products in an iterative, continual release environment
Contribute to and promote good software engineering practices across the team

PradeepIT Consulting Services Pvt Ltd

About PradeepIT Consulting Services Pvt Ltd

Join PradeepIT: Innovating Information Technology and Solutions We pride ourselves on delivering exceptional results in the digital era of Information and Technology. With a track record of successful projects across offshore, nearshore, and onshore locations, we've built a clientele spanning 3 continents and 100+ companies. Our 380+ successful projects reflect our commitment to excellence. At PradeepIT, we prioritize the satisfaction of our resources, followed closely by meeting the needs of our clients and partner companies. Our service offerings include Outsourcing, Managed Services, Recruitment Process Outsourcing, Customer Relationship Management, Web Designing & Development, Content Development, and E-commerce Management. We specialize in SAP S/4 HANA, SAP Customer Data Cloud (Gigya), SAP CPQ (Calliduscloud), SAP Customer Experience, Mobility, Android, iOS & Hybrid development for native application developments. Our core value of "Join As Employee With Us And Grow Up As Entrepreneur" drives our mission. We proudly introduce our venture companies: 1. HG Infotech Pvt Ltd 2. Beli Brother Consulting Pvt Ltd 3. Involvemind 4. Stackglobe 5. Prastuti Consulting 6. Khahara Consulting 7. Thinkhigh And many more to come in the near future. We invite you to be part of our clients' success stories by adopting the latest technology and continually improving processes. If you'd like to learn more about us or have specific questions, visit www.pradeepit.com, call us at 08047363377, or email info@in.pradeepit.com. Let's work together on your next project!

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

GCP Data Engineer

YoE: 5+ Years

Mandatory Skills Python, Pyspark, GCP, SQL, DBT

Responsibilities:

Establish scalable, efficient, automated processes for data analysis, data model development, validation, and implementation.
Work closely with analysts/data scientists to understand impact to the downstream data models.
Write efficient and well-organized software to ship products in an iterative, continual release environment.
Contribute to and promote good software engineering practices across the team.
Communicate clearly and effectively to technical and non-technical audiences.

Minimum Qualifications:
Experience with at least one cloud provider solution (GCP preferred)
Strong experience working with relational SQL databases.
Strong experience with object-oriented/object function scripting language: Python.
Working knowledge in any transformation tools, DBT preferred.
Ability to work with Linux platform.
Strong knowledge of data pipeline and workflow management tools (Airflow)
Working knowledge of Git hub /Git Toolkit
Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation
Experience creating Data pipelines that prepare data for ingestion & consumption appropriately.
Experience in maintaining and optimizing databases/filesystems for production usage in reporting, analytics.
Working in a collaborative environment and interacting effectively with technical and non-technical team members equally well.
Good verbal and written communication skill