Data Engineer - Google Cloud

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.


If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Experience Level: 4+ years

Responsibilities:

• Work with cloud engineers and customers to solve big data problems by developing utilities for migration, storage and processing on Cloud platforms.
• Design and build a cloud migration strategy for cloud and on-premise applications.
• Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact at massive scale.
• Build tools to ingest and jobs to process several terabytes or petabytes per day.
• Design and develop next-gen storage and compute solutions for several large customers.
• Communicate with a wide set of teams, including Infrastructure, Network, Engineering, DevOps, SiteOps teams, and cloud customers.
• Build advanced tooling for automation, testing, monitoring, administration, and data operations across multiple cloud clusters.

Required Skills:

• Hands-on experience in data structures, distributed systems, Hadoop and spark,
• SQL and NoSQL Databases
• Strong software development skills in at least one of: Python, PySpark.
• Experience in developing Big Data solutions (migration, storage, processing)
• Experience building and supporting large-scale systems in a production environment
• Cloud Platforms – AWS, GCP or Azure Big Data Distributions
• Any of Apache Hadoop/CDH/HDP/EMR/Google DataProc/HD-Insights Distributed processing Frameworks.
• One or more of MapReduce, Apache Spark, Apache Storm, Apache Flink.
• Database/warehouse
• Hive, HBase, and at least one cloud native services Orchestration Frameworks
• Any of Airflow, Oozie, Apache NiFi, Google DataFlow Message/Event Solutions
• Any of Kafka, Kinesis, Cloud pub-sub Container Orchestration (Good to have)
• Kubernetes or Swarm
• Leadership qualities
• Ability to lead technology teams and provide them mentorship / support to accelerate performance.
• Experience in leading multiple large projects as well as a deep understanding of Agile developments
• Effective communication with all the stakeholders involved.
• Communicate clearly about complex subjects and technical plans with technical and non technical audiences.

What is in it for you:

• Opportunity to learn cloud-native services and how to utilize those services to solve various business problems.
• More hands-on learning opportunities in Python, SQL, etc
• Sponsored certification opportunity for various courses of your choice (eg, GCP, AWS, Azure, Tableau, Looker, etc)
• Allocated work will allow you to not only just complete the task but you will be given an opportunity to own up the work and take responsibility for it’s end-to-end delivery