Match score not available

Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive feedback and expert guidance on applications, and have your profile manually reviewed.

Start Your Free Trial Now!

Start my free trial

Principal Engineer - Java/Hadoop

Remote: 
Full Remote
Contract: 
Fixed term
Experience: 
Mid-level (2-5 years)
Work from: 
Illinois (USA), United States

Offer summary

Qualifications:

Bachelor’s degree in Computer Science, Engineering or related field; advanced degree preferred., Extensive experience in Hadoop engineering and big data technologies., Experience managing large-scale data migrations., Proven expertise in Java or Python development or DevOps., Knowledge of Cassandra is a plus..

Key responsabilities:

  • Evaluate and optimize Hadoop clusters for performance improvements.
  • Architect a scalable Hadoop solution for data transformation.
  • Oversee ingestion and categorization of banking data.
  • Collaborate with the Mexico City team on project objectives.
  • Identify and resolve issues in Hadoop environments.
Brilliant® logo
Brilliant® Human Resources, Staffing & Recruiting SME https://www.brilliantfs.com/
51 - 200 Employees
About Brilliant®
About Brilliant® Brilliant is an award-winning direct-hire, contract and consulting practice specializing in accounting, finance, audit, tax, technology and business solutions for the Midwest and Southeast regions of the U.S. labor markets.     We represent the highest-quality professionals across the nation and partner with businesses looking for consultative or permanent resources in the areas of accounting, finance, audit, tax, financial systems, data analytics, technology and more. Together with our resources, we provide the business solutions needed to help our clients achieve their goals. Many of our team members are former accounting and finance experts from the Big 4 audit and accounting firms who know the market like no other.     Since our inception in 2009, we have ranked on major lists including Forbes America’s Best Professional Recruiting Firms (No. 2 in 2018), Forbes America’s Best Executive Recruiting Firms, Crain’s Chicago Business Fast 50 (No. 1 in 2015), Staffing Industry Analysts Fastest-Growing U.S. Staffing Firms (No. 2 in 2015), ClearlyRated’s Best of Staffing Talent, ClearlyRated’s Best of Staffing Client, Inc. 5000, Best Places to Work South Florida, 101 Best and Brightest Companies to Work For®, and others.   We strive to #bebrilliant and offer a safe, fun and equal-opportunity environment for our team. Our fast-paced culture is filled with innovation, passion and hard work. We are dedicated to our craft and strive to transform the accounting, finance and technology space while helping to navigate the goals of our clients and candidates. To learn more about Brilliant, visit www.brilliantfs.com or call 312.582.1800.
See more Brilliant® offers

Job description

REMOTE

US Based candidates that can travel to Mexico

GC or USC

W2 Only

Contract 6 months+

Position Overview

We are seeking a highly skilled and experienced Senior Hadoop Engineer to lead a transformative project migrating from Informix to Cassandra for our Data Loader system. This system manages large-scale banking information, categorizing it into various buckets such as Customer Portfolio, Credit, and Loans. You will play a critical role in designing and implementing a Hadoop-based solution to ensure a smooth transition, requiring both strategic oversight and hands-on technical work. As the project involves collaboration with a team based in Mexico City, international travel is required.

Key Responsibilities

  • Cluster Evaluation and Optimization: Assess and evaluate Hadoop clusters, including sizes, nodes, and throughput. Provide actionable recommendations for improvements.
  • Architecture and Design: Develop a comprehensive architecture for the Hadoop environment, ensuring it meets the scalability, performance, and reliability requirements of the data transformation project. Design data processing workflows and integrate Hadoop with existing systems.
  • Design and Implementation: Architect a scalable Hadoop solution to facilitate the Informix-to-Cassandra transformation, ensuring efficient data ingestion and processing.
  • Hands-On Engineering: Configure, optimize, and manage Hadoop environments, including map/reduce functionalities.
  • Data Management: Oversee the ingestion and categorization of large-scale banking data into the correct buckets, ensuring data integrity and processing efficiency.
  • Collaboration: Work with the Mexico City-based team to align on project objectives, offer technical guidance, and support the transformation process.
  • Troubleshooting: Identify and resolve issues related to Hadoop environments, addressing performance bottlenecks and configuration challenges.

Must Have Skills

  • Sr. Java/Python Developer or Sr. DevOps Experience: Extensive experience in Java or Python development or DevOps, with a focus on big data applications.
  • Hadoop Engineering Expertise: Deep knowledge of Hadoop engineering, including the configuration and optimization of multi-node Hadoop environments.
  • Map/Reduce Management: Proven experience managing map/reduce processes for effective data handling and processing in Hadoop.

Good To Have

  • Cassandra Experience: Familiarity with Cassandra configuration, troubleshooting, and optimization is a plus.

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or a related field; advanced degree preferred.
  • Extensive experience in Hadoop engineering and big data technologies.
  • Proven track record in managing similar transformation projects, especially large-scale data migrations.
  • Strong analytical, problem-solving, and communication skills, with the ability to work independently and as part of an international team.

Travel Requirements

  • Willingness and ability to travel internationally, specifically to Mexico City, as needed.

#tech2023

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Industry :
Human Resources, Staffing & Recruiting
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Hard Skills

Apache HadoopJava (Programming Language)Apache CassandraPython (Programming Language)Data ManagementDevOps

Other Skills

  • Problem Solving
  • Verbal Communication Skills
  • Analytical Skills
  • Collaboration
Are you interested?

Hadoop Developer Related jobs

See more Hadoop Developer jobs