Logo for US Tech Solutions

Large-Scale Data Platforms Engineer - #26-23263

US Tech Solutions

Role overview

Qualifications

  • Strong experience in Data Engineering / Big Data Engineering within high-volume production environments.
  • Proven experience designing and operating data pipelines processing billions of rows/records.
  • Extensive hands-on experience with Apache Spark and distributed data processing.
  • Strong programming experience in Python, Java, or Scala.

Responsibilities

  • Design and implement scalable, production-grade data pipelines capable of processing billions of rows/records across multiple data sources.
  • Build reliable data ingestion, transformation, processing, and storage workflows for large-scale analytical and operational use cases.
  • Develop and optimize distributed data processing solutions using technologies such as Apache Spark.
  • Monitor production pipelines, identify bottlenecks and failures, and proactively improve data reliability, pipeline uptime, and processing efficiency.

Key facts

Hard skills

Other skills

  • Problem Solving

About the company

US Tech Solutions logo

US Tech Solutions

Staffing & Recruiting

USTECH SOLUTIONS is the largest privately owned diversity workforce partner with a global footprint. For 20+ years, we have partnered with leading MSPs and some of the world’s largest enterprises to deliver a flexible workforce. We serve Fortune 500 giants and growing businesses alike, reinventing the role of humans in a digital workforce. ‘Reinventing Human’ is about connecting you with top talent and seamlessly integrating new hires into your programs through our next gen AI powered Talent platforms. As the largest private diversity supplier in the US, we champion inclusion and unlock hidden potential. We work with leading MSPs and are a trusted strategic partner to the world’s top brands. At USTECH SOLUTIONS, we're inverting the talent hiring pyramid by offering a range of solutions from curated talent pools, workforce management services, and IT services resourcing to IC compliance. Our legacy and close affinity to the computing industry has equipped us with the expertise and vision to provision AI platform solutions that help organizations to innovate faster. Considering Statement of Work? Meet US Tech Digital (ustechdigital.com). We're helping businesses achieve digital leadership through our tailored SOW solutions, utilizing market-leading technology products and our proprietary in-house developed platform solutions. Explore our full range of services and solutions by visiting our website: ustechsolutions.com

Company details

Company typeLarge
IndustryStaffing & Recruiting
Company size1001 - 5000

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Duration: 12 months contract
 
Job Description:
  • We are seeking a Senior Data Engineer to design, build, and operate highly scalable data platforms supporting a large, high-traffic digital business. The role involves massive datasets, complex data flows, and business-critical analytics workloads, where performance, reliability, scalability, and automation are essential.
  • The ideal candidate has hands-on experience building and operating production-grade data pipelines processing billions of rows/records, with strong expertise across distributed data processing, orchestration, data modeling, monitoring, and optimization.
  • This is not a dashboard-focused or basic ETL role. We are looking for an engineer who can take complex data problems from business requirements → architecture → pipeline development → data modeling → production deployment → monitoring and optimization, while ensuring high performance, reliability, and scalability.
 Responsibilities:
  • Design and implement scalable, production-grade data pipelines capable of processing billions of rows/records across multiple data sources.
  • Build reliable data ingestion, transformation, processing, and storage workflows for large-scale analytical and operational use cases.
  • Develop and optimize distributed data processing solutions using technologies such as Apache Spark.
  • Build and manage workflow orchestration using Apache Airflow or similar platforms.
  • Design data pipelines with strong focus on performance, scalability, reliability, recoverability, and operational efficiency.
  • Monitor production pipelines, identify bottlenecks and failures, and proactively improve data reliability, pipeline uptime, and processing efficiency.
  • Develop robust data models that translate complex business requirements into clean, scalable, and easily evolvable analytical structures.
  • Write highly efficient and complex SQL for large-scale data transformation, analysis, validation, and troubleshooting.
  • Use Python, Java, or Scala to develop scalable data processing and automation solutions.
  • Identify repetitive manual processes and continuously automate, simplify, and eliminate operational overhead.
  • Troubleshoot large-scale data and pipeline issues and drive root-cause resolution rather than relying on manual workarounds.
 Experience:
  • Strong experience in Data Engineering / Big Data Engineering within high-volume production environments.
  • Proven experience designing and operating data pipelines processing billions of rows/records.
  • Extensive hands-on experience with Apache Spark and distributed data processing.
  • Strong experience with Apache Airflow or comparable workflow orchestration frameworks.
  • Advanced proficiency in SQL and experience working with very large datasets.
  • Strong programming experience in Python, Java, or Scala.
  • Proven expertise in data modeling, dimensional modeling, analytical data structures, and scalable data architecture.
  • Experience with production data environments where availability, reliability, latency, scalability, and data quality are critical.
  • Demonstrated mindset of automation and continuous improvement—you naturally look for ways to eliminate repetitive manual work.
Skillsets:
  • Experience handling multi-billion-row datasets or similarly high-volume event/data workloads.
  • Experience with high-traffic consumer platforms, digital products, marketplaces, advertising, search, transaction, or behavioral analytics data.
  • Experience building data platforms that support near-real-time or high-frequency data processing.
  • Background in geographic information systems (GIS) or spatial analysis
 Education:
  • Bachelor's degree or equivalent experience in related field.
 
About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.
 
US Tech Solutions is an Equal Opportunity Employer.  All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
 
AI Statement: By applying, you acknowledge that AI-assisted tools may be used during hiring. 

#LI-AS140

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Data Platform Engineer Related jobs

Other jobs at US Tech Solutions

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.