Duration: 06+ Months
About the Role
Building
agentic software to improve how teams develop, deploy, and operate machine learning workloads on GPUs. This senior contract role focuses on designing and delivering
production-grade intelligent agents across the software stack: training and inference frameworks, cluster tooling, performance analysis, and operational workflows for large-scale GPU deployments.
You will lead implementation of Python systems that combine
LLM orchestration,
tool integration, and
rigorous evaluation to automate high-value engineering work: investigating distributed job failures, interpreting telemetry and profilers, accelerating performance analysis, and reducing manual toil in ML operations.
This is a
senior individual contributor engagement. You are expected to own significant components end to end, make sound technical decisions within program direction, and deliver maintainable code with minimal supervision.
Key Responsibilities
- Architect and implement Python agent frameworks: tool adapters, orchestration loops, structured outputs, session handling, and CLI or service interfaces suitable for production use.
- Build LLM-powered workflows (LiteLLM, DSPy, or equivalent) with bounded prompts, allowlisted tools, budget caps, structured JSON outputs, and evidence-backed reporting.
- Integrate agents with the GPU and ML software ecosystem: ROCm tooling, PyTorch, distributed training and inference stacks, profilers, cluster metrics, log pipelines, and debug utilities.
- Own quality and eval infrastructure: fixture-driven tests, JSON Schema validation, regression suites, accuracy metrics, and CI integration before rollout.
- Solve ML operations problems on training and inference clusters: multi-node failure analysis, performance regression investigation, configuration and launch issues, and operational automation.
- Deliver deployment-ready artifacts: Docker/Kubernetes packaging, runbooks, documentation, and security-conscious defaults for customer-controlled environments.
- Partner with framework, performance, and field teams; incorporate code review feedback and iterate based on production and pilot learnings.
Required Qualifications
- Bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field; equivalent practical experience accepted.
- 10+ years of professional software engineering experience, including 5+ years on production Python systems at scale.
- Deep experience with distributed ML training or inference on GPU clusters: multi-node jobs, collective communication failures, log and metric correlation across ranks and nodes.
- Strong hands-on PyTorch background and production familiarity with large-scale stacks (Megatron-LM, DeepSpeed, TorchTitan, vLLM, or equivalent).
- Proven ML debugging and performance engineering across multiple failure modes: throughput regression, memory errors, numerical instability, misconfiguration, and profiler or trace analysis.
- Demonstrated delivery of LLM agent or orchestration systems in production or near-production settings: tool routing, structured outputs, reliability, and testability.
- Track record of shipping complex software on schedule: clean code, automated tests, code review discipline, and clear technical communication.
- Ability to work independently, prioritize across ambiguous requirements, and align weekly with a technical lead.
Preferred Qualifications
- Open-source ML development: upstream framework repositories, community CI patterns, and integration with OSS tooling.
- ML performance optimization: parallelism, throughput/MFU tuning, roofline analysis, and profiler-driven investigation.
- ROCm and GPU cluster operations: metrics, profilers, health monitoring, Slurm or Kubernetes job environments.
- Security-aware agent deployment: secret handling, egress control, and customer VPC or on-premises constraints.
About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit
www.ustechsolutions.com.
US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
AI Statement: By applying, you acknowledge that AI-assisted tools may be used during hiring.
#LI-AS140
