Job Requisition ID #
About the Role
Join Autodesk’s AEC Design organization to help build, evaluate, and scale the next generation of AI-powered and agentic experiences and future MCP-based workflows!
You will work closely with senior Data Scientists, Software Engineers, and product teams to develop reliable ML models, evaluate LLM-driven tool calling, and contribute to unified LLM evaluation frameworks used across AEC. This role is ideal for an early-career engineer with strong ML fundamentals, curiosity for new AI technologies, and comfort working across both experimentation and engineering.
Responsibilities
Develop and evaluate ML models (classification, regression, clustering, forecasting).
Support LLM evaluation workflows, including dataset creation, metrics, and benchmarking for MCP and Assistant scenarios.
Run offline batch evaluations and contribute to real-time evaluation instrumentation (Opik, Langfuse, custom pipelines).
Collaborate with engineering teams to integrate models into production workflows with CI/CD best practices.
Build scripts, utilities, and small pipelines to automate data preparation, experiments, and evaluation.
Partner with PMs, domain experts, and cross-product teams to translate user scenarios into measurable evaluation tasks.
Minimum Qualifications
Bachelor’s (2–3 years experience) or Master’s (new grad welcome) in CS, Data Science, Engineering, or similar.
Strong Python skills and experience with ML fundamentals (feature engineering, training, validation).
Familiarity with scikit-learn, pandas, NumPy; deep learning frameworks a plus.
Experience with LLMs, prompt evaluation, or toolcalling workflows
Understanding of CI/CD, git, and sound software engineering practices.
Ability to analyze model quality using metrics, error analysis, and experiment tracking.
Nice to have: experience with MCP, model evaluation frameworks, time-series data, cloud environments (AWS/Azure), Opik/Langfuse.
Why Autodesk?
Work on cutting-edge ML and LLM technologies shaping the future of AEC design.
Contribute to cross-product AI initiatives (Tyto, AA, MCP, Agentic Accelerator).
Learn from and collaborate with experienced scientists, engineers, and product teams.
Clear growth opportunities and exposure across multiple strategic AI programs.
Learn More
About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
Salary transparency
Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.Diversity & Belonging
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging
Are you an existing contractor or consultant with Autodesk?
Please search for open jobs and apply internally (not on this external site).
Parexel
Nagarro
Ad Hoc LLC
Clarifai
Parexel
Autodesk
Autodesk
Autodesk