Logo for Fraunhofer-Gesellschaft

Career Opportunities: Student Assistant in the Field of LLM Security (81268)

Roles & Responsibilities

  • Very good Python skills (to be tested in interview)
  • Basic understanding of AI/ML, especially transformers
  • Experience with PyTorch and transformer architectures (desirable)
  • Enrolled student in Computer Science, Data Science, Mathematics or related field with good English skills

Requirements:

  • Develop methods to enhance the security of LLMs, focusing on defending against backdoor attacks and jailbreaks
  • Systematically evaluate the robustness of LLMs against established and novel attack scenarios (backdoor, divergence, membership inference, etc.)
  • Investigate, apply, and evaluate post-hoc explainability methods to analyze model behavior and understand attack mechanisms as well as defense effectiveness and limitations
  • Collaborate on scientific papers and contribute to a bachelor’s or master’s thesis

Job description

 

The Fraunhofer Institute for Secure Information Technology SIT is one of the leading research and development institutions for cybersecurity in Germany and Europe and is part of ATHENE, the national research center for applied cybersecurity. ATHENE is a cooperation between the Fraunhofer Society, TU Darmstadt, Darmstadt University of Applied Sciences, and Goethe University Frankfurt. Our common goal: to make the world of tomorrow safer.

 

Be part of change

  • Development of methods to enhance the security of LLMs. A major focus is on defending against common attacks such as backdoor attacks and associated jailbreaks.
  • Systematic evaluation of the robustness of LLMs against established and novel attack scenarios, regarding common and novel attacks such as backdoor attacks, divergence attacks, or membership inference attacks, etc.
  • Investigation, application, and evaluation of post-hoc explainability methods to analyze model behavior, with the aim of gaining a deeper understanding of the underlying attack mechanisms as well as the effectiveness and limitations of corresponding defense strategies. 

 

What you contribute

  • Very good Python skills, which will be tested in the interview.
  • Basic understanding of AI/ML mainly in relation to transformers
  • Experience with Pytorch and transformer architectures is desirable
  • Good English skills
  • Enrolled student (Computer Science, Data Science, Mathematics or similar)
  • Structured, independent working style and ability to work in a team
  • Strong analytical thinking
  •  

 

What we offer

  • Flexible working hours that can be easily combined with your studies
  • An inspiring work environment with state-of-the-art infrastructure
  • The opportunity to gain practical experience and make valuable contacts in research
  • Opportunity to collaborate on scientific papers and write a later bachelor's or master's thesis.
  • Position can be remote or hybrid
  • The monthly working time is about 40 hours, depending on the agreement 

 

We value and promote the diversity of our employees' skills and therefore welcome all applications – regardless of age, gender, nationality, ethnic and social origin, religion, ideology, disability, sexual orientation and identity. Severely disabled persons are given preference in the event of equal suitability. Our tasks are diverse and adaptable – for applicants with disabilities, we work together to find solutions that best promote their abilities. Remuneration according to the general works agreement for employing assistant staff.

With its focus on developing key technologies that are vital for the future and enabling the commercial utilization of this work by business and industry, Fraunhofer plays a central role in the innovation process. As a pioneer and catalyst for groundbreaking developments and scientific excellence, Fraunhofer helps shape society now and in the future. 

Ready for a change? Then apply now and make a difference! Once we have received your online application, you will receive an automatic confirmation of receipt. We will then get back to you as soon as possible and let you know what happens next.

 

Fraunhofer Institute for Secure Information Technology SIT 

<a href="http://​www.sit.fraunhofer.de<input id="tor__fcustInstituteLinkRMK" type='hidden' value='27335' >​" target="_blank" rel="noopener">www.sit.fraunhofer.de 

 

Requisition Number: 81268                Application Deadline:

 

[Not translated in selected language]
 

Related jobs

Other jobs at Fraunhofer-Gesellschaft

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.