Logo for Fraunhofer-Gesellschaft

Career Opportunities: Student Assistant in the Field of LLM Security (81268)

Role overview

Qualifications

  • Very good Python skills (to be tested in interview)
  • Basic understanding of AI/ML, especially transformers
  • Experience with PyTorch and transformer architectures (desirable)
  • Enrolled student in Computer Science, Data Science, Mathematics or related field with good English skills

Responsibilities

  • Develop methods to enhance the security of LLMs, focusing on defending against backdoor attacks and jailbreaks
  • Systematically evaluate the robustness of LLMs against established and novel attack scenarios (backdoor, divergence, membership inference, etc.)
  • Investigate, apply, and evaluate post-hoc explainability methods to analyze model behavior and understand attack mechanisms as well as defense effectiveness and limitations
  • Collaborate on scientific papers and contribute to a bachelor’s or master’s thesis

About the company

Fraunhofer-Gesellschaft logo

Fraunhofer-Gesellschaft

Research & Scientific Services

Die Fraunhofer-Gesellschaft mit Sitz in Deutschland ist die weltweit fΓΌhrende Organisation fΓΌr anwendungsorientierte Forschung. Mit ihrer Fokussierung auf zukunftsrelevante SchlΓΌsseltechnologien sowie auf die Verwertung der Ergebnisse in Wirtschaft und Industrie spielt sie eine zentrale Rolle im Innovationsprozess. Als Wegweiser und Impulsgeber fΓΌr innovative Entwicklungen und wissenschaftliche Exzellenz wirkt sie mit an der Gestaltung unserer Gesellschaft und unserer Zukunft. Die 1949 gegrΓΌndete Organisation betreibt in Deutschland derzeit 75 Institute und Forschungseinrichtungen. Rund 29 000 Mitarbeiterinnen und Mitarbeiter, ΓΌberwiegend mit natur- oder ingenieurwissenschaftlicher Ausbildung, erarbeiten das jΓ€hrliche Forschungsvolumen von 2,8 Milliarden Euro. Davon fallen 2,3 Milliarden Euro auf den Leistungsbereich Vertragsforschung.

Company details

IndustryResearch & Scientific Services
Company size10001

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

 

The Fraunhofer Institute for Secure Information Technology SIT is one of the leading research and development institutions for cybersecurity in Germany and Europe and is part of ATHENE, the national research center for applied cybersecurity. ATHENE is a cooperation between the Fraunhofer Society, TU Darmstadt, Darmstadt University of Applied Sciences, and Goethe University Frankfurt. Our common goal: to make the world of tomorrow safer.

 

Be part of change

  • Development of methods to enhance the security of LLMs. A major focus is on defending against common attacks such as backdoor attacks and associated jailbreaks.
  • Systematic evaluation of the robustness of LLMs against established and novel attack scenarios, regarding common and novel attacks such as backdoor attacks, divergence attacks, or membership inference attacks, etc.
  • Investigation, application, and evaluation of post-hoc explainability methods to analyze model behavior, with the aim of gaining a deeper understanding of the underlying attack mechanisms as well as the effectiveness and limitations of corresponding defense strategies. 

 

What you contribute

  • Very good Python skills, which will be tested in the interview.
  • Basic understanding of AI/ML mainly in relation to transformers
  • Experience with Pytorch and transformer architectures is desirable
  • Good English skills
  • Enrolled student (Computer Science, Data Science, Mathematics or similar)
  • Structured, independent working style and ability to work in a team
  • Strong analytical thinking
  •  

 

What we offer

  • Flexible working hours that can be easily combined with your studies
  • An inspiring work environment with state-of-the-art infrastructure
  • The opportunity to gain practical experience and make valuable contacts in research
  • Opportunity to collaborate on scientific papers and write a later bachelor's or master's thesis.
  • Position can be remote or hybrid
  • The monthly working time is about 40 hours, depending on the agreement 

 

We value and promote the diversity of our employees' skills and therefore welcome all applications – regardless of age, gender, nationality, ethnic and social origin, religion, ideology, disability, sexual orientation and identity. Severely disabled persons are given preference in the event of equal suitability. Our tasks are diverse and adaptable – for applicants with disabilities, we work together to find solutions that best promote their abilities. Remuneration according to the general works agreement for employing assistant staff.

With its focus on developing key technologies that are vital for the future and enabling the commercial utilization of this work by business and industry, Fraunhofer plays a central role in the innovation process. As a pioneer and catalyst for groundbreaking developments and scientific excellence, Fraunhofer helps shape society now and in the future. 

Ready for a change? Then apply now and make a difference! Once we have received your online application, you will receive an automatic confirmation of receipt. We will then get back to you as soon as possible and let you know what happens next.

 

Fraunhofer Institute for Secure Information Technology SIT 

<a href="http://​www.sit.fraunhofer.de<input id="tor__fcustInstituteLinkRMK" type='hidden' value='27335' >​" target="_blank" rel="noopener">www.sit.fraunhofer.de 

 

Requisition Number: 81268                Application Deadline:

 

[Not translated in selected language]
 

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
Β·

Related jobs

Other jobs at Fraunhofer-Gesellschaft

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.