Zum Inhalt springen

Abschlussarbeit im Unternehmen

Master's Thesis: Localisation of Safety Neurones in Text2Image Models

Fraunhofer-Gesellschaft · Darmstadt

Master's Thesis: Localisation of Safety Neurones in Text2Image Models

Einstiegsart
Abschlussarbeit im Unternehmen
Arbeitgeber
Fraunhofer-Gesellschaft
Einsatzort
Darmstadt
Fachrichtung
Nachrichten- und Informationstechnik
Letzte Aktualisierung
09.11.2026
connecticum-JobNr
1848643

Stellenbeschreibung

Apply now » City: Darmstadt Date: Nov 3, 2026 Master's Thesis: Localisation of Safety Neurones in Text2Image Models The Fraunhofer-Gesellschaft (www.fraunhofer.com ) is one of the world's leading organizations for application-oriented research. 74 institutes develop pioneering technologies for our economy and society – more precisely: 30 000 people from technology, science, administration and IT. They know: Anyone who comes to Fraunhofer wants to and can make a difference.

For themselves, for us and for the markets of today and tomorrow. The Fraunhofer Institute for Secure Information Technology SIT is one of the leading research and development institutions for cybersecurity in Germany and Europe and is part of ATHENE, the national research center for applied cybersecurity. ATHENE is a collaboration between the Fraunhofer Society, TU Darmstadt, Hochschule Darmstadt, and Goethe University Frankfurt. Our common goal: to make the world of tomorrow safer.

Be part of change LLMs have gained significant attention recently due to their remarkable capabilities. A similar, yet less explored field focuses on text-to-image (T2I) model architectures. Since a picture is worth more than a thousand words, one can assume that T2I models possess at least as many capabilities as text-to-text models (T2T). Therefore, it is important to subject these models to an "alignment" process. In T2T models, some neurones in the architecture are repurposed as safety neurones.

To better understand the alignment process, the locations of safety neurones in both architectures should be compared.Objective: The work aims to investigate the localisations of safety neurones in T2I models and compare them with T2T models. For this purpose, the proposed approaches for the localisation of safety neurones from T2T models will be adapted and implemented for T2I models. Finally, results regarding the localisation and significance of the neurones are analysed to highlight similarities and differences in the architectures.Results: The results of this work aim to conceptualise the differences in model architectures for LLM security research.

Since T2I models receive less attention, it is important to motivate further research on these models. For this purpose, a comprehensive comparison of different architectures and their associated safety neurones will be conducted as part of the work. The results are verified by a targeted deactivation of the identified neurones and then compared with randomly deactivated neurones.What you do with us: Researching and implementing novel machine learning approaches that enhance the security of LLMs Self-critical evaluation of the obtained results Presenting the results Preparing a project report in the form of a master's thesis What you contribute Very good academic record with a maximum average grade of 2.2 Very good programming skills in Python are strictly required and will be assessed through practical tasks during the selection process Knowledge in Machine Learning, including training, inference, and optimization of transformer architectures Knowledge in ML-Security is desirable Good Python skills, specifically with PyTorch Scientific interest and interest in current research projects

What we offer

Independent work schedule management Insights into the intersection of academic research and industrial application Related works: https://arxiv.org/pdf/2404.09932 (Relevante Abschnitte 2.2, 2.7, 3.1, 3.2) https://arxiv.org/pdf/2402.05162 https://arxiv.org/pdf/2406.14144 We value and promote the diversity of our employees' skills and therefore welcome all applications – regardless of age, gender, nationality, ethnic and social origin, religion, ideology, disability, sexual orientation and identity.

Severely disabled persons are given preference in the event of equal suitability. Our tasks are diverse and adaptable – for applicants with disabilities, we work together to find solutions that best promote their abilities. With its focus on developing key technologies that are vital for the future and enabling the commercial utilization of this work by business and industry, Fraunhofer plays a central role in the innovation process. As a pioneer and catalyst for groundbreaking developments and scientific excellence, Fraunhofer helps shape society now and in the future.

Ready for a change? Then apply now and make a difference! Once we have received your online application, you will receive an automatic confirmation of receipt. We will then get back to you as soon as possible and let you know what happens next. Fraunhofer Institute for Secure Information Technology SIT www.sit.fraunhofer.de Requisition Number: 81219 Application Deadline: Job Segment: Neurology, Cyber Security, R&D, Safety, Research, Healthcare, Security, Service Apply now »

Über Fraunhofer-Gesellschaft

Mitarbeiter im Unternehmen
10.001 - 50.000
Firmensprache
Deutsch
Website
fraunhofer.de
Karriere-Website
fraunhofer.de/de/jobs-und-karriere.html

Weitere Jobs von Fraunhofer-Gesellschaft

Alle Jobs von Fraunhofer-Gesellschaft

Arbeitgeber persönlich treffen

Auf der connecticum 2027 in Berlin sprichst du direkt mit Arbeitgebern aus Business, IT und Engineering.

connecticum Business-Karrieremesse 2027 · 23. November

connecticum IT-Karrieremesse 2027 · 24. November

connecticum Engineering-Karrieremesse 2027 · 25. November

Ähnliche Jobs

Weitere Stellen finden

Nach Einstiegsart

Alle Jobangebote nach Datum

Master's Thesis: Localisation of Safety Neurones in…

Stelle per E-Mail senden · Stelle melden

Für Arbeitgeber: Stellen bei connecticum Jobs veröffentlichen