• Worked in a team to learn the principles of diffusion in a discrete setting: forward and reverse diffusion processes, noise schedules, discrete and continuous objective functions, etc. Implemented a diffusion model for language tasks in PyTorch based on recent research (https://arxiv.org/pdf/2406.07524).
• Continuing the project to investigate generalisation in discrete diffusion models.
• Built and optimised transformer-based architectures for language modelling, gaining experience with attention mechanisms and sinusoidal positional encodings.
• Explored white-box adversarial attacks of retrained image classification models; researched and implemented various black-box attacks.

Skills: PyTorch · Diffusion Models · Transformer Models · Adversarial Attacks · Machine Learning