Projects
Higher Order Attention
15-08-2026I investigated whether higher-order interactions in attention can improve small language models trained under severe data constraints. In a…
I investigated whether higher-order interactions in attention can improve small language models trained under severe data constraints. In a…