Seminar

Name: Should we skip attention?
Start: 2025-12-12T15:30:00-05:00
End: 2025-12-12T16:30:00-05:00
Location: 3305 Newell-Simon Hall

List
Month

S	M	T	W	T	F	S
	0 events 1 0 events, 1	0 events 2 0 events, 2	0 events 3 0 events, 3	0 events 4 0 events, 4	0 events 5 0 events, 5	0 events 6 0 events, 6
0 events 7 0 events, 7	1 event 8 1 event, 8 3:30 pm - 4:30 pm VASC Seminar Eliahu Horwitz The Hebrew University of Jerusalem Monday, December 8 3:30 pm - 4:30 pm What Can We Learn from a Million Models? Abstract: Machine learning has transformed many fields by learning from large collections of data. Yet, it is rarely applied to its own outputs: the models themselves. Today, with millions of publicly available models, a natural question arises: what can we do with so many models? In this talk, I will motivate two core applications that [...]	0 events 9 0 events, 9	0 events 10 0 events, 10	0 events 11 0 events, 11	1 event 12 1 event, 12 3:30 pm - 4:30 pm VASC Seminar Simon Lucey The Australian Institute for Machine Learning Friday, December 12 3:30 pm - 4:30 pm Should we skip attention? Abstract: Transformers are ubiquitous. They influence nearly every aspect of modern AI. However, the mechanics of their training remain poorly understood. This poses a problem for the field due to the immense amounts of data, computational power, and energy being invested in the training of these networks. I highlight a recent intriguing empirical result from [...]	0 events 13 0 events, 13
0 events 14 0 events, 14	0 events 15 0 events, 15	0 events 16 0 events, 16	0 events 17 0 events, 17	0 events 18 0 events, 18	0 events 19 0 events, 19	0 events 20 0 events, 20
0 events 21 0 events, 21	0 events 22 0 events, 22	0 events 23 0 events, 23	0 events 24 0 events, 24	0 events 25 0 events, 25	0 events 26 0 events, 26	0 events 27 0 events, 27
0 events 28 0 events, 28	0 events 29 0 events, 29	0 events 30 0 events, 30	0 events 31 0 events, 31

There are no events on this day.

Monday, December 8

VASC Seminar

Eliahu Horwitz

Google PhD Fellow

The Hebrew University of Jerusalem

What Can We Learn from a Million Models?

Monday, December 8
3:30 pm - 4:30 pm

There are no events on this day.

Friday, December 12

VASC Seminar

Simon Lucey

Director

The Australian Institute for Machine Learning

Should we skip attention?

Friday, December 12
3:30 pm - 4:30 pm

There are no events on this day.

Calendar of Events

VASC Seminar Eliahu Horwitz The Hebrew University of Jerusalem

VASC Seminar Simon Lucey The Australian Institute for Machine Learning

What Can We Learn from a Million Models?

Should we skip attention?

VASC Seminar

Eliahu Horwitz

The Hebrew University of Jerusalem

VASC Seminar

Simon Lucey

The Australian Institute for Machine Learning