Dan Roy
@roydanroy.bsky.social
Research Director, Founding Faculty, Canada CIFAR AI Chair @VectorInst.
Full Prof @UofT - Statistics and Computer Sci. (x-appt) danroy.org
I study assumption-free prediction and decision making under uncertainty, with inference emerging from optimality.
Full Prof @UofT - Statistics and Computer Sci. (x-appt) danroy.org
I study assumption-free prediction and decision making under uncertainty, with inference emerging from optimality.
Curious. Didn’t know meta had a PPL team.
April 7, 2025 at 1:13 AM
Curious. Didn’t know meta had a PPL team.
I like to think about non-reasoning model responses as vibes.
April 7, 2025 at 12:50 AM
I like to think about non-reasoning model responses as vibes.
And, to achieve the results in this paper, what was the most challenging part? Why had previous attempts fallen short? What was your key new insight?
February 3, 2025 at 3:25 AM
And, to achieve the results in this paper, what was the most challenging part? Why had previous attempts fallen short? What was your key new insight?
Very interesting. So, what was the biggest hole to fill, in terms of hypotheses?
February 2, 2025 at 5:19 PM
Very interesting. So, what was the biggest hole to fill, in terms of hypotheses?
What are the key papers to read?
December 30, 2024 at 8:36 PM
What are the key papers to read?
A $100,000,000 experiment is no longer "consequence" free. Ilya is saying "scaling is over", but this may simply be that the scaling "laws" (not laws) are no longer accurate. Also, those laws are tied to hyperparameter tunings.
December 15, 2024 at 1:08 PM
A $100,000,000 experiment is no longer "consequence" free. Ilya is saying "scaling is over", but this may simply be that the scaling "laws" (not laws) are no longer accurate. Also, those laws are tied to hyperparameter tunings.
Sure some were empirical. Some were not.
December 14, 2024 at 9:27 PM
Sure some were empirical. Some were not.
I'd say no in a sense. Xavier-He initialization was theoretical work. And that was absolutely critical.
December 14, 2024 at 1:47 AM
I'd say no in a sense. Xavier-He initialization was theoretical work. And that was absolutely critical.
Annoying. If it could be automatic, sure.
December 13, 2024 at 12:14 AM
Annoying. If it could be automatic, sure.
That's part of the spec. I don't think this is too problematic. The example they give is problems in NP, where there is a polynomial time checker (i.e., a polytime EV), but generating an instance that passes the checker is hard in the worst case.
December 12, 2024 at 10:37 PM
That's part of the spec. I don't think this is too problematic. The example they give is problems in NP, where there is a polynomial time checker (i.e., a polytime EV), but generating an instance that passes the checker is hard in the worst case.
@gkdziugaite.bsky.social. Works at GDM and Mila. Influential, technical work.
December 11, 2024 at 1:20 PM
@gkdziugaite.bsky.social. Works at GDM and Mila. Influential, technical work.