They find µP stabilizes early training (like an LR warmup), but IWD takes over in the long term!
The Maximal Update Parameterization (µP) allows LR transfer from small to large models, saving costly tuning, but independent weight decay (IWD) essential for it to work.
The Maximal Update Parameterization (µP) allows LR transfer from small to large models, saving costly tuning, but independent weight decay (IWD) essential for it to work.
October 24, 2025 at 9:16 AM
They find µP stabilizes early training (like an LR warmup), but IWD takes over in the long term!
The Maximal Update Parameterization (µP) allows LR transfer from small to large models, saving costly tuning, but independent weight decay (IWD) essential for it to work.
The Maximal Update Parameterization (µP) allows LR transfer from small to large models, saving costly tuning, but independent weight decay (IWD) essential for it to work.
Learned a lot over the past two days with UI Reach, ICCSD, Greater IC, local colleges, and IWD about ACT WorkKeys and the potential for becoming a Work Ready Community here in JoCo!
The first step is making sure that local employers understand the NCRC so that they can hire folks who achieve it!
The first step is making sure that local employers understand the NCRC so that they can hire folks who achieve it!
September 25, 2025 at 2:44 PM
Learned a lot over the past two days with UI Reach, ICCSD, Greater IC, local colleges, and IWD about ACT WorkKeys and the potential for becoming a Work Ready Community here in JoCo!
The first step is making sure that local employers understand the NCRC so that they can hire folks who achieve it!
The first step is making sure that local employers understand the NCRC so that they can hire folks who achieve it!
Jennifer is determined to bring forth recognition of chest/breastfeeding as a #GenderEquity issue. Read more about Jennifer’s #advocacy project, where she’s advocating for greater equity within California’s Black Infant Health (BIH) program ➡️ bit.ly/RU-IWD-2025 (🧵 2/2) #Breastfeeding #NBM25
August 4, 2025 at 3:56 PM
Jennifer is determined to bring forth recognition of chest/breastfeeding as a #GenderEquity issue. Read more about Jennifer’s #advocacy project, where she’s advocating for greater equity within California’s Black Infant Health (BIH) program ➡️ bit.ly/RU-IWD-2025 (🧵 2/2) #Breastfeeding #NBM25
Had a fabulous IWD bc I got to hang with some amazing colleagues in this work 🥰 love my community so much
Hope you all had a lovely international sex workers day!
Hope you all had a lovely international sex workers day!
June 3, 2025 at 2:33 PM
Had a fabulous IWD bc I got to hang with some amazing colleagues in this work 🥰 love my community so much
Hope you all had a lovely international sex workers day!
Hope you all had a lovely international sex workers day!
So... I feel like I survived a personal emergency with flying colors. What emergency?
* Modem died last night
* Router stopped functioning
* I work from home exclusively
* Had to add the iwd package to my Arch Linux Desktop without internet.
* Modem died last night
* Router stopped functioning
* I work from home exclusively
* Had to add the iwd package to my Arch Linux Desktop without internet.
May 30, 2025 at 2:50 PM
So... I feel like I survived a personal emergency with flying colors. What emergency?
* Modem died last night
* Router stopped functioning
* I work from home exclusively
* Had to add the iwd package to my Arch Linux Desktop without internet.
* Modem died last night
* Router stopped functioning
* I work from home exclusively
* Had to add the iwd package to my Arch Linux Desktop without internet.
called IWD-Transformer, thereby increasing the impact of this work. [8/8 of https://arxiv.org/abs/2505.16391v1]
May 23, 2025 at 6:03 AM
called IWD-Transformer, thereby increasing the impact of this work. [8/8 of https://arxiv.org/abs/2505.16391v1]
The right to work is essential to dignity and equality. On #IWD we stand with Afghan women.
“It has been over 3.5 yrs since Afghan women from all walks of life took to the streets chanting “Bread, Work, Freedom,” a fierce assertion of their right to work & be free from Taliban systemic oppression. This #IWD, their call is more urgent than ever.” www.hrw.org/news/2025/04...
For ‘Bread, Work, Freedom,’ Afghan Women Are Still Resisting
It has been over three and a half years since Afghan women from all walks of life first took to the streets chanting “Bread, Work, Freedom,” a fierce assertion of their right to work and to be free fr...
www.hrw.org
May 1, 2025 at 11:44 AM
The right to work is essential to dignity and equality. On #IWD we stand with Afghan women.
“It has been over 3.5 yrs since Afghan women from all walks of life took to the streets chanting “Bread, Work, Freedom,” a fierce assertion of their right to work & be free from Taliban systemic oppression. This #IWD, their call is more urgent than ever.” www.hrw.org/news/2025/04...
For ‘Bread, Work, Freedom,’ Afghan Women Are Still Resisting
It has been over three and a half years since Afghan women from all walks of life first took to the streets chanting “Bread, Work, Freedom,” a fierce assertion of their right to work and to be free fr...
www.hrw.org
May 1, 2025 at 9:00 AM
“It has been over 3.5 yrs since Afghan women from all walks of life took to the streets chanting “Bread, Work, Freedom,” a fierce assertion of their right to work & be free from Taliban systemic oppression. This #IWD, their call is more urgent than ever.” www.hrw.org/news/2025/04...
A year ago, on #InternationalWorkersDay, I submitted my thesis for examination (I should've added the full date on the front page, hmm!).
IWD = best day of the year and the one most worthy of celebrating/marking
Solidarity on #MayDay!
IWD = best day of the year and the one most worthy of celebrating/marking
Solidarity on #MayDay!
April 30, 2025 at 11:20 PM
A year ago, on #InternationalWorkersDay, I submitted my thesis for examination (I should've added the full date on the front page, hmm!).
IWD = best day of the year and the one most worthy of celebrating/marking
Solidarity on #MayDay!
IWD = best day of the year and the one most worthy of celebrating/marking
Solidarity on #MayDay!
There's no better day than 28 April to remind ourselves that Trade Unions make work safe for workers
On IWD we remember the dead, and renew our fight for the living to have decent workplaces that look after our health, safety and welfare at work.
www.unison.org.uk/unison-healt...
On IWD we remember the dead, and renew our fight for the living to have decent workplaces that look after our health, safety and welfare at work.
www.unison.org.uk/unison-healt...
April 27, 2025 at 9:36 AM
There's no better day than 28 April to remind ourselves that Trade Unions make work safe for workers
On IWD we remember the dead, and renew our fight for the living to have decent workplaces that look after our health, safety and welfare at work.
www.unison.org.uk/unison-healt...
On IWD we remember the dead, and renew our fight for the living to have decent workplaces that look after our health, safety and welfare at work.
www.unison.org.uk/unison-healt...
I think men also did it for IWD - why do we need to make this a gender thing? We should support women, men, children and highlight the positives and address the negatives - and do so as a society/community. And I do do the work. I do it everyday. Even have this “chat” with you. Happy day.
April 13, 2025 at 10:58 PM
I think men also did it for IWD - why do we need to make this a gender thing? We should support women, men, children and highlight the positives and address the negatives - and do so as a society/community. And I do do the work. I do it everyday. Even have this “chat” with you. Happy day.
You don't do the work. If you did you wouldn't be complaining about IWD on a post about IWD. Go. Do. The. Work.
April 13, 2025 at 10:43 PM
You don't do the work. If you did you wouldn't be complaining about IWD on a post about IWD. Go. Do. The. Work.
Ah, yes, here it comes: the "you're angry" accusations.
Just go put in the work, dude. Go do it. Women did it for IWD. You do it for IMD. It's not impossible, but sitting here and whining about it isn't getting you anywhere. So go do the work.
Just go put in the work, dude. Go do it. Women did it for IWD. You do it for IMD. It's not impossible, but sitting here and whining about it isn't getting you anywhere. So go do the work.
April 13, 2025 at 10:41 PM
Ah, yes, here it comes: the "you're angry" accusations.
Just go put in the work, dude. Go do it. Women did it for IWD. You do it for IMD. It's not impossible, but sitting here and whining about it isn't getting you anywhere. So go do the work.
Just go put in the work, dude. Go do it. Women did it for IWD. You do it for IMD. It's not impossible, but sitting here and whining about it isn't getting you anywhere. So go do the work.
66/n | Sareta was named as one of Apolitical’s 100 Most Influential People in #Gender Policy (2020).
Sareta (@saretaashraph.bsky.social), your career is truly inspiring! Thanks for participating in our campaign and for your work!
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
Sareta (@saretaashraph.bsky.social), your career is truly inspiring! Thanks for participating in our campaign and for your work!
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
April 1, 2025 at 12:18 PM
66/n | Sareta was named as one of Apolitical’s 100 Most Influential People in #Gender Policy (2020).
Sareta (@saretaashraph.bsky.social), your career is truly inspiring! Thanks for participating in our campaign and for your work!
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
Sareta (@saretaashraph.bsky.social), your career is truly inspiring! Thanks for participating in our campaign and for your work!
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
46/n | Ania has published articles and contributed to edited books on topics of #ICL, #IHL, and #IHRL.
Thank you Ania, for taking part in our campaign and for all the incredible work you do!
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
Thank you Ania, for taking part in our campaign and for all the incredible work you do!
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
March 31, 2025 at 11:26 AM
46/n | Ania has published articles and contributed to edited books on topics of #ICL, #IHL, and #IHRL.
Thank you Ania, for taking part in our campaign and for all the incredible work you do!
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
Thank you Ania, for taking part in our campaign and for all the incredible work you do!
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
Lucy Moore was a pioneering New Zealand botanist known for her work on native flora and plant #ecology. She contributed to the "Flora of New Zealand" series, collaborated with fellow botanist Lucy Cranwell, and earned numerous honours, leaving a lasting legacy in botany.
#TETTRIsEU #Taxonomy #IWD
#TETTRIsEU #Taxonomy #IWD
March 28, 2025 at 10:07 AM
Lucy Moore was a pioneering New Zealand botanist known for her work on native flora and plant #ecology. She contributed to the "Flora of New Zealand" series, collaborated with fellow botanist Lucy Cranwell, and earned numerous honours, leaving a lasting legacy in botany.
#TETTRIsEU #Taxonomy #IWD
#TETTRIsEU #Taxonomy #IWD
29/n | Thank you so much Kate Gibson (@kategibson123.bsky.social) for being a part of our #IWD campaign! Your work as an international criminal lawyer and your dedication to justice and human rights is truly inspiring.
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
March 25, 2025 at 2:52 PM
29/n | Thank you so much Kate Gibson (@kategibson123.bsky.social) for being a part of our #IWD campaign! Your work as an international criminal lawyer and your dedication to justice and human rights is truly inspiring.
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
#IWD
#WomeninLaw
#TrailblazingWomen
#AYICL
#WomeninInternationalLaw
So great to be at Good To Be Good's annual #IWD Community Event!
Led by women, these incredible leaders are working hard to drive progress toward gender equity.
Huge thanks to Char and the entire team for your inspiring work!
Led by women, these incredible leaders are working hard to drive progress toward gender equity.
Huge thanks to Char and the entire team for your inspiring work!
March 21, 2025 at 5:56 PM
So great to be at Good To Be Good's annual #IWD Community Event!
Led by women, these incredible leaders are working hard to drive progress toward gender equity.
Huge thanks to Char and the entire team for your inspiring work!
Led by women, these incredible leaders are working hard to drive progress toward gender equity.
Huge thanks to Char and the entire team for your inspiring work!
Great to see @mcbrisbois.bsky.social interviewed by @sussexnrggroup.bsky.social for #IWD last week!! She talked about motivation, her impactful work with @edrc-uk.bsky.social, and the two must-read papers topping her list right now.📚
Watch it here: tinyurl.com/3k6t5der
Watch it here: tinyurl.com/3k6t5der
March 21, 2025 at 3:16 PM
Great to see @mcbrisbois.bsky.social interviewed by @sussexnrggroup.bsky.social for #IWD last week!! She talked about motivation, her impactful work with @edrc-uk.bsky.social, and the two must-read papers topping her list right now.📚
Watch it here: tinyurl.com/3k6t5der
Watch it here: tinyurl.com/3k6t5der
Last week, we caught up with @mcbrisbois.bsky.social from @sussexnrggroup.bsky.social for #IWD! 🚨 We talked motivation, her impactful work with @edrc-uk.bsky.social, and the two must-read papers topping her list right now.📚 www.youtube.com/watch?v=cS8R...
EnGRG A Spotlight on... Marie Claire Brisbois
YouTube video by Energy Geographies Research Group
www.youtube.com
March 20, 2025 at 11:32 AM
Last week, we caught up with @mcbrisbois.bsky.social from @sussexnrggroup.bsky.social for #IWD! 🚨 We talked motivation, her impactful work with @edrc-uk.bsky.social, and the two must-read papers topping her list right now.📚 www.youtube.com/watch?v=cS8R...
3/19/1911
More than one million attend first International Women's Day (IWD) rallies campaigning for women's rights to work, vote, hold office, Germany, Austria
More than one million attend first International Women's Day (IWD) rallies campaigning for women's rights to work, vote, hold office, Germany, Austria
March 19, 2025 at 5:09 PM
3/19/1911
More than one million attend first International Women's Day (IWD) rallies campaigning for women's rights to work, vote, hold office, Germany, Austria
More than one million attend first International Women's Day (IWD) rallies campaigning for women's rights to work, vote, hold office, Germany, Austria
✨ #EESheInnovates continues!
Meet Emmy Noether (1882–1935), a pioneering mathematician whose work laid the foundation for modern abstract algebra and theoretical physics.
#EELISA #WomenInSTEM #Innovation #Math #Physics #History #FAU #IWD #Innovation #Sustainability #Diversity #Equality @fau.de
Meet Emmy Noether (1882–1935), a pioneering mathematician whose work laid the foundation for modern abstract algebra and theoretical physics.
#EELISA #WomenInSTEM #Innovation #Math #Physics #History #FAU #IWD #Innovation #Sustainability #Diversity #Equality @fau.de
March 19, 2025 at 3:27 PM
✨ #EESheInnovates continues!
Meet Emmy Noether (1882–1935), a pioneering mathematician whose work laid the foundation for modern abstract algebra and theoretical physics.
#EELISA #WomenInSTEM #Innovation #Math #Physics #History #FAU #IWD #Innovation #Sustainability #Diversity #Equality @fau.de
Meet Emmy Noether (1882–1935), a pioneering mathematician whose work laid the foundation for modern abstract algebra and theoretical physics.
#EELISA #WomenInSTEM #Innovation #Math #Physics #History #FAU #IWD #Innovation #Sustainability #Diversity #Equality @fau.de