John Sandall
@johnsandall.bsky.social
CEO & Principal Data Scientist at coefficient.ai
Reposted by John Sandall
Kicking off tonight’s PyData London with @johnsandall.bsky.social telling us about Death by RMSE: Cautionary Tales of Metrics Gone Wild
Choosing the wrong eval metrics can look great but give terrible real world performance—it’s always a trade off!
Choosing the wrong eval metrics can look great but give terrible real world performance—it’s always a trade off!
April 1, 2025 at 6:54 PM
Kicking off tonight’s PyData London with @johnsandall.bsky.social telling us about Death by RMSE: Cautionary Tales of Metrics Gone Wild
Choosing the wrong eval metrics can look great but give terrible real world performance—it’s always a trade off!
Choosing the wrong eval metrics can look great but give terrible real world performance—it’s always a trade off!
The model is trained, eval metrics are great, nothing changes — the KPIs are static, business impact isn’t there, did you optimise for the wrong thing?
I'm speaking at @pydatalondon.bsky.social meetup tomorrow on "Death by RMSE: Cautionary Tales of Metrics Gone Wild"
www.meetup.com/pydata-londo...
I'm speaking at @pydatalondon.bsky.social meetup tomorrow on "Death by RMSE: Cautionary Tales of Metrics Gone Wild"
www.meetup.com/pydata-londo...
PyData London - 95th Meetup, Tue, Apr 1, 2025, 7:00 PM | Meetup
## Details
**Venue**: Riverbank House, 2 Swan Ln, London EC4R 3AD
**Please note**:
1. 🚨🚨🚨A valid photo ID is required by building security. 🚨🚨🚨
2. This event follo
www.meetup.com
March 31, 2025 at 11:59 AM
The model is trained, eval metrics are great, nothing changes — the KPIs are static, business impact isn’t there, did you optimise for the wrong thing?
I'm speaking at @pydatalondon.bsky.social meetup tomorrow on "Death by RMSE: Cautionary Tales of Metrics Gone Wild"
www.meetup.com/pydata-londo...
I'm speaking at @pydatalondon.bsky.social meetup tomorrow on "Death by RMSE: Cautionary Tales of Metrics Gone Wild"
www.meetup.com/pydata-londo...