Marty Puterman
@martypute.bsky.social
Researcher on MDPs and RL. Retired prof. #orms #rl
Preprints of ALL chapters of "Markov Decision Processes and Reinforcement Learning" by Puterman and Chan are now posted at github.com/martyput/MDP....
All feedback and typos are greatly appreciated and will impact the final version. Links will be removed when the book is published. #AI #orms
All feedback and typos are greatly appreciated and will impact the final version. Links will be removed when the book is published. #AI #orms
GitHub - martyput/MDP_book
Contribute to martyput/MDP_book development by creating an account on GitHub.
github.com
September 30, 2025 at 5:40 PM
Preprints of ALL chapters of "Markov Decision Processes and Reinforcement Learning" by Puterman and Chan are now posted at github.com/martyput/MDP....
All feedback and typos are greatly appreciated and will impact the final version. Links will be removed when the book is published. #AI #orms
All feedback and typos are greatly appreciated and will impact the final version. Links will be removed when the book is published. #AI #orms
Chapters 1-7 of our forthcoming book “Markov Decision Processes and Reinforcement Learning” by Puterman and Chan can be dowloaded at:
github.com/martyput/MDP....
They cover model foundations, and MDPs. Please share comments and/or typos ASAP.
#orms #AI #ReinforcementLearning
github.com/martyput/MDP....
They cover model foundations, and MDPs. Please share comments and/or typos ASAP.
#orms #AI #ReinforcementLearning
September 25, 2025 at 5:06 PM
Chapters 1-7 of our forthcoming book “Markov Decision Processes and Reinforcement Learning” by Puterman and Chan can be dowloaded at:
github.com/martyput/MDP....
They cover model foundations, and MDPs. Please share comments and/or typos ASAP.
#orms #AI #ReinforcementLearning
github.com/martyput/MDP....
They cover model foundations, and MDPs. Please share comments and/or typos ASAP.
#orms #AI #ReinforcementLearning
Reposted by Marty Puterman
An important point about this site is that if you have deep MDP questions, instead of asking an influencer on twitter, you can ask @martypute.bsky.social which is uh, a serious step up
September 22, 2025 at 4:09 AM
An important point about this site is that if you have deep MDP questions, instead of asking an influencer on twitter, you can ask @martypute.bsky.social which is uh, a serious step up
Rick Scott; We'll miss your amazing music and presence in the Vancouver music scene.
youtu.be/nlyRiUIAByM?...
youtu.be/nlyRiUIAByM?...
Eh Canada - Rick Scott
YouTube video by RickScottKids
youtu.be
August 7, 2025 at 6:28 PM
Rick Scott; We'll miss your amazing music and presence in the Vancouver music scene.
youtu.be/nlyRiUIAByM?...
youtu.be/nlyRiUIAByM?...
Reposted by Marty Puterman
I strongly agree
The Turing Award for Sutton and Barto is a well-deserved acknowledgment of their foundational contributions to reinforcement learning, particularly their work on actor critics and TD(λ), both of which have directly shaped modern RL. A day to celebrate and ignore critics of #RL and Bellman equation.
March 9, 2025 at 12:11 AM
I strongly agree
Reposted by Marty Puterman
Reposted by Marty Puterman
Congrats Andrew and Rich, well deserved!! apnews.com/article/turi...
AI pioneers who channeled 'hedonistic' machines win computer science's top prize
Teaching machines in the way that animal trainers mold the behavior of dogs or horses has been an important method for developing artificial intelligence and one that was recognized Wednesday with the...
apnews.com
March 6, 2025 at 3:41 AM
Congrats Andrew and Rich, well deserved!! apnews.com/article/turi...
Reposted by Marty Puterman
A new Trump resort?
February 26, 2025 at 5:31 AM
A new Trump resort?
Reposted by Marty Puterman
In the early part of my career, many said to me: all your work in RL & MDPs will never see applications. They were so wrong...most modern robots are based on RL. And about 1/3rd of the talks at the last INFORMS were on RL and the Bellman equation.
February 8, 2025 at 3:05 PM
In the early part of my career, many said to me: all your work in RL & MDPs will never see applications. They were so wrong...most modern robots are based on RL. And about 1/3rd of the talks at the last INFORMS were on RL and the Bellman equation.
An illustrated guide to never learning anything
December 25, 2024 at 12:31 AM
@eugenevinitsky.bsky.social
Would you like to meet Thursday at NeurIPS.
Would you like to meet Thursday at NeurIPS.
December 12, 2024 at 1:27 AM
@eugenevinitsky.bsky.social
Would you like to meet Thursday at NeurIPS.
Would you like to meet Thursday at NeurIPS.
Reposted by Marty Puterman
If you're at NeurIPS, RLC is hosting an RL event from 8 till late at The Pearl on Dec. 11th. Join us, meet all the RL researchers, and spread the word!
December 10, 2024 at 9:55 PM
If you're at NeurIPS, RLC is hosting an RL event from 8 till late at The Pearl on Dec. 11th. Join us, meet all the RL researchers, and spread the word!
December 9, 2024 at 5:56 PM
I agree.
Many of those I followed on X are now on bluesky. Looking for more in the operations research community. #operations_research
December 7, 2024 at 5:57 PM
I agree.
Who is organizing RLC?
December 6, 2024 at 11:29 PM
Who is organizing RLC?
Reposted by Marty Puterman
The call for papers for RLC is now up! Abstract deadline of 2/14, submission deadline of 2/21!
Please help us spread the word.
rl-conference.cc/callforpaper...
Please help us spread the word.
rl-conference.cc/callforpaper...
RLJ | RLC Call for Papers
rl-conference.cc
December 2, 2024 at 3:39 PM
The call for papers for RLC is now up! Abstract deadline of 2/14, submission deadline of 2/21!
Please help us spread the word.
rl-conference.cc/callforpaper...
Please help us spread the word.
rl-conference.cc/callforpaper...
Many of those I followed on X are now on bluesky. Looking for more in the operations research community. #operations_research
November 29, 2024 at 5:50 PM
Many of those I followed on X are now on bluesky. Looking for more in the operations research community. #operations_research
Reposted by Marty Puterman
In case y'all don't know, Google @deep-mind.bsky.social recently released a video documentary about making the #RL algorithm AlphaGo that beat Lee Sedol, the World Champion of Go. Super cool story, check it out:
www.youtube.com/watch?v=WXuK...
www.youtube.com/watch?v=WXuK...
AlphaGo - The Movie | Full award-winning documentary
YouTube video by Google DeepMind
www.youtube.com
November 20, 2024 at 3:03 PM
In case y'all don't know, Google @deep-mind.bsky.social recently released a video documentary about making the #RL algorithm AlphaGo that beat Lee Sedol, the World Champion of Go. Super cool story, check it out:
www.youtube.com/watch?v=WXuK...
www.youtube.com/watch?v=WXuK...
Looking forward to seeing posts from the RL and OR communities.
November 24, 2024 at 12:31 AM
Looking forward to seeing posts from the RL and OR communities.