Does anybody know the level of interaction a general account on BlueSky has? Despite over 1000 followers I feel it's a lot lower than many other social platforms. Do you think this is a result of a large influx of non 'organic' growth?

#meta
#bluesky
#askbluesky

Is there a way to shift my doomscrolling from Instagram to Bluesky? I know I'd end up more informed and positive from 10 minutes on here than on insta. Maybe some good suggestions of random fun accounts to follow?

Wallace and Grommit serving up some great PSA's on AI and automation. Doesn't just seem to play out the AI bad trope and shows to a general audience how it can go wrong quickly.

Just starting to build out my home office to have a nice space to push through the end of my PhD. What's your number one item to have in it? Can be anything from plants to monitors!
🌊🧪
#phdlife
#academia

Sits down to write paper...

6 months later. This paper hasn't written itself yet no matter how many times I ask nicely...

What are your tips for breaking through writing block and pushing out your paper? Could really do with some advice from the academic community!
🧪🌊

Our oceans aren't quiet and they're getting louder. A great paper on how important sound is in the ocean and how humans are impacting it. This is not only important for the biosphere but louder oceans make bad actors harder to detect.
🧪 🌊

www.science.org/doi/10.1126/...

Kind of a broken record here but proceedings.neurips.cc/paper_files/...
is totally fascinating in that it postulates two underlying, measurable structures that you can use to assess if RL will be easy or hard in an environment

For those doing lit reviews, be aware that Scopus can now search for pre prints as well! Great for getting visibility of what's on the horizon in your field.
🧪

The beginnings of a starter pack for UK-based PhD students. Please let me know if you'd like to be added! go.bsky.app/8Uj4vn7

What's your reinforcement learning stack?

I use:
- Custom gymnasium env
- Stable baselines 3 - RL library
- PPO - Algorithm
- NatureCNN - Model network
- wandb - run tracking
- wandb sweeps - hyper-parameter optimization
- tensorboard - offline tracking

#AI
#DRL
#RL
#Reinforcementlearning

Yesterday's wintery work views. Having a large window right next to the desk has helped massively with fighting back the SAD this year. Take this post as your reminder to get some sunshine and fresh air today.

Another must read for reinforcement learning. Answers many key questions for researchers;
-Do I need multiple training runs?
-How do I report model confidence?
-And a great section on common mistakes to fend off reviewer 2
🧪
#DRL
#reinforcementlearning
#AI
arxiv.org/abs/2304.01315

One of my favourite DRL papers. OpenAI five, it highlights just how much compute and time is needed for training complex capable agents. Remember this is learning in a human coded environment . Training agents for real world scenarios is even more challenging.
🧪
#RL
#AI

arxiv.org/abs/1912.06680

Make sure your DRL work is actually useful. A brilliant paper outlining all the things you should be considering when publishing DRL results
arxiv.org/abs/1709.06560

#Reinforcementlearning
#DRL
#AI
🧪

One of the most useful blog posts to read before messing around with PPO:
iclr-blog-track.github.io/2022/03/25/p...

#Reinforcementlearning
#AI
#RL

Feel free to interact with me about:
🧪
- Reinforcement learning
- Oceanography
- Acoustic modelling
- AI decision making

Or more casually:
- cycling 🚴
- sailing ⛵
- triathlon 🏊‍♂️ 🚴🏃
- climbing 🧗‍♀️

#introduction
I'm a PhD researcher at the University of Bath looking into AI tactical decision making. I focus on using environmental data and digital twins in reinforcement learning to train models to make tactical decisions in challenging ocean environments.

scholar.google.com/citations?us...