Ruby Web Scraping: Tips, Libraries, and Proxies Let’s build web scrapers in Ruby using Nokogiri, HTTParty, and Mechanize. Discover practical proxy solutions and strategies to prevent bans and scrape at scale.
Interest | Match | Feed
Interest | Match | Feed
Origin
infatica.io
August 30, 2025 at 5:49 PM
This episode also has a massive argument between @excid3.com & I about whether @johnnunemaker.com should cut a 1.0 release of httparty.
July 25, 2025 at 11:18 PM
This episode also has a massive argument between @excid3.com & I about whether @johnnunemaker.com should cut a 1.0 release of httparty.
When you HTTParty, you must party hard!
June 10, 2025 at 3:39 PM
When you HTTParty, you must party hard!
I'm a committed polyglot, but if I'm honest, I'm a Rubyist at heart.
`gem` can behave like `npx` now!
```sh
gem exec cowsay aww yiss
```
Badass. Especially for things like `bundler`, `rubocop`, `json`, `httparty`, and `jekyll`.
And, of course, the extremely important `cat` replacement, `lolcat`.
`gem` can behave like `npx` now!
```sh
gem exec cowsay aww yiss
```
Badass. Especially for things like `bundler`, `rubocop`, `json`, `httparty`, and `jekyll`.
And, of course, the extremely important `cat` replacement, `lolcat`.
May 19, 2025 at 4:25 PM
I'm a committed polyglot, but if I'm honest, I'm a Rubyist at heart.
`gem` can behave like `npx` now!
```sh
gem exec cowsay aww yiss
```
Badass. Especially for things like `bundler`, `rubocop`, `json`, `httparty`, and `jekyll`.
And, of course, the extremely important `cat` replacement, `lolcat`.
`gem` can behave like `npx` now!
```sh
gem exec cowsay aww yiss
```
Badass. Especially for things like `bundler`, `rubocop`, `json`, `httparty`, and `jekyll`.
And, of course, the extremely important `cat` replacement, `lolcat`.
Just perusing the @gumroad source a bit and it uses flipper and httparty! 😎 Always love seeing my stuff in the wild. 400+ refs to Flipper (and their facade named Feature) and 150+ for HTTParty.
April 20, 2025 at 10:45 PM
Just perusing the @gumroad source a bit and it uses flipper and httparty! 😎 Always love seeing my stuff in the wild. 400+ refs to Flipper (and their facade named Feature) and 150+ for HTTParty.
HTTParty 0.23 is out and it'll help you avoid party fouls (aka common net/http errors)! 🤣
I'll make it the default soon but want to have it opt in for a release or two.
I'll make it the default soon but want to have it opt in for a release or two.
March 27, 2025 at 3:03 PM
HTTParty 0.23 is out and it'll help you avoid party fouls (aka common net/http errors)! 🤣
I'll make it the default soon but want to have it opt in for a release or two.
I'll make it the default soon but want to have it opt in for a release or two.
A more full example might look like this (I am using here the httparty gem)
March 27, 2025 at 8:00 AM
A more full example might look like this (I am using here the httparty gem)
When you HTTParty, you must party hard!
March 18, 2025 at 9:51 PM
When you HTTParty, you must party hard!
Dear ruby devs: what http client are you all using these days? In the past I've used Net::HTTP, httparty and Typhoeus but not sure if there are newwer/better options out there nowadays 👵
January 15, 2025 at 3:51 PM
Dear ruby devs: what http client are you all using these days? In the past I've used Net::HTTP, httparty and Typhoeus but not sure if there are newwer/better options out there nowadays 👵
For people consuming OpenAI on a #rails app, are you using any wrapper gem? Or just composing with HTTParty? Keep wanting to use the former, but then discover the later is just way way more ergonomic.
December 13, 2024 at 2:52 PM
For people consuming OpenAI on a #rails app, are you using any wrapper gem? Or just composing with HTTParty? Keep wanting to use the former, but then discover the later is just way way more ergonomic.
Trying to debug an auth issue with a 3rd party provider. Rewrote a POC in Sinatra/HTTParty to do some quick debugging. Everything works. Retry in other app. Token fetches fail. Not sure why. Same details afaik.
December 9, 2024 at 5:53 PM
Trying to debug an auth issue with a 3rd party provider. Rewrote a POC in Sinatra/HTTParty to do some quick debugging. Everything works. Retry in other app. Token fetches fail. Not sure why. Same details afaik.
no party like an httparty
two men dancing in front of a computer monitor
Alt: two men dancing in front of a computer monitor
media.tenor.com
October 25, 2024 at 4:44 PM
no party like an httparty
My first post here and it's me patting myself on the back. Struggled to write an API call in a new Rails app with HTTParty, and I finally got it to return the data I want!
October 24, 2024 at 2:26 PM
My first post here and it's me patting myself on the back. Struggled to write an API call in a new Rails app with HTTParty, and I finally got it to return the data I want!
厳密に条件を揃えたわけじゃないけどやっぱり Ruby の HTTParty 使って連打すると死んでるような気がする
May 5, 2024 at 4:47 PM
厳密に条件を揃えたわけじゃないけどやっぱり Ruby の HTTParty 使って連打すると死んでるような気がする
spent like 30 minutes debugging why my Apple Maps snapshot images for check-ins suddenly broke yesterday after switching from HTTParty to Faraday… turns out Faraday sorts request parameters by default?? why??? param order usually doesn't matter but sometimes it REALLY does, like signed URLs
March 11, 2024 at 4:42 PM
spent like 30 minutes debugging why my Apple Maps snapshot images for check-ins suddenly broke yesterday after switching from HTTParty to Faraday… turns out Faraday sorts request parameters by default?? why??? param order usually doesn't matter but sometimes it REALLY does, like signed URLs
du gehst auf die party, ich mach http requests mit httparty
(joke httparty lutscht arsch als ruby http client lib)
(joke httparty lutscht arsch als ruby http client lib)
December 20, 2023 at 12:45 AM
du gehst auf die party, ich mach http requests mit httparty
(joke httparty lutscht arsch als ruby http client lib)
(joke httparty lutscht arsch als ruby http client lib)
tbh, one of my reasons for using HTTParty is that if there's an error code, you actually get to see the server response
July 5, 2023 at 11:12 PM
tbh, one of my reasons for using HTTParty is that if there's an error code, you actually get to see the server response
when you httparty you must party hard
July 5, 2023 at 10:56 PM
when you httparty you must party hard
February 26, 2025 at 12:52 PM
#ruby How to Debug HTTParty Requests => http://bit.ly/1tSw7zX /via @natritmeyer
October 13, 2025 at 9:00 AM
#ruby How to Debug HTTParty Requests => http://bit.ly/1tSw7zX /via @natritmeyer