david holtz
banner
dholtz.bsky.social
david holtz
@dholtz.bsky.social
professor at columbia.

things i’m likely to skeet about (in no particular order): research, the #NBA, music, and #Survivor
The DRO division at CBS is hiring this year! We welcome applicants from a wide range of fields, including OM, econ, stats, CS, engineering, and IS.

If you're on the market, apply! If you have any questions about the position, please reach out.

apply.interfolio.com/173616
September 25, 2025 at 3:35 PM
Reposted by david holtz
📣 Please repost 📣 We are hiring a staff Research Associate (pre-doc) at Columbia DRO!

This is a great opportunity if you want to work on online platforms, urban economics, experiment design, or impacts of AI.

Deadline to apply is May 15. For more info: business.columbia.edu/faculty/divi...
April 16, 2025 at 6:52 PM
one recent learning from wearing an oura ring is that I burn a decent number of calories when giving an academic talk. just one more incentive to get out there and promote your research, i guess
January 5, 2025 at 5:06 PM
nosferatu feels like a supercut of diablo iv cutscenes (non-derogatory), right down to the fact that ralph ineson (the voice of lorath in diablo iv) has a big role in the movie
December 27, 2024 at 5:05 AM
🤔🤔🤔
December 24, 2024 at 3:37 PM
figured out my halloween costume for 2025: jeff proust
December 22, 2024 at 5:33 PM
In the January/February 2025 Harvard Business Review (and online now): a new article that explains the steps that companies should follow to get better at experimentation

hbr.org/2025/01/want...

From me, Iavor Bojinov, Ramesh Johari, Sven Schmit and Martin Tingley
Want Your Company to Get Better at Experimentation?
For years, online experimentation has fueled the innovations of leading tech companies, enabling them to rapidly test and refine new ideas, optimize product features, personalize user experiences, and...
hbr.org
December 14, 2024 at 5:37 PM
Reposted by david holtz
Good short thread qualifying the elite education graph that’s been making the rounds.
I suspect that (a) on a per-capita basis, Yale/Princeton/MIT probably are close to equal (if not above) Harvard, and (b) a lot of this is very smart or well-connected 28-year-olds from developing countries going to HKS/HLS for graduate school, something that Harvard explicitly is recruiting for.
December 7, 2024 at 4:41 PM
saw the new documentary about omar rodriguez-lopez and cedric bixler-zavala last night.

1st, the doc is so good. 2nd, it includes footage from this 2000 ATDI performance of one armed scissor on letterman, which i had never seen before. it goes so hard!

www.youtube.com/watch?v=G7L-...
At the Drive In - One Armed Scissor (Live at David Letterman)
YouTube video by gusbucker
www.youtube.com
December 6, 2024 at 7:37 PM
the way i pick up every spam phone call now hoping it's the survivor casting department...so embarrassing...
December 6, 2024 at 6:59 PM
the way the norcal earthquake caused a tsunami warning that then got canceled made me realize how cruel it was to shake your world, cause a wave of emotions, and then call things off. if you give me another shot, we can build a relationship with a strong foundation on solid ground. hope you’re well.
December 5, 2024 at 9:26 PM
If this is an RCT the SUTVA violations are gonna be insane

for more on this topic, see: pubsonline.informs.org/doi/10.1287/...
December 4, 2024 at 10:31 AM
Reposted by david holtz
“this actually involves you in the news” is a good one-liner of that Twitter magic that has felt missing for a bit.
A chronological feed gives you a true sense of what matters to the people you follow right now. This actually involves you in the news. This was a key innovation of Twitter that Elon just destroyed.
Having a modern morning — ie both on phones. Me: "Martial law in Korea!" Robin: "I don't see that anywhere" Me: "It's on Bluesky"

This site has arrived
December 4, 2024 at 9:45 AM
“academic community from which the university should select my tenure letter writers” bluesky starter pack
November 27, 2024 at 9:52 PM
1) having the guy who played Russ Hanneman record an announcement video on cameo when I accepted my job at Berkeley

2) tweeting about my stay in a London Airbnb that was basically a bathroom with a bed in it (link below):

nypost.com/2023/07/11/m...
November 15, 2024 at 10:19 PM
OK, one of my favorite things about X/twitter was the survivor community, so I’ve done the public service of putting together a #Survivor starter pack.

Still very much a WIP - please reply with accounts I should add!
November 14, 2024 at 2:12 AM
Seems like a nice interface to interact with LLM APIs in R
(1/2) Package highlight: elmer 🐘🎨

🔹 Call LLMs from common provides like OpenAI, Perplexity, Claud, Azure
🔹Interactive chat console, interactive method call or programmatic chat
🔹Stream results: receiving and processing data bit by bit as it arrives 🏎️
🔹 You can extract structured data easily
November 12, 2024 at 7:09 PM
Reposted by david holtz
Proud to share my first NBER working paper. 17.5 million Redfin users were randomly assigned to see or not see flood risk on home listing; the treated users went on to make offers on less risky homes. First casual evidence that homebuyers are adapting to climate change www.nber.org/papers/w33119
Expecting Climate Change: A Nationwide Field Experiment in the Housing Market
Founded in 1920, the NBER is a private, non-profit, non-partisan organization dedicated to conducting economic research and to disseminating research findings among academics, public policy makers, an...
www.nber.org
November 11, 2024 at 1:56 PM
I had a great time doing this interview recently with Gretchen Huizinga and Sid Suri for the Microsoft Research podcast. We talk about Sid's and my now years-long collaboration/bromance, as well as our recent work on prompt engineering.

Please give it a listen!

www.microsoft.com/en-us/resear...
Collaborators: Prompt engineering with Siddharth Suri and David Holtz - Microsoft Research
In “Collaborators,” Siddharth Suri and David Holtz give a brief history of prompt engineering, discuss the debate behind their recent collaboration, and share what they found from studying how people’...
www.microsoft.com
November 11, 2024 at 6:04 PM
Announcing a new working paper measuring the causal impact of generative AI on business performance in emerging markets!

osf.io/preprints/os...

This is joint work w/ Nick Otis (who led the project), Rowan Clarke, Solene Delecourt, and Rem Koning.

More on our results below down👇 1/
December 21, 2023 at 4:08 PM
Super interesting twitter thread re: GPT’s ability to add very large numbers:
Tweet by @colin_fraser
“I asked GPT 3 and 4 to add random 7 digit numbers 12,000 times each (150 distinct pairs of addends × 8 possible values for Number of Carries × 10 responses each). The prompt was just "{a}+{b}=", ...
twitter.com
July 9, 2023 at 11:00 AM
Very excited by this recent paper by Naoki Egami and coauthors, which looks at how social scientists can conduct unbiased statistical inference when using LLM-generated annotations in their analyses: arxiv.org/pdf/2306.04746…
June 28, 2023 at 6:18 PM