Melanie Brucks
@melaniebrucks.bsky.social
Assistant Professor of Marketing
Columbia Business School
Innovation & Technology
Columbia Business School
Innovation & Technology
5/ Mitigation strategy
Instead of searching for a “perfect” prompt, we propose Prompt Aggregation: By asking the same question multiple ways and combining answers, we can cancel out these biases.
In our “honey vs maple” example, aggregation favors honey in 5 of 8 prompts. Try it out yourself!
Instead of searching for a “perfect” prompt, we propose Prompt Aggregation: By asking the same question multiple ways and combining answers, we can cancel out these biases.
In our “honey vs maple” example, aggregation favors honey in 5 of 8 prompts. Try it out yourself!
April 28, 2025 at 7:00 PM
5/ Mitigation strategy
Instead of searching for a “perfect” prompt, we propose Prompt Aggregation: By asking the same question multiple ways and combining answers, we can cancel out these biases.
In our “honey vs maple” example, aggregation favors honey in 5 of 8 prompts. Try it out yourself!
Instead of searching for a “perfect” prompt, we propose Prompt Aggregation: By asking the same question multiple ways and combining answers, we can cancel out these biases.
In our “honey vs maple” example, aggregation favors honey in 5 of 8 prompts. Try it out yourself!
Seems straightforward... until you flip the order. Same question, different answers. But why?
April 28, 2025 at 7:00 PM
Seems straightforward... until you flip the order. Same question, different answers. But why?
1/ Setup
Imagine you ask a simple question to ChatGPT:
Imagine you ask a simple question to ChatGPT:
April 28, 2025 at 7:00 PM
1/ Setup
Imagine you ask a simple question to ChatGPT:
Imagine you ask a simple question to ChatGPT: