Gwen Yidou-Weng
@yidouweng.bsky.social
AI PhD student @UCLA
Probabilistic circuits | Controlled generation
Probabilistic circuits | Controlled generation
Wish LM could plan—not just guess the next word?
TRACE lets LM see all endings before each move.
– Global control at inference time
– Tractable lookahead via an HMM LM-proxy
– Linear classifier per constraint
Outperform RL, DPO, FUDGE—at just +20% decoding over base LM.
#ICML2025 @guyvdb.bsky.social
TRACE lets LM see all endings before each move.
– Global control at inference time
– Tractable lookahead via an HMM LM-proxy
– Linear classifier per constraint
Outperform RL, DPO, FUDGE—at just +20% decoding over base LM.
#ICML2025 @guyvdb.bsky.social
July 19, 2025 at 9:54 PM
Wish LM could plan—not just guess the next word?
TRACE lets LM see all endings before each move.
– Global control at inference time
– Tractable lookahead via an HMM LM-proxy
– Linear classifier per constraint
Outperform RL, DPO, FUDGE—at just +20% decoding over base LM.
#ICML2025 @guyvdb.bsky.social
TRACE lets LM see all endings before each move.
– Global control at inference time
– Tractable lookahead via an HMM LM-proxy
– Linear classifier per constraint
Outperform RL, DPO, FUDGE—at just +20% decoding over base LM.
#ICML2025 @guyvdb.bsky.social