They won't appear if they are currently busy with another quest, Kaveh's hangout for example. Abandoning his hangout fixed the problem for me (bazaar). As for the stall by the tavern, they'll appear only during certain hours of the day