I'm not a liberal by any means, but if it comes down to a mid but generally well-intentioned guy or a loser who's spent his entire life working against LGBTQ+ people, women, the working class, etc it's a pretty obvious choice.

Well that's the thing! He doesn't want to decrease the costs of homes. He wants to crash the U.S. economy so his oligarch friends can buy everything for dirt cheap and screw everyone else over. Economically it makes zero sense to tariff your main supply of resources and he knows that.