Shortest route aside, wherever you're going from Victoria you'd have to be on a VERY scenic route for it to take you through Oak Bay.

Next time I'm driving from downtown Vancouver to Whistler I'll take the scenic route through UBC.