I imagine they have a similar flavor to the leaves and stems and wouldn't have much of an effect on the flavor of the tea soup

First fell in love with guabao at 瑞豐夜市. Gotta get back there sometime