Wall Street might pay dearly for backing Romney