Mortgage Banking Activities Mortgage Banking Activities, Mortgage Banking Revenue (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2016	Mar. 31, 2015
Mortgage Banking Revenue [Abstract]
Net realized gains on mortgage loans	$ 10,779	$ 17,251
Net change in unrealized gain on mortgage loans held for sale	3,283	3,451
Net change in fair value of mortgage loan commitments	12,036	7,529
Net change in the fair value of forward sales contracts	(7,121)	(2,191)
Total production revenue	18,977	26,040
Servicing revenue	15,453	13,280
Total mortgage banking revenue	$ 34,430	$ 39,320