Consolidated Statements of Financial Condition (Unaudited) (Parenthetical) (USD $) In Thousands, except Share data, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Statement of Financial Position [Abstract]
Interest-bearing instruments	$ 16,044	$ 9,436
Investments, Fair Value Disclosure	432,096	481,683
Fair value of loans held for sale	614,876	279,385
Allowance for losses on loans held for investment	(21,847)	(23,908)
Single family mortgage servicing rights	$ 115,477	$ 153,128
Preferred stock, par value	$ 0	$ 0
Preferred stock, shares authorized	10,000	10,000
Preferred stock, shares issued	0	0
Preferred stock, shares outstanding	0	0
Common stock, par value	$ 0	$ 0
Common stock, shares authorized	160,000,000	160,000,000
Common stock, shares issued	14,852,971	14,799,991
Common stock, shares outstanding	14,852,971	14,799,991