Consolidated Statements of Cash Flows (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2014	Dec. 31, 2013	Dec. 31, 2012
Operating Activities
Net income	$ 24,292	$ 22,235	$ 18,664
Adjustments to reconcile net income to net cash provided by operating activities:
Provision for loan losses	1,117	1,824	10,924
Provision for depreciation	2,952	3,110	3,416
Net amortization of premium and discounts on loans, securities, deposits and debt obligations	1,020	1,235	1,497
Amortization of mortgage servicing rights	1,401	2,098	3,562
Net (recovery) impairment of mortgage servicing rights	(116)	(1,261)	759
Amortization of intangibles	1,102	1,241	1,413
Gain on sale of loans	(3,517)	(5,817)	(10,669)
Loss on sale or disposals of property, plant and equipment	0	1	179
(Gain) loss on sale or write-down of REO	(73)	883	427
OTTI losses on investment securities	0	337	5
(Gain) loss on sale or call of securities	(932)	(97)	(2,139)
Change in deferred taxes	(179)	1,519	779
Proceeds from sale of loans held for sale	159,305	308,260	520,376
Origination of loans held for sale	(153,753)	(294,941)	(521,464)
Stock option expense	78	44	104
Restricted stock unit expense (credit)	(122)	783	146
Income from bank owned life insurance	(1,802)	(883)	(924)
Change in interest receivable and other assets	(5,962)	1,327	17
Change in accrued interest and other liabilities	5,254	(2,535)	4,838
Net cash provided by operating activities	30,065	39,363	31,910
Investing Activities
Proceeds from maturities, calls and paydowns of held-to-maturity securities	73	121	152
Proceeds from maturities, calls and paydowns of available-for-sale securities	20,400	35,072	60,057
Proceeds from sale of available-for-sale securities	14,913	4,027	72,262
Proceeds from sale of REO	2,108	2,899	3,444
Proceeds from sale of office properties and equipment	84	0	10
Purchases of available-for-sale securities	(70,149)	(49,230)	(91,513)
Purchases of office properties and equipment	(4,935)	(2,045)	(3,223)
Investment in bank owned life insurance	(3,406)	0	(5,000)
Proceeds from FHLB stock redemption	5,548	1,305	0
Proceeds from bank owned life insurance death benefit	910	0	0
Purchase of portfolio mortgage loans	(16,594)	(4,545)	0
Proceeds from sale of non-mortgage loans	20,592	13,369	4,644
Net increase in loans receivable	(73,206)	(70,845)	(65,005)
Net cash provided by (used) in investing activities	(103,662)	(69,872)	(24,172)
Financing Activities
Net increase in deposits	25,810	68,368	71,318
Repayment of Federal Home Loan Bank long-term advances	(976)	(276)	(69,045)
Proceeds from Federal Home Loan Bank long-term advances	0	10,000	0
Cash paid for redemption of preferred stock	0	0	(36,358)
Increase (decrease) in securities sold under repurchase agreements	2,840	217	(8,684)
Cash dividends paid on common stock	(5,937)	(3,907)	(1,950)
Cash dividends paid on preferred stock	0	0	(1,136)
Net cash paid for repurchase of common stock	(15,519)	(1,821)	0
Proceeds from exercise of stock options	921	350	4
Proceeds from treasury stock sales	76	64	14
Net cash (used) provided by financing activities	7,215	72,995	(45,837)
Increase (decrease) in cash and cash equivalents	(66,382)	42,486	(38,099)
Cash and cash equivalents at beginning of period	179,318	136,832	174,931
Cash and cash equivalents at end of period	112,936	179,318	136,832
Supplemental cash flow information:
Interest paid	6,557	7,179	12,251
Income taxes paid	8,950	10,500	4,000
Transfers from loans to other real estate owned and other assets held for sale	2,357	5,836	4,048
Transfer from loans held for sale to loans	1,178	3,231	0
Securities traded but not yet settled	$ 0	$ 742	$ 405