Consolidated Statements Of Cash Flows (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2011	Dec. 31, 2010	Dec. 31, 2009
Operating Activities
Net income	$ 15,534	$ 8,108	$ 7,194
Adjustments to reconcile net income to net cash provided by operating activities:
Provision for loan losses	12,434	23,177	23,232
Provision for depreciation	3,436	3,403	3,832
Net amortization of premium and discounts on loans, securities, deposits and debt obligations	396	1,503	170
Amortization of mortgage servicing rights	2,169	2,642	3,171
Net impairment (recovery) of mortgage servicing rights	404	(353)	(1,314)
Amortization of intangibles	1,442	1,495	1,456
Gain on sale of loans	(5,968)	(7,533)	(9,008)
Loss on sale or disposals of property, plant and equipment	59	12	563
Loss on sale or write-down of REO	947	4,050	1,627
OTTI losses on investment securities	2	331	3,940
(Gain) loss on sale or call of securities	(218)	8	(284)
Change in deferred taxes	2,839	(2,417)	(4,007)
Proceeds from sale of loans held for sale	263,336	384,492	518,747
Stock option expense	144	168	228
Restricted stock unit expense	211
Origination of loans held for sale	(262,825)	(388,064)	(513,593)
Income from bank owned life insurance	(929)	(1,146)	(557)
Change in interest receivable and other assets	2,961	3,664	(8,541)
Change in accrued interest and other liabilities	2,365	(1,340)	(3,384)
Net cash provided by operating activities	38,739	32,200	23,472
Investing Activities
Proceeds from maturities, calls and paydowns of held-to-maturity securities	178	1,081	175
Proceeds from maturities, calls and paydowns of available-for-sale securities	52,097	46,765	25,770
Proceeds from sale of available-for-sale securities	8,719	448	6,383
Proceeds from sale of REO	9,630	10,511	7,076
Proceeds from sale of office properties and equipment	17	1	1,227
Purchases of available-for-sale securities	(120,499)	(76,439)	(52,645)
Purchases of held-to-maturity securities			(1,210)
Purchases of office properties and equipment	(2,041)	(1,562)	(1,763)
Investment in bank owned life insurance		(3,757)	(1,500)
Proceed from insurance death benefit		728
Proceeds from FHLB stock redemption	357	364
Purchase of portfolio mortgage loans	(25,842)
Proceeds from sale of non-mortgage loans	9,212	13,949	8,714
Net decrease (increase) in loans receivable	31,137	53,767	(35,598)
Net cash provided by (used) in investing activities	(40,949)	44,356	(43,371)
Financing Activities
Net increase (decrease) in deposits	21,314	(4,468)	110,577
Repayment of Federal Home Loan Bank long-term advances	(35,044)	(30,042)	(25,040)
Net decrease in Federal Home Loan Bank short-term advances			(9,100)
Proceeds from Federal Home Loan Bank long-term advances			25,000
Increase (decrease) in securities sold under repurchase agreements	4,139	7,849	(1,056)
Cash dividends paid on common stock	(481)		(3,776)
Cash dividends paid on preferred stock	(1,850)	(1,850)	(1,747)
Net cash received from common stock issuance	19,859
Proceeds from exercise of stock options	11	3	5
Proceeds from treasury stock purchases	29
Net cash (used) provided by financing activities	7,977	(28,508)	94,863
Increase (decrease) in cash and cash equivalents	5,767	48,048	74,964
Cash and cash equivalents at beginning of period	169,164	121,116	46,152
Cash and cash equivalents at end of period	174,931	169,164	121,116
Supplemental cash flow information:
Interest paid	17,464	26,212	34,038
Income taxes paid	4,875	5,800	8,800
Transfers from loans to other real estate owned and other assets held for sale	4,614	12,147	14,930
Transfer from loans held for sale to loans	7,596
Transfers from premises and equipment to other real estate owned and other assets held for sale			300
Andres O'Neil & Lowe [Member]
Investing Activities
Net cash paid in acquisition		(1,500)
Payak-Dubbs [Member]
Investing Activities
Net cash paid in acquisition	$ (3,914)