Consolidated Statements of Cash Flows (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Cash Flows from Operating Activities
Net income	$ 13,446	$ 12,149	$ 2,738
Adjustments to reconcile net income to net cash provided by operating activities:
Depreciation and amortization	4,114	4,543	4,798
Net premium amortization of available for sale investment securities	5,027	5,312	3,916
Provision for loan losses	(2,600)	2,772	13,487
Deferred income tax benefit	(473)	(1,043)	(2,227)
Noncash employee stock purchase plan expense	36	36	42
Mortgage loans originated for sale	(52,016)	(84,496)	(41,128)
Proceeds from sale of mortgage loans	50,957	86,563	41,981
Gains on sale of mortgage loans, net	(1,036)	(1,918)	(982)
Loss on disposal and write downs of premises and equipment, net	7	257	3
Net loss on sale and write downs of other real estate	5,702	4,084	5,945
Net loss (gain) on sale of available for sale investment securities	50	(1,209)	(1,355)
Increase in cash surrender value of company-owned life insurance	(926)	(961)	(918)
Death benefits in excess of cash surrender value on company-owned life insurance	0	(529)	0
Decrease in accrued interest receivable	173	545	639
(Increase) decrease in other assets	(241)	1,296	372
Decrease in accrued interest payable	(233)	(1,005)	(1,436)
Increase in other liabilities	2,036	2,014	2,187
Net cash provided by operating activities	24,023	28,410	28,062
Proceeds from maturities and calls of investment securities:
Available for sale	123,231	219,141	191,345
Held to maturity	55	55	55
Proceeds from sale of available for sale investment securities	2,233	135,193	201,093
Purchases of available for sale investment securities	(190,306)	(333,116)	(538,370)
Principal collected on loans originated for investment, net	5,540	29,818	83,463
Proceeds from surrender of company-owned life insurance	0	0	2,248
Proceeds from death benefits of company-owned life insurance	0	1,051	0
Purchases of premises and equipment	(3,525)	(1,675)	(2,679)
Proceeds from sale of other real estate	9,458	12,278	9,834
Proceeds from disposals of equipment	28	429	5
Net cash (used in) provided by investing activities	(53,286)	63,174	(53,006)
Cash Flows from Financing Activities
Net decrease in deposits	(595)	(24,255)	(28,507)
Net increase (decrease) in federal funds purchased and other short-term borrowings	5,040	(2,939)	(20,387)
Proceeds from securities sold under agreements to repurchase and other long-term borrowings	754	0	0
Repayments of securities sold under agreements to repurchase and other long-term borrowings	(2,171)	(61,397)	(12,545)
Dividends paid, preferred	(1,500)	(1,500)	(1,500)
Repurchase of common stock warrant	0	(75)	0
Shares issued under employee stock purchase plan	133	128	136
Net cash provided by (used in) financing activities	1,661	(90,038)	(62,803)
Net (decrease) increase in cash and cash equivalents	(27,602)	1,546	(87,747)
Cash and cash equivalents at beginning of year	95,855	94,309	182,056
Cash and cash equivalents at end of year	68,253	95,855	94,309
Supplemental Disclosures
Interest	12,228	19,263	26,106
Income taxes	6,150	3,800	2,900
Sale and financing of other real estate	5,711	3,358	3,195
From Loans [Member]
Supplemental Disclosures
Transfers to other real estate	6,110	33,913	26,586
From Premises [Member]
Supplemental Disclosures
Transfers to other real estate	$ 0	$ 212	$ 0