Loans and Allowance for Loan Losses (Evaluation for Impairment) (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	$ 1,737	$ 11,090
ALL, collectively evaluated for impairment	22,204	28,270
ALL, PI loans evluated for credit impairment	5,373	0
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	29,314	39,360	93,687
Loans held for investment, individually evaluated for impairment	77,594	96,241
Loans held for investment, collectively evaluated for impairment	871,049	790,458
Loans held for investment, PI loans with subsequent credit deterioration	192,115	0
Loans held for investment, PI loans with no credit deterioration	36,277	330,836
Loans held for investment	1,177,035	1,217,535
Commercial and agricultural [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	282	1,506
ALL, collectively evaluated for impairment	2,432	4,270
ALL, PI loans evluated for credit impairment	524	0
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	3,238	5,776	11,144
Loans held for investment, individually evaluated for impairment	2,334	3,890
Loans held for investment, collectively evaluated for impairment	62,704	62,327
Loans held for investment, PI loans with subsequent credit deterioration	11,533	0
Loans held for investment, PI loans with no credit deterioration	3,133	28,872
Loans held for investment	79,704	95,089
Real estate - construction [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	82	4,899
ALL, collectively evaluated for impairment	4,705	7,096
ALL, PI loans evluated for credit impairment	200	0
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	4,987	11,995	46,792
Loans held for investment, individually evaluated for impairment	13,533	30,460
Loans held for investment, collectively evaluated for impairment	42,199	54,705
Loans held for investment, PI loans with subsequent credit deterioration	2,285	0
Loans held for investment, PI loans with no credit deterioration	397	7,641
Loans held for investment	58,414	92,806
Real estate - mortgage, 1-4 family residential [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	607	2,140
ALL, collectively evaluated for impairment	7,383	6,745
ALL, PI loans evluated for credit impairment	711	0
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	8,701	8,885	7,742
Loans held for investment, individually evaluated for impairment	18,118	24,886
Loans held for investment, collectively evaluated for impairment	496,205	375,945
Loans held for investment, PI loans with subsequent credit deterioration	34,961	0
Loans held for investment, PI loans with no credit deterioration	4,254	52,894
Loans held for investment	553,538	453,725
Real estate - mortgage, commercial [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	766	2,415
ALL, collectively evaluated for impairment	5,473	8,648
ALL, PI loans evluated for credit impairment	3,388	0
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	9,627	11,063	26,851
Loans held for investment, individually evaluated for impairment	43,609	36,835
Loans held for investment, collectively evaluated for impairment	227,760	254,927
Loans held for investment, PI loans with subsequent credit deterioration	141,974	0
Loans held for investment, PI loans with no credit deterioration	28,493	239,621
Loans held for investment	441,836	531,383
Consumer [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	0	130
ALL, collectively evaluated for impairment	2,211	1,511
ALL, PI loans evluated for credit impairment	550	0
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	2,761	1,641	1,158
Loans held for investment, individually evaluated for impairment	0	170
Loans held for investment, collectively evaluated for impairment	42,181	42,554
Loans held for investment, PI loans with subsequent credit deterioration	1,362	0
Loans held for investment, PI loans with no credit deterioration	0	1,808
Loans held for investment	$ 43,543	$ 44,532