Loans and Allowance for Loan Losses (Evaluation for Impairment) (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	$ 927	$ 1,737
ALL, collectively evaluated for impairment	20,298	22,204
ALL, PI loans evluated for credit impairment	5,560	5,373
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	26,785	29,314	39,360	93,687
Loans held for investment, individually evaluated for impairment	42,830	77,594
Loans held for investment, collectively evaluated for impairment	1,007,767	871,049
Loans held for investment, PI loans with subsequent credit deterioration	161,307	192,115
Loans held for investment, PI loans with no credit deterioration	344	36,277
Loans held for investment	1,212,248	1,177,035
Commercial and agricultural [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	0	282
ALL, collectively evaluated for impairment	2,549	2,432
ALL, PI loans evluated for credit impairment	382	524
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	2,931	3,238	5,776	11,144
Loans held for investment, individually evaluated for impairment	398	2,334
Loans held for investment, collectively evaluated for impairment	61,125	62,704
Loans held for investment, PI loans with subsequent credit deterioration	10,729	11,533
Loans held for investment, PI loans with no credit deterioration	0	3,133
Loans held for investment	72,252	79,704
Real estate - construction [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	0	82
ALL, collectively evaluated for impairment	4,218	4,705
ALL, PI loans evluated for credit impairment	1,015	200
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	5,233	4,987	11,995	46,792
Loans held for investment, individually evaluated for impairment	4,734	13,533
Loans held for investment, collectively evaluated for impairment	49,457	42,199
Loans held for investment, PI loans with subsequent credit deterioration	9,792	2,285
Loans held for investment, PI loans with no credit deterioration	100	397
Loans held for investment	64,083	58,414
Real estate - mortgage, 1-4 family residential [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	927	607
ALL, collectively evaluated for impairment	7,218	7,383
ALL, PI loans evluated for credit impairment	724	711
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	8,869	8,701	8,885	7,742
Loans held for investment, individually evaluated for impairment	14,119	18,118
Loans held for investment, collectively evaluated for impairment	595,135	496,205
Loans held for investment, PI loans with subsequent credit deterioration	26,628	34,961
Loans held for investment, PI loans with no credit deterioration	225	4,254
Loans held for investment	636,107	553,538
Real estate - mortgage, commercial [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	0	766
ALL, collectively evaluated for impairment	3,944	5,473
ALL, PI loans evluated for credit impairment	3,251	3,388
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	7,195	9,627	11,063	26,851
Loans held for investment, individually evaluated for impairment	23,579	43,609
Loans held for investment, collectively evaluated for impairment	258,167	227,760
Loans held for investment, PI loans with subsequent credit deterioration	113,178	141,974
Loans held for investment, PI loans with no credit deterioration	0	28,493
Loans held for investment	394,924	441,836
Consumer [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
ALL, individually evaluated for impairment	0	0
ALL, collectively evaluated for impairment	2,369	2,211
ALL, PI loans evluated for credit impairment	188	550
ALL, PI loans with no credit deterioration	0	0
Total ALL evaluated for impairment	2,557	2,761	1,641	1,158
Loans held for investment, individually evaluated for impairment	0	0
Loans held for investment, collectively evaluated for impairment	43,883	42,181
Loans held for investment, PI loans with subsequent credit deterioration	980	1,362
Loans held for investment, PI loans with no credit deterioration	19	0
Loans held for investment	$ 44,882	$ 43,543