Loans (Past Due Status) (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2012	Dec. 31, 2011
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past due, 30 - 59 days	$ 5,899	$ 10,395
Past due, 60 - 89 days	6,992	11,807
Past due, 90 or more days	63,724	54,711
Past due, total	76,615	76,913
Current	902,975	809,786
PI loans, no credit deterioration	220,404	330,836
PI loans, credit deterioration	31,801	0
Loans and leases receivable	1,231,795	1,217,535
90 or more days past due and accruing	1,071	3,000
Commercial and agricultural [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past due, 30 - 59 days	927	335
Past due, 60 - 89 days	832	425
Past due, 90 or more days	2,511	2,755
Past due, total	4,270	3,515
Current	51,718	62,702
PI loans, no credit deterioration	1,021	28,872
PI loans, credit deterioration	15,660	0
Loans and leases receivable	72,669	95,089
90 or more days past due and accruing	671	305
Real estate - construction [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past due, 30 - 59 days	605	1,850
Past due, 60 - 89 days	1,503	2,206
Past due, 90 or more days	15,842	21,438
Past due, total	17,950	25,494
Current	40,549	59,671
PI loans, no credit deterioration	543	7,641
PI loans, credit deterioration	2,221	0
Loans and leases receivable	61,263	92,806
90 or more days past due and accruing	0	1,400
Real estate - mortgage, 1-4 family residential [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past due, 30 - 59 days	972	4,544
Past due, 60 - 89 days	2,772	2,253
Past due, 90 or more days	13,942	14,125
Past due, total	17,686	20,922
Current	530,027	379,909
PI loans, no credit deterioration	39,943	52,894
PI loans, credit deterioration	2,595	0
Loans and leases receivable	590,251	453,725
90 or more days past due and accruing	58	292
Real estate - mortgage, commercial [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past due, 30 - 59 days	3,221	2,926
Past due, 60 - 89 days	1,872	6,645
Past due, 90 or more days	31,316	16,330
Past due, total	36,409	25,901
Current	237,940	265,861
PI loans, no credit deterioration	177,533	239,621
PI loans, credit deterioration	11,291	0
Loans and leases receivable	463,173	531,383
90 or more days past due and accruing	339	1,003
Consumer [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past due, 30 - 59 days	174	740
Past due, 60 - 89 days	13	278
Past due, 90 or more days	113	63
Past due, total	300	1,081
Current	42,741	41,643
PI loans, no credit deterioration	1,364	1,808
PI loans, credit deterioration	34	0
Loans and leases receivable	44,439	44,532
90 or more days past due and accruing	3	0
Granite Corp [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and leases receivable	287,302	373,488
Granite Corp [Member] | Real estate - construction [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and leases receivable	$ 2,764	$ 7,641