Loans and Allowance for Credit Losses Allowance for Loan Losses by Portfolio Segment (Details) - USD ($)		3 Months Ended		6 Months Ended
		Jun. 30, 2015	Jun. 30, 2014	Jun. 30, 2015	Jun. 30, 2014
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		$ 177,701,000	$ 197,089,000	$ 184,144,000	$ 202,780,000
Loans charged off		(15,372,000)	(11,476,000)	(21,136,000)	(21,744,000)
Recoveries of loans previously charged off		2,967,000	2,412,000	6,158,000	4,269,000
Net loans charged off		(12,405,000)	(9,064,000)	(14,978,000)	(17,475,000)
Provision for loan losses	[1]	2,189,000	3,660,000	(1,681,000)	6,380,000
Ending Balance		167,485,000	191,685,000	167,485,000	191,685,000
Provision for loan losses gross		(11,000)	160,000	(180,000)	380,000
Provision for Loan and Lease Losses		2,200,000	3,500,000	(1,500,000)	6,000,000
Real-estate commercial mortage [Member]
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		52,860,000	53,757,000	53,493,000	55,659,000
Loans charged off		(1,642,000)	(2,141,000)	(2,351,000)	(3,527,000)
Recoveries of loans previously charged off		451,000	430,000	887,000	474,000
Net loans charged off		(1,191,000)	(1,711,000)	(1,464,000)	(3,053,000)
Provision for loan losses	[1]	(989,000)	(2,204,000)	(1,349,000)	(2,764,000)
Ending Balance		50,680,000	49,842,000	50,680,000	49,842,000
Commercial - industrial, financial, and agricultural [Member]
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		57,150,000	50,563,000	51,378,000	50,330,000
Loans charged off		(11,166,000)	(5,512,000)	(13,029,000)	(10,637,000)
Recoveries of loans previously charged off		1,471,000	775,000	2,257,000	1,519,000
Net loans charged off		(9,695,000)	(4,737,000)	(10,772,000)	(9,118,000)
Provision for loan losses	[1]	1,715,000	3,258,000	8,564,000	7,872,000
Ending Balance		49,170,000	49,084,000	49,170,000	49,084,000
Real-estate - home equity [Member]
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		23,481,000	32,460,000	28,271,000	28,222,000
Loans charged off		(870,000)	(1,234,000)	(1,638,000)	(2,885,000)
Recoveries of loans previously charged off		189,000	177,000	440,000	533,000
Net loans charged off		(681,000)	(1,057,000)	(1,198,000)	(2,352,000)
Provision for loan losses	[1]	(294,000)	638,000	(4,567,000)	6,171,000
Ending Balance		22,506,000	32,041,000	22,506,000	32,041,000
Real-estate - residential mortgage [Member]
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		23,235,000	33,329,000	29,072,000	33,082,000
Loans charged off		(783,000)	(1,089,000)	(2,064,000)	(1,935,000)
Recoveries of loans previously charged off		187,000	108,000	346,000	224,000
Net loans charged off		(596,000)	(981,000)	(1,718,000)	(1,711,000)
Provision for loan losses	[1]	148,000	396,000	(4,567,000)	1,373,000
Ending Balance		22,787,000	32,744,000	22,787,000	32,744,000
Real-estate - construction [Member]
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		8,487,000	9,842,000	9,756,000	12,649,000
Loans charged off		(87,000)	(218,000)	(87,000)	(432,000)
Recoveries of loans previously charged off		231,000	158,000	1,378,000	382,000
Net loans charged off		144,000	(60,000)	1,291,000	(50,000)
Provision for loan losses	[1]	(882,000)	1,549,000	(3,298,000)	(1,268,000)
Ending Balance		7,749,000	11,331,000	7,749,000	11,331,000
Consumer [Member]
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		2,527,000	3,324,000	3,015,000	3,260,000
Loans charged off		(357,000)	(449,000)	(1,137,000)	(1,200,000)
Recoveries of loans previously charged off		368,000	402,000	609,000	611,000
Net loans charged off		11,000	(47,000)	(528,000)	(589,000)
Provision for loan losses	[1]	70,000	29,000	121,000	635,000
Ending Balance		2,608,000	3,306,000	2,608,000	3,306,000
Leasing and other and overdrafts [Member]
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		1,653,000	2,011,000	1,799,000	3,370,000
Loans charged off		(467,000)	(833,000)	(830,000)	(1,128,000)
Recoveries of loans previously charged off		70,000	362,000	241,000	526,000
Net loans charged off		(397,000)	(471,000)	(589,000)	(602,000)
Provision for loan losses	[1]	359,000	311,000	405,000	(917,000)
Ending Balance		1,615,000	1,851,000	1,615,000	1,851,000
Unallocated [Member]
Accounts, Notes, Loans and Financing Receivable [Line Items]
Beginning Balance		8,308,000	11,803,000	7,360,000	16,208,000
Loans charged off		0	0	0	0
Recoveries of loans previously charged off		0	0	0	0
Net loans charged off		0	0	0	0
Provision for loan losses	[1]	2,062,000	(317,000)	3,010,000	(4,722,000)
Ending Balance	[2]	$ 10,370,000	$ 11,486,000	$ 10,370,000	$ 11,486,000

[1] The provision for loan losses excluded an $11,000 and $181,000 increase, respectively, in the reserve for unfunded lending commitments for the three and six months ended June 30, 2015 and a $160,000 and $380,000 decrease, respectively, in the reserve for unfunded lending commitments for the three and six months ended June 30, 2014. The total provision for credit losses, comprised of allocations for both funded and unfunded loans, was $2.2 million and negative $1.5 million, respectively, for the three and six months ended June 30, 2015 and $3.5 million and $6.0 million, respectively, for the three and six months ended June 30, 2014.

[2] The unallocated allowance, which was approximately 6% of the total allowance for credit losses as of both June 30, 2015 and June 30, 2014, was, in the opinion of management, reasonable and appropriate given that the estimates used in the allocation process are inherently imprecise.