Loans (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2013	Jun. 30, 2012	Jun. 30, 2013	Jun. 30, 2012	Dec. 31, 2012
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	$ 40,765	$ 56,006	$ 44,275	$ 58,884
Additions (deductions) [Abstract]
Provision for loan losses	(2,107)	1,056	(2,798)	6,187
Recoveries credited to allowance	3,958	1,351	5,409	3,231
Loans charged against the allowance	(5,830)	(6,286)	(10,100)	(16,175)
Reclassification to loans held for sale		(781)		(781)
Balance at end of period	36,786	51,346	36,786	51,346
Allowance for loan losses [Abstract]
Individually evaluated for impairment	17,481		17,481		21,009
Collectively evaluated for impairment	19,305		19,305		23,266
Total ending allowance balance	36,786		36,786		44,275
Loans [Abstract]
Individually evaluated for impairment	137,581		137,581		151,167
Collectively evaluated for impairment	1,253,421		1,253,421		1,272,801
Total loans recorded investment	1,391,002		1,391,002		1,423,968
Accrued interest included in recorded investment	4,920		4,920		4,829
Total Loans	1,386,082		1,386,082		1,419,139
Commercial [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	10,058	16,441	11,402	18,183
Additions (deductions) [Abstract]
Provision for loan losses	(1,404)	1,194	(1,676)	2,690
Recoveries credited to allowance	3,181	390	3,717	1,396
Loans charged against the allowance	(3,599)	(2,379)	(5,207)	(6,623)
Reclassification to loans held for sale		(170)		(170)
Balance at end of period	8,236	15,476	8,236	15,476
Allowance for loan losses [Abstract]
Individually evaluated for impairment	4,446		4,446		6,558
Collectively evaluated for impairment	3,790		3,790		4,844
Total ending allowance balance	8,236		8,236		11,402
Loans [Abstract]
Individually evaluated for impairment	47,559		47,559		55,634
Collectively evaluated for impairment	571,150		571,150		563,316
Total loans recorded investment	618,709		618,709		618,950
Accrued interest included in recorded investment	1,659		1,659		1,692
Total Loans	617,050		617,050		617,258
Mortgage [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	20,163	23,271	21,447	22,885
Additions (deductions) [Abstract]
Provision for loan losses	(349)	570	(488)	4,805
Recoveries credited to allowance	450	572	1,072	1,120
Loans charged against the allowance	(1,605)	(2,950)	(3,372)	(7,347)
Reclassification to loans held for sale		(192)		(192)
Balance at end of period	18,659	21,271	18,659	21,271
Allowance for loan losses [Abstract]
Individually evaluated for impairment	11,637		11,637		12,869
Collectively evaluated for impairment	7,022		7,022		8,578
Total ending allowance balance	18,659		18,659		21,447
Loans [Abstract]
Individually evaluated for impairment	82,838		82,838		88,028
Collectively evaluated for impairment	422,710		422,710		441,703
Total loans recorded investment	505,548		505,548		529,731
Accrued interest included in recorded investment	2,506		2,506		2,391
Total Loans	503,042		503,042		527,340
Installment [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	3,162	5,534	3,378	6,146
Additions (deductions) [Abstract]
Provision for loan losses	141	229	516	518
Recoveries credited to allowance	306	389	592	715
Loans charged against the allowance	(613)	(953)	(1,490)	(2,180)
Reclassification to loans held for sale		(218)		(218)
Balance at end of period	2,996	4,981	2,996	4,981
Allowance for loan losses [Abstract]
Individually evaluated for impairment	1,398		1,398		1,582
Collectively evaluated for impairment	1,598		1,598		1,796
Total ending allowance balance	2,996		2,996		3,378
Loans [Abstract]
Individually evaluated for impairment	7,184		7,184		7,505
Collectively evaluated for impairment	183,612		183,612		183,090
Total loans recorded investment	190,796		190,796		190,595
Accrued interest included in recorded investment	755		755		746
Total Loans	190,041		190,041		189,849
Payment Plan Receivable [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	129	206	144	197
Additions (deductions) [Abstract]
Provision for loan losses	(12)	(7)	(16)	23
Recoveries credited to allowance	21	0	28	0
Loans charged against the allowance	(13)	(4)	(31)	(25)
Reclassification to loans held for sale		0		0
Balance at end of period	125	195	125	195
Allowance for loan losses [Abstract]
Individually evaluated for impairment	0		0		0
Collectively evaluated for impairment	125		125		144
Total ending allowance balance	125		125		144
Loans [Abstract]
Individually evaluated for impairment	0		0		0
Collectively evaluated for impairment	75,949		75,949		84,692
Total loans recorded investment	75,949		75,949		84,692
Accrued interest included in recorded investment	0		0		0
Total Loans	75,949		75,949		84,692
Unallocated [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	7,253	10,554	7,904	11,473
Additions (deductions) [Abstract]
Provision for loan losses	(483)	(930)	(1,134)	(1,849)
Recoveries credited to allowance	0	0	0	0
Loans charged against the allowance	0	0	0	0
Reclassification to loans held for sale		(201)		(201)
Balance at end of period	6,770	9,423	6,770	9,423
Allowance for loan losses [Abstract]
Individually evaluated for impairment	0		0		0
Collectively evaluated for impairment	6,770		6,770		7,904
Total ending allowance balance	$ 6,770		$ 6,770		$ 7,904