Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2013	Mar. 31, 2012	Dec. 31, 2012
Allowance for loan losses:
Beginning Balance	$ 38,597	$ 51,997
Charge-offs	1,523	12,122
Recoveries	4,060	1,651
Provision	(2,500)	6,084
Ending Balance	38,634	47,610
Ending balance: Individually evaluated for impairment	5,038	9,647
Ending balance: Collectively evaluated for impairment	33,596	37,963
Financing receivables:
Ending balance	1,113,302	1,322,348	1,150,050
Ending balance: Individually evaluated for impairment	77,649	123,728
Ending balance: Collectively evaluated for impairment	1,035,653	1,198,620
Substandard
Financing receivables:
Ending balance	102,361		116,244
Commercial
Allowance for loan losses:
Beginning Balance	4,517	5,070
Charge-offs	254	10
Recoveries	19	6
Provision	(509)	262
Ending Balance	3,773	5,328
Ending balance: Individually evaluated for impairment	68	389
Ending balance: Collectively evaluated for impairment	3,705	4,939
Financing receivables:
Ending balance	92,906	105,147	93,001
Ending balance: Individually evaluated for impairment	210	1,157
Ending balance: Collectively evaluated for impairment	92,696	103,990
Commercial | Substandard
Financing receivables:
Ending balance	747		1,063
Real Estate Commercial
Allowance for loan losses:
Beginning Balance	20,100	30,770
Charge-offs	508	8,280
Recoveries	2,724	189
Provision	(3,051)	5,959
Ending Balance	19,265	28,638
Ending balance: Individually evaluated for impairment	2,000	4,568
Ending balance: Collectively evaluated for impairment	17,265	24,070
Financing receivables:
Ending balance	566,349	676,297
Ending balance: Individually evaluated for impairment	42,036	61,580
Ending balance: Collectively evaluated for impairment	524,313	614,717
Real Estate Commercial | Substandard
Allowance for loan losses:
Ending Balance	3,100	5,000
Financing receivables:
Ending balance	21,800	43,300
Real Estate Construction
Allowance for loan losses:
Beginning Balance	3,837	7,937
Charge-offs	4	1,402
Recoveries	770	1,169
Provision	(874)	(740)
Ending Balance	3,729	6,964
Ending balance: Individually evaluated for impairment	1,039	1,908
Ending balance: Collectively evaluated for impairment	2,690	5,056
Financing receivables:
Ending balance	40,698	60,285
Ending balance: Individually evaluated for impairment	9,810	24,072
Ending balance: Collectively evaluated for impairment	30,888	36,213
Real Estate Residential
Allowance for loan losses:
Beginning Balance	4,535	6,335
Charge-offs	585	2,291
Recoveries	404	165
Provision	(383)	584
Ending Balance	3,971	4,793
Ending balance: Individually evaluated for impairment	1,931	2,782
Ending balance: Collectively evaluated for impairment	2,040	2,011
Financing receivables:
Ending balance	394,599	464,596
Ending balance: Individually evaluated for impairment	25,593	36,919
Ending balance: Collectively evaluated for impairment	369,006	427,677
Consumer
Allowance for loan losses:
Beginning Balance	1,178	884
Charge-offs	172	139
Recoveries	143	122
Provision	65	52
Ending Balance	1,214	919
Ending balance: Collectively evaluated for impairment	1,214	919
Financing receivables:
Ending balance	2,908	3,544	3,101
Ending balance: Collectively evaluated for impairment	2,908	3,544
Consumer | Substandard
Financing receivables:
Ending balance	1		26
Unallocated
Allowance for loan losses:
Beginning Balance	4,430	1,001
Provision	2,252	(33)
Ending Balance	6,682	968
Ending balance: Collectively evaluated for impairment	6,682	968
Financing receivables:
Ending balance	15,842	12,479	17,551
Ending balance: Collectively evaluated for impairment	$ 15,842	$ 12,479