Segment Reporting (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended
	Sep. 30, 2013	Sep. 30, 2012	Sep. 30, 2013	Sep. 30, 2012	Dec. 31, 2012
Interest income	$ 10,182	$ 11,393	$ 31,544	$ 34,941
Interest expense	(1,354)	(2,663)	(5,238)	(7,983)
Provision for credit losses	(22,460)	(6,200)	(27,310)	(18,095)
Noninterest income	4,792	4,001	13,244	13,152
Noninterest expense	(9,968)	(9,709)	(30,218)	(29,870)
Net intersegment (expense) income			0	0
(Loss) income before taxes	(18,808)	(3,178)	(17,978)	(7,855)
Income tax benefit (expense)	7,416	1,357	7,169	3,291
Net (loss) income	(11,392)	(1,821)	(10,809)	(4,564)
Total assets	1,051,384	1,178,633	1,051,384	1,178,633	1,185,807
Community Banking [Member]
Interest income			31,509	34,882
Interest expense			(5,238)	(7,967)
Provision for credit losses			(27,310)	(18,095)
Noninterest income			4,192	5,089
Noninterest expense			(17,449)	(17,969)
Net intersegment (expense) income			(3,982)	(3,903)
(Loss) income before taxes			(18,278)	(7,963)
Income tax benefit (expense)			7,289	3,336
Net (loss) income			(10,989)	(4,627)
Total assets	1,032,956	1,159,766	1,032,956	1,159,766
Insurance Products and Services [Member]
Interest income			35	59
Interest expense			0	0
Provision for credit losses			0	0
Noninterest income			9,046	7,974
Noninterest expense			(7,638)	(7,407)
Net intersegment (expense) income			(530)	(392)
(Loss) income before taxes			913	234
Income tax benefit (expense)			(364)	(98)
Net (loss) income			549	136
Total assets	15,973	16,920	15,973	16,920
Parent Company [Member]
Interest income			0	0
Interest expense			0	(16)
Provision for credit losses			0	0
Noninterest income			6	89
Noninterest expense			(5,131)	(4,494)
Net intersegment (expense) income			4,512	4,295
(Loss) income before taxes			(613)	(126)
Income tax benefit (expense)			244	53
Net (loss) income			(369)	(73)
Total assets	$ 2,455	$ 1,947	$ 2,455	$ 1,947