Segment Reporting (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2013	Jun. 30, 2012	Jun. 30, 2013	Jun. 30, 2012	Dec. 31, 2012
Interest income	$ 10,755	$ 11,692	$ 21,362	$ 23,548
Interest expense	(1,754)	(2,659)	(3,884)	(5,320)
Provision for credit losses	(2,700)	(3,525)	(4,850)	(11,895)
Noninterest income	3,962	4,577	8,452	9,151
Noninterest expense	(9,759)	(9,663)	(20,250)	(20,161)
Net intersegment (expense) income			0	0
Income (loss) before taxes	504	422	830	(4,677)
Income tax (expense) benefit	(143)	(129)	(247)	1,934
Net income (loss)	361	293	583	(2,743)
Total assets	1,054,277	1,175,333	1,054,277	1,175,333	1,185,807
Community Banking [Member]
Interest income			21,331	23,509
Interest expense			(3,884)	(5,309)
Provision for credit losses			(4,850)	(11,895)
Noninterest income			2,619	3,706
Noninterest expense			(11,672)	(12,157)
Net intersegment (expense) income			(2,588)	(2,687)
Income (loss) before taxes			956	(4,833)
Income tax (expense) benefit			(284)	2,001
Net income (loss)			672	(2,832)
Total assets	1,035,452	1,156,644	1,035,452	1,156,644
Insurance Products and Services [Member]
Interest income			31	39
Interest expense			0	0
Provision for credit losses			0	0
Noninterest income			5,841	5,395
Noninterest expense			(5,031)	(4,967)
Net intersegment (expense) income			(358)	(257)
Income (loss) before taxes			483	210
Income tax (expense) benefit			(144)	(89)
Net income (loss)			339	121
Total assets	15,924	16,903	15,924	16,903
Parent Company [Member]
Interest income			0	0
Interest expense			0	(11)
Provision for credit losses			0	0
Noninterest income			(8)	50
Noninterest expense			(3,547)	(3,037)
Net intersegment (expense) income			2,946	2,944
Income (loss) before taxes			(609)	(54)
Income tax (expense) benefit			181	22
Net income (loss)			(428)	(32)
Total assets	$ 2,901	$ 1,786	$ 2,901	$ 1,786