Segment Reporting (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended
	Sep. 30, 2014	Sep. 30, 2013	Sep. 30, 2014	Sep. 30, 2013	Dec. 31, 2013
Segment Reporting Information [Line Items]
Interest income	$ 9,686	$ 10,182	$ 28,664	$ 31,544
Interest expense	(1,050)	(1,354)	(3,258)	(5,238)
Provision for credit losses	(775)	(22,460)	(2,700)	(27,310)
Noninterest income	3,994	4,792	13,310	13,244
Noninterest expense	(9,819)	(9,968)	(29,851)	(30,218)
Net intersegment (expense) income			0	0
Income (loss) before taxes	2,036	(18,808)	6,165	(17,978)
Income tax (expense) benefit	(774)	7,416	(2,340)	7,169
Net income (loss)	1,262	(11,392)	3,825	(10,809)
Total assets	1,096,285	1,051,384	1,096,285	1,051,384	1,054,124
Community Banking [Member]
Segment Reporting Information [Line Items]
Interest income			28,664	31,509
Interest expense			(3,258)	(5,238)
Provision for credit losses			(2,700)	(27,310)
Noninterest income			4,894	4,192
Noninterest expense			(17,235)	(17,449)
Net intersegment (expense) income			(4,919)	(3,982)
Income (loss) before taxes			5,446	(18,278)
Income tax (expense) benefit			(2,067)	7,289
Net income (loss)			3,379	(10,989)
Total assets	1,070,991	1,032,956	1,070,991	1,032,956
Insurance Products and Services [Member]
Segment Reporting Information [Line Items]
Interest income			0	35
Interest expense			0	0
Provision for credit losses			0	0
Noninterest income			8,416	9,046
Noninterest expense			(6,789)	(7,638)
Net intersegment (expense) income			(534)	(530)
Income (loss) before taxes			1,093	913
Income tax (expense) benefit			(415)	(364)
Net income (loss)			678	549
Total assets	10,292	15,973	10,292	15,973
Parent Company [Member]
Segment Reporting Information [Line Items]
Interest income			0	0
Interest expense			0	0
Provision for credit losses			0	0
Noninterest income			0	6
Noninterest expense			(5,827)	(5,131)
Net intersegment (expense) income			5,453	4,512
Income (loss) before taxes			(374)	(613)
Income tax (expense) benefit			142	244
Net income (loss)			(232)	(369)
Total assets	$ 15,002	$ 2,455	$ 15,002	$ 2,455