Segment Reporting (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2014	Mar. 31, 2013	Dec. 31, 2013
Segment Reporting Information [Line Items]
Interest income	$ 9,455	$ 10,607
Interest expense	(1,132)	(2,130)
Provision for credit losses	(975)	(2,150)
Noninterest income	4,788	4,490
Noninterest expense	(10,115)	(10,491)
Net intersegment (expense) income	0	0
Income (loss) before taxes	2,021	326
Income tax (expense) benefit	(763)	(104)
Net income (loss)	1,258	222
Total assets	1,049,514	1,104,611	1,054,124
Community Banking [Member]
Segment Reporting Information [Line Items]
Interest income	9,455	10,588
Interest expense	(1,132)	(2,130)
Provision for credit losses	(975)	(2,150)
Noninterest income	1,522	1,492
Noninterest expense	(5,591)	(6,233)
Net intersegment (expense) income	(1,662)	(1,304)
Income (loss) before taxes	1,617	263
Income tax (expense) benefit	(610)	(84)
Net income (loss)	1,007	179
Total assets	1,031,855	1,085,625
Insurance Products and Services [Member]
Segment Reporting Information [Line Items]
Interest income	0	19
Interest expense	0	0
Provision for credit losses	0	0
Noninterest income	3,266	3,007
Noninterest expense	(2,615)	(2,513)
Net intersegment (expense) income	(181)	(174)
Income (loss) before taxes	470	339
Income tax (expense) benefit	(178)	(108)
Net income (loss)	292	231
Total assets	13,567	16,489
Parent Company [Member]
Segment Reporting Information [Line Items]
Interest income	0	0
Interest expense	0	0
Provision for credit losses	0	0
Noninterest income	0	(9)
Noninterest expense	(1,909)	(1,745)
Net intersegment (expense) income	1,843	1,478
Income (loss) before taxes	(66)	(276)
Income tax (expense) benefit	25	88
Net income (loss)	(41)	(188)
Total assets	$ 4,092	$ 2,497