CONSOLIDATED STATEMENTS OF CHANGES IN SHAREHOLDERS' EQUITY - USD ($) $ in Thousands	Total	Common Stock [Member]	Capital Surplus [Member]	Retained Earnings [Member]	Accumulated Other Comprehensive Income (Loss), Net [Member]	Noncontrolling Interest [Member]
Balance at Dec. 31, 2013	$ 115,073	$ 17,403	$ 44,251	$ 50,689	$ 232	$ 2,498
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income	7,486			7,584		(98)
Other comprehensive income (loss), net of tax	3,562				3,562
Cash dividends ($0.34, $0.46 and $0.52 for 2014, 2015 and 2016, respectively)	(2,419)			(2,419)
Sale of majority interest in consolidated subsidiary	(2,400)					(2,400)
Restricted stock vesting (15,425, 16,359 and 53,908 shares for 2014, 2015 and 2016, respectively)		39	(39)
Repurchase of restricted stock (4,732, 4,576 and 15,351 shares for 2014, 2015, and 2016, respectively)	(125)	(12)	(113)
Exercise of stock options (25,501 and 6,650 shares in 2014 and 2016 respectively)	394	64	330
Share-based compensation	463		463
Balance at Dec. 31, 2014	122,034	17,494	44,892	55,854	3,794	0
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income	7,830			7,830		0
Other comprehensive income (loss), net of tax	(2,117)				(2,117)
Cash dividends ($0.34, $0.46 and $0.52 for 2014, 2015 and 2016, respectively)	(3,292)			(3,292)
Restricted stock vesting (15,425, 16,359 and 53,908 shares for 2014, 2015 and 2016, respectively)		41	(41)
Repurchase of restricted stock (4,732, 4,576 and 15,351 shares for 2014, 2015, and 2016, respectively)	(83)	(11)	(72)
Share-based compensation	605		605
Repurchase of common stock (77,500 and 26,800 shares in 2015 and 2016)	(1,423)	(194)	(1,229)
Balance at Dec. 31, 2015	123,554	17,330	44,155	60,392	1,677	0
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income	8,064			8,064		0
Other comprehensive income (loss), net of tax	(3,077)				(3,077)
Cash dividends ($0.34, $0.46 and $0.52 for 2014, 2015 and 2016, respectively)	(3,701)			(3,701)
Restricted stock vesting (15,425, 16,359 and 53,908 shares for 2014, 2015 and 2016, respectively)	0	135	(135)
Repurchase of restricted stock (4,732, 4,576 and 15,351 shares for 2014, 2015, and 2016, respectively)	(353)	(38)	(315)
Exercise of stock options (25,501 and 6,650 shares in 2014 and 2016 respectively)	92	16	76
Exercise of stock warrant (104,101 shares)	1,650	260	1,390
Share-based compensation	939		939
Repurchase of common stock (77,500 and 26,800 shares in 2015 and 2016)	(489)	(67)	(422)
Balance at Dec. 31, 2016	$ 126,679	$ 17,636	$ 45,688	$ 64,755	$ (1,400)	$ 0