Investment Securities - Held-to-Maturity and Available-for-Sale, Scheduled Maturities (Details) - USD ($) $ in Thousands	Mar. 31, 2016	Dec. 31, 2015
Held-to-maturity Securities [Abstract]
Securities Held-to-Maturity, Amortized Cost	$ 36,932	$ 40,990
Securities Held-to-Maturity, Gross Unrealized Gains	140	135
Securities Held-to-Maturity, Gross Unrealized Losses	(41)	(64)
Securities Held-to-Maturity, Fair Value	37,031	41,061
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost	291,162	330,681
Securities Available-for-Sale, Gross Unrealized Gain	4,641	2,937
Securities Available-for-Sale, Gross Unrealized Loss	(3,378)	(3,848)
Securities Available-for-Sale, Fair Value	292,425	329,770
U.S. Treasuries [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	0	4,978
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	0	0
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	0	(91)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	0	4,887
Securities Available-for-Sale, Amortized Cost	0	4,978
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	0	0
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	0	(91)
Securities Available-for-Sale, Debt Securities, Fair Value	0	4,887
U.S. Government Corporations and Agencies [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Within 1 year	10,278	10,389
Securities Available-for-Sale, Gross Unrealized Gains, Within 1 year	2	0
Securities Available-for-Sale, Gross Unrealized Losses, Within 1 year	0	(29)
Securities Available-for-Sale, Fair Value, Within 1 year	10,280	10,360
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	57,085	92,148
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	302	26
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	0	(378)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	57,387	91,796
Securities Available-for-Sale, Amortized Cost	67,363	102,537
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	304	26
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	0	(407)
Securities Available-for-Sale, Debt Securities, Fair Value	67,667	102,156
State and Political Subdivisions [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	17,125	17,362
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	134	80
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	(12)	(29)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	17,247	17,413
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	50,335	47,969
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	1,382	1,188
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	(17)	(32)
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	51,700	49,125
Securities Available-for-Sale, Amortized Cost, Over 10 years	32,560	34,334
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	1,301	1,160
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	0	0
Securities Available-for-Sale, Fair Value, Over 10 years	33,861	35,494
Securities Available-for-Sale, Amortized Cost	100,020	99,665
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	2,817	2,428
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	(29)	(61)
Securities Available-for-Sale, Debt Securities, Fair Value	102,808	102,032
Residential Mortgage Backed Securities [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	4,920	9,713
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	6	12
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	0	(13)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	4,926	9,712
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	59	60
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	1	0
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	0	0
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	60	60
Securities Available-for-Sale, Amortized Cost, Over 10 years	3,497	3,517
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	91	65
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	0	0
Securities Available-for-Sale, Fair Value, Over 10 years	3,588	3,582
Securities Available-for-Sale, Amortized Cost	8,476	13,290
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	98	77
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	0	(13)
Securities Available-for-Sale, Debt Securities, Fair Value	8,574	13,354
Collateralized Mortgage Obligations [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Over 10 years	3,080	3,215
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	0	0
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	(24)	(82)
Securities Available-for-Sale, Fair Value, Over 10 years	3,056	3,133
Securities Available-for-Sale, Amortized Cost	3,080	3,215
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	0	0
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	(24)	(82)
Securities Available-for-Sale, Debt Securities, Fair Value	3,056	3,133
Corporate Bonds [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Within 1 year	250	250
Securities Available-for-Sale, Gross Unrealized Gains, Within 1 year	0	0
Securities Available-for-Sale, Gross Unrealized Losses, Within 1 year	0	0
Securities Available-for-Sale, Fair Value, Within 1 year	250	250
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	18,862	19,446
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	142	25
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	(44)	(158)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	18,960	19,313
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	15,122	10,148
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	95	0
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	(63)	(266)
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	15,154	9,882
Securities Available-for-Sale, Amortized Cost, Over 10 years	60,000	60,000
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	857	0
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	(3,218)	(2,770)
Securities Available-for-Sale, Fair Value, Over 10 years	57,639	57,230
Securities Available-for-Sale, Amortized Cost	94,234	89,844
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	1,094	25
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	(3,325)	(3,194)
Securities Available-for-Sale, Debt Securities, Fair Value	92,003	86,675
Money Market Mutual Funds [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost	17,563	16,726
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	0	0
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	0	0
Securities Available-for-Sale, Debt Securities, Fair Value	17,563	16,726
Equity Securities [Member]
Available-for-sale Securities [Abstract]
Equity Securities Available-for-Sale, Amortized Cost	426	426
Equity Securities Available-for-Sale, Gross Unrealized Gains	328	381
Equity Securities Available-for-Sale, Gross Unrealized Loss	0	0
Equity Securities Available-for-Sale, Fair Value	754	807
Corporate Bonds [Member]
Held-to-maturity Securities [Abstract]
Securities Held-to-Maturity, Amortized Cost, Within 1 year	26,924	21,047
Securities Held-to-Maturity, Gross Unrealized Gains, Within 1 year	114	134
Securities Held-to-Maturity, Gross Unrealized Losses, Within 1 year	0	0
Securities Held-to-Maturity, Fair Value, Within 1 year	27,038	21,181
Securities Held-to-Maturity, Amortized Cost, After 1 year to 5 years	10,008	19,943
Securities Held-to-Maturity, Gross Unrealized Gains, After 1 year to 5 years	26	1
Securities Held-to-Maturity, Gross Unrealized Losses, After 1 year to 5 years	(41)	(64)
Securities Held-to-Maturity, Fair Value, After 1 year to 5 years	9,993	19,880
Securities Held-to-Maturity, Amortized Cost	36,932	40,990
Securities Held-to-Maturity, Gross Unrealized Gains	140	135
Securities Held-to-Maturity, Gross Unrealized Losses	(41)	(64)
Securities Held-to-Maturity, Fair Value	$ 37,031	$ 41,061