Investment Securities - Held-to-Maturity and Available-for-Sale, Scheduled Maturities (Details) - USD ($) $ in Thousands	Dec. 31, 2016	Dec. 31, 2015
Held-to-maturity Securities [Abstract]
Securities Held-to-Maturity, Amortized Cost	$ 24,881	$ 40,990
Securities Held-to-Maturity, Gross Unrealized Gains	2	135
Securities Held-to-Maturity, Gross Unrealized Losses	(12)	(64)
Securities Held-to-Maturity, Fair Value	24,871	41,061
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost	451,311	330,681
Securities Available-for-Sale, Gross Unrealized Gains	1,777	2,937
Securities Available-for-Sale, Gross Unrealized Losses	(9,451)	(3,848)
Securities Available-for-Sale, Fair Value	443,637	329,770
U.S. Treasuries [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	0	4,978
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	0	0
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	0	(91)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	0	4,887
Securities Available-for-Sale, Amortized Cost	0	4,978
Available-for-sale Debt Securities, Accumulated Gross Unrealized Gain, before Tax	0	0
Securities Available-for-Sale, Gross Unrealized Losses	0	(91)
Securities Available-for-Sale, Fair Value	0	4,887
U.S. Government Corporations and Agencies [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Within 1 year	15,000	10,389
Securities Available-for-Sale, Gross Unrealized Gains, Within 1 year	20	0
Securities Available-for-Sale, Gross Unrealized Losses, Within 1 year	0	(29)
Securities Available-for-Sale, Fair Value, Within 1 year	15,020	10,360
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	17,265	92,148
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	0	26
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	(19)	(378)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	17,246	91,796
Securities Available-for-Sale, Amortized Cost	32,265	102,537
Available-for-sale Debt Securities, Accumulated Gross Unrealized Gain, before Tax	20	26
Securities Available-for-Sale, Gross Unrealized Losses	(19)	(407)
Securities Available-for-Sale, Fair Value	32,266	102,156
State and Political Subdivisions [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Within 1 year	964	0
Securities Available-for-Sale, Gross Unrealized Gains, Within 1 year	0	0
Securities Available-for-Sale, Gross Unrealized Losses, Within 1 year	(1)	0
Securities Available-for-Sale, Fair Value, Within 1 year	963	0
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	18,705	17,362
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	38	80
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	(75)	(29)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	18,668	17,413
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	55,541	47,969
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	829	1,188
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	(426)	(32)
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	55,944	49,125
Securities Available-for-Sale, Amortized Cost, Over 10 years	12,663	34,334
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	226	1,160
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	(114)	0
Securities Available-for-Sale, Fair Value, Over 10 years	12,775	35,494
Securities Available-for-Sale, Amortized Cost	87,873	99,665
Available-for-sale Debt Securities, Accumulated Gross Unrealized Gain, before Tax	1,093	2,428
Securities Available-for-Sale, Gross Unrealized Losses	(616)	(61)
Securities Available-for-Sale, Fair Value	88,350	102,032
Residential Mortgage Backed Securities [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	6,086	9,713
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	0	12
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	(66)	(13)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	6,020	9,712
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	23,479	60
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	0	0
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	(622)	0
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	22,857	60
Securities Available-for-Sale, Amortized Cost, Over 10 years	174,388	3,517
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	99	65
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	(4,794)	0
Securities Available-for-Sale, Fair Value, Over 10 years	169,693	3,582
Securities Available-for-Sale, Amortized Cost	203,953	13,290
Available-for-sale Debt Securities, Accumulated Gross Unrealized Gain, before Tax	99	77
Securities Available-for-Sale, Gross Unrealized Losses	(5,482)	(13)
Securities Available-for-Sale, Fair Value	198,570	13,354
Collateralized Mortgage Obligations [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Over 10 years	4,659	3,215
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	0	0
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	(105)	(82)
Securities Available-for-Sale, Fair Value, Over 10 years	4,554	3,133
Securities Available-for-Sale, Amortized Cost	4,659	3,215
Available-for-sale Debt Securities, Accumulated Gross Unrealized Gain, before Tax	0	0
Securities Available-for-Sale, Gross Unrealized Losses	(105)	(82)
Securities Available-for-Sale, Fair Value	4,554	3,133
Corporate Bonds [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Within 1 year	250	250
Securities Available-for-Sale, Gross Unrealized Gains, Within 1 year	0	0
Securities Available-for-Sale, Gross Unrealized Losses, Within 1 year	0	0
Securities Available-for-Sale, Fair Value, Within 1 year	250	250
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	35,923	19,446
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	34	25
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	(241)	(158)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	35,716	19,313
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	15,193	10,148
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	0	0
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	(516)	(266)
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	14,677	9,882
Securities Available-for-Sale, Amortized Cost, Over 10 years	60,000	60,000
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	27	0
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	(2,472)	(2,770)
Securities Available-for-Sale, Fair Value, Over 10 years	57,555	57,230
Securities Available-for-Sale, Amortized Cost	111,366	89,844
Available-for-sale Debt Securities, Accumulated Gross Unrealized Gain, before Tax	61	25
Securities Available-for-Sale, Gross Unrealized Losses	(3,229)	(3,194)
Securities Available-for-Sale, Fair Value	108,198	86,675
Money Market Mutual Funds [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost	10,784	16,726
Available-for-sale Debt Securities, Accumulated Gross Unrealized Gain, before Tax	0	0
Securities Available-for-Sale, Gross Unrealized Losses	0	0
Securities Available-for-Sale, Fair Value	10,784	16,726
Equity Securities [Member]
Available-for-sale Securities [Abstract]
Equity Securities Available-for-Sale, Amortized Cost	411	426
Equity Securities Available-for-Sale, Gross Unrealized Gains	504	381
Equity Securities Available-for-Sale, Gross Unrealized Loss	0	0
Equity Securities Available-for-Sale, Fair Value	915	807
Residential Mortgage Backed Securities [Member]
Held-to-maturity Securities [Abstract]
Securities Held-to-Maturity, Amortized Cost, Over 10 years	5,071	0
Securities Held-to-Maturity, Gross Unrealized Gains, Over 10 years	0	0
Securities Held-to-Maturity, Gross Unrealized Losses, Over 10 years	(3)	0
Securities Held-to-Maturity, Fair Value, Over 10 years	5,068	0
Securities Held-to-Maturity, Amortized Cost	5,071	0
Securities Held-to-Maturity, Gross Unrealized Gains	0	0
Securities Held-to-Maturity, Gross Unrealized Losses	(3)	0
Securities Held-to-Maturity, Fair Value	5,068	0
Corporate Bonds [Member]
Held-to-maturity Securities [Abstract]
Securities Held-to-Maturity, Amortized Cost, Within 1 year	19,810	21,047
Securities Held-to-Maturity, Gross Unrealized Gains, Within 1 year	2	134
Securities Held-to-Maturity, Gross Unrealized Losses, Within 1 year	(9)	0
Securities Held-to-Maturity, Fair Value, Within 1 year	19,803	21,181
Securities Held-to-Maturity, Amortized Cost, After 1 year to 5 years	0	19,943
Securities Held-to-Maturity, Gross Unrealized Gains, After 1 year to 5 years	0	1
Securities Held-to-Maturity, Gross Unrealized Losses, After 1 year to 5 years	0	(64)
Securities Held-to-Maturity, Fair Value, After 1 year to 5 years	0	19,880
Securities Held-to-Maturity, Amortized Cost	19,810	40,990
Securities Held-to-Maturity, Gross Unrealized Gains	2	135
Securities Held-to-Maturity, Gross Unrealized Losses	(9)	(64)
Securities Held-to-Maturity, Fair Value	$ 19,803	$ 41,061