Investment Securities - Held-to-Maturity and Available-for-Sale, Scheduled Maturities (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Debt Securities, Held-to-maturity, Fair Value to Amortized Cost [Abstract]
Securities held-to-maturity, amortized cost	$ 192,052	$ 142,634
Securities held-to-maturity, gross unrealized gains	2,944	287
Securities held-to-maturity, gross unrealized losses	(110)	(1,346)
Securities held-to-maturity, fair value	194,886	141,575
Debt Securities, Available-for-sale [Abstract]
Investment securities available-for-sale	246,924	328,507
Debt securities, available-for-sale and held-to-maturity, amortized cost	251,014	342,711
Securities available-for-sale, gross unrealized gain	1,415	394
Securities available-for-sales, gross unrealized loss	(5,505)	(14,598)
U.S. Government Corporations and Agencies [Member]
Debt Securities, Held-to-maturity, Fair Value to Amortized Cost [Abstract]
Securities held-to-maturity, amortized cost, after 1 year to 5 years	6,997	6,996
Securities held-to-maturity, gross unrealized gains, after 1 year to 5 years	66	0
Securities held-to-maturity, gross unrealized losses, after 1 year to 5 years	0	(104)
Securities held-to-maturity, fair value, after 1 year to 5 years	7,063	6,892
Securities held-to-maturity, amortized cost	6,997	6,996
Securities held-to-maturity, gross unrealized gains	66	0
Securities held-to-maturity, gross unrealized losses	0	(104)
Securities held-to-maturity, fair value	7,063	6,892
Debt Securities, Available-for-sale [Abstract]
Securities available-for-sale, amortized cost, within 1 year	301	15,108
Securities available-for-sale, gross unrealized gains, within 1 year	0	0
Securities available-for-sale, gross unrealized losses, within 1 year	(1)	(90)
Securities available-for-sale, fair value, within 1 year	300	15,018
Securities available-for-sale, amortized cost, after 1 year to 5 years	0	303
Securities available-for-sale, gross unrealized gains, after 1 year to 5 years	0	0
Securities available-for-sale, gross unrealized losses, after 1 year to 5 years	0	(6)
Securities available-for-sale, fair value, after 1 year to 5 years	0	297
Securities available for sale, amortized cost	301	15,411
Debt securities, available-for-sale, accumulated gross unrealized gain, before tax	0	0
Securities available-for-sale, gross unrealized losses	(1)	(96)
Investment securities available-for-sale	300	15,315
State and Political Subdivisions [Member]
Debt Securities, Available-for-sale [Abstract]
Securities available-for-sale, amortized cost, within 1 year	0	5,900
Securities available-for-sale, gross unrealized gains, within 1 year	0	4
Securities available-for-sale, gross unrealized losses, within 1 year	0	(6)
Securities available-for-sale, fair value, within 1 year	0	5,898
Securities available-for-sale, amortized cost, after 1 year to 5 years	4,717	15,459
Securities available-for-sale, gross unrealized gains, after 1 year to 5 years	23	36
Securities available-for-sale, gross unrealized losses, after 1 year to 5 years	0	(56)
Securities available-for-sale, fair value, after 1 year to 5 years	4,740	15,439
Securities available-for-sale, amortized cost, after 5 years to 10 years	29,563	43,923
Securities available-for-sale, gross unrealized gains, after 5 years to 10 years	292	318
Securities available-for-sale, gross unrealized losses, after 5 years to 10 years	0	(163)
Securities available-for-sale, fair value, after 5 years to 10 years	29,855	44,078
Securities available for sale, amortized cost	34,280	65,282
Debt securities, available-for-sale, accumulated gross unrealized gain, before tax	315	358
Securities available-for-sale, gross unrealized losses	0	(225)
Investment securities available-for-sale	34,595	65,415
Residential Mortgage Backed Securities [Member]
Debt Securities, Held-to-maturity, Fair Value to Amortized Cost [Abstract]
Securities held-to-maturity, amortized cost, after 5 years to 10 years	9,083	11,573
Securities held-to-maturity, gross unrealized gains, after 5 years to 10 years	129	0
Securities held-to-maturity, gross unrealized losses, after 5 years to 10 years	0	(135)
Securities held-to-maturity, fair value, after 5 years to 10 years	9,212	11,438
Securities held-to-maturity, amortized cost, over 10 years	175,972	124,065
Securities held-to-maturity, gross unrealized gains, over 10 years	2,749	287
Securities held-to-maturity, gross unrealized losses, over 10 years	(110)	(1,107)
Securities Held-to-Maturity, Fair Value, Over 10 years	178,611	123,245
Securities held-to-maturity, amortized cost	185,055	135,638
Securities held-to-maturity, gross unrealized gains	2,878	287
Securities held-to-maturity, gross unrealized losses	(110)	(1,242)
Securities held-to-maturity, fair value	187,823	134,683
Debt Securities, Available-for-sale [Abstract]
Securities available-for-sale, amortized cost, within 1 year	304	0
Securities available-for-sale, gross unrealized gains, within 1 year	9	0
Securities available-for-sale, gross unrealized losses, within 1 year	0	0
Securities available-for-sale, fair value, within 1 year	313	0
Securities available-for-sale, amortized cost, after 1 year to 5 years	611	5,799
Securities available-for-sale, gross unrealized gains, after 1 year to 5 years	3	3
Securities available-for-sale, gross unrealized losses, after 1 year to 5 years	(1)	(70)
Securities available-for-sale, fair value, after 1 year to 5 years	613	5,732
Securities available-for-sale, amortized cost, after 5 years to 10 years	36,893	49,904
Securities available-for-sale, gross unrealized gains, after 5 years to 10 years	107	6
Securities available-for-sale, gross unrealized losses, after 5 years to 10 years	(21)	(1,381)
Securities available-for-sale, fair value, after 5 years to 10 years	36,979	48,529
Securities available-for-sale, amortized cost, over 10 years	80,630	100,873
Securities available-for-sale, gross unrealized gains, over 10 years	378	26
Securities available-for-sale, gross unrealized losses, over 10 years	(453)	(3,398)
Securities available-for-sale, fair value, over 10 years	80,555	97,501
Securities available for sale, amortized cost	118,438	156,576
Debt securities, available-for-sale, accumulated gross unrealized gain, before tax	497	35
Securities available-for-sale, gross unrealized losses	(475)	(4,849)
Investment securities available-for-sale	118,460	151,762
Collateralized Mortgage Obligations [Member]
Debt Securities, Available-for-sale [Abstract]
Securities available-for-sale, amortized cost, after 5 years to 10 years	2,377	1,677
Securities available-for-sale, gross unrealized gains, after 5 years to 10 years	6	0
Securities available-for-sale, gross unrealized losses, after 5 years to 10 years	(22)	(78)
Securities available-for-sale, fair value, after 5 years to 10 years	2,361	1,599
Securities available-for-sale, amortized cost, over 10 years	0	1,305
Securities available-for-sale, gross unrealized gains, over 10 years	0	0
Securities available-for-sale, gross unrealized losses, over 10 years	0	(16)
Securities available-for-sale, fair value, over 10 years	0	1,289
Securities available for sale, amortized cost	2,377	2,982
Debt securities, available-for-sale, accumulated gross unrealized gain, before tax	6	0
Securities available-for-sale, gross unrealized losses	(22)	(94)
Investment securities available-for-sale	2,361	2,888
Corporate Bonds [Member]
Debt Securities, Available-for-sale [Abstract]
Securities available-for-sale, amortized cost, within 1 year	6,012	7,806
Securities available-for-sale, gross unrealized gains, within 1 year	1	0
Securities available-for-sale, gross unrealized losses, within 1 year	(4)	(68)
Securities available-for-sale, fair value, within 1 year	6,009	7,738
Securities available-for-sale, amortized cost, after 1 year to 5 years	29,606	18,508
Securities available-for-sale, gross unrealized gains, after 1 year to 5 years	596	1
Securities available-for-sale, gross unrealized losses, after 1 year to 5 years	(61)	(332)
Securities available-for-sale, fair value, after 1 year to 5 years	30,141	18,177
Securities available-for-sale, amortized cost, after 5 years to 10 years	0	16,146
Securities available-for-sale, gross unrealized gains, after 5 years to 10 years	0	0
Securities available-for-sale, gross unrealized losses, after 5 years to 10 years	0	(392)
Securities available-for-sale, fair value, after 5 years to 10 years	0	15,754
Securities available-for-sale, amortized cost, over 10 years	60,000	60,000
Securities available-for-sale, gross unrealized gains, over 10 years	0	0
Securities available-for-sale, gross unrealized losses, over 10 years	(4,942)	(8,542)
Securities available-for-sale, fair value, over 10 years	55,058	51,458
Securities available for sale, amortized cost	95,618	102,460
Debt securities, available-for-sale, accumulated gross unrealized gain, before tax	597	1
Securities available-for-sale, gross unrealized losses	(5,007)	(9,334)
Investment securities available-for-sale	$ 91,208	$ 93,127