Investment Securities - Held-to-Maturity and Available-for-Sale, Scheduled Maturities (Details) - USD ($) $ in Thousands	Dec. 31, 2020	Jan. 01, 2020	Dec. 31, 2019
Debt Securities, Held-to-maturity, Fair Value to Amortized Cost [Abstract]
Investment securities held-to-maturity (fair value $156,325 and $194,886 at December 31, 2020 and 2019, respectively)	$ 151,257		$ 192,052
Securities held-to-maturity, gross unrealized gains	5,068		2,944
Securities held-to-maturity, gross unrealized losses	0		(110)
Securities, held-to-maturity, allowance for credit loss	0
Securities held-to-maturity, fair value	156,325		194,886
Debt Securities, Available-for-sale [Abstract]
Securities, available-for-sale, amortized cost	221,254		251,014
Securities, available-for-sale, accumulated gross unrealized gain, before tax	3,783		1,415
Securities, available-for-sale, gross unrealized losses	(5,528)		(5,505)
Securities, available-for-sale, allowance for credit loss	(869)
Securities, available-for-sale, fair value	218,640		246,924
U.S. Government Corporations and Agencies [Member]
Debt Securities, Held-to-maturity, Fair Value to Amortized Cost [Abstract]
Securities held-to-maturity, amortized cost, after 1 year to 5 years	6,998		6,997
Securities held-to-maturity, gross unrealized gains, after 1 year to 5 years	171		66
Securities held-to-maturity, gross unrealized losses, after 1 year to 5 years	0		0
Securities held-to-maturity, allowance for credit loss, after 1 year to 5 years	0
Securities held-to-maturity, fair value, after 1 year to 5 years	7,169		7,063
Investment securities held-to-maturity (fair value $156,325 and $194,886 at December 31, 2020 and 2019, respectively)	6,998		6,997
Securities held-to-maturity, gross unrealized gains	171		66
Securities held-to-maturity, gross unrealized losses	0		0
Securities, held-to-maturity, allowance for credit loss	0
Securities held-to-maturity, fair value	7,169		7,063
Debt Securities, Available-for-sale [Abstract]
Securities, available-for-sale, amortized cost, within 1 year	0		301
Securities, available-for-sale, gross unrealized gains, within 1 year	0		0
Securities, available-for-sale, gross unrealized losses, within 1 year	0		(1)
Securities, available-for-sale, allowance for credit loss, within 1 year	0
Securities, available-for-sale, fair value, within 1 year	0		300
Securities, available-for-sale, amortized cost	0		301
Securities, available-for-sale, accumulated gross unrealized gain, before tax	0		0
Securities, available-for-sale, gross unrealized losses	0		(1)
Securities, available-for-sale, allowance for credit loss	0
Securities, available-for-sale, fair value	0		300
State and Political Subdivisions [Member]
Debt Securities, Available-for-sale [Abstract]
Securities, available-for-sale, amortized cost, after 1 year to 5 years	3,560		4,717
Securities, available-for-sale, gross unrealized gains, after 1 year to 5 years	33		23
Securities, available-for-sale, gross unrealized losses, after 1 year to 5 years	0		0
Securities, available-for-sale, allowance for credit loss, after 1 year to 5 years	0
Securities, available-for-sale, fair value, after 1 year to 5 years	3,593		4,740
Securities, available-for-sale, amortized cost, after 5 years to 10 years	9,881		29,563
Securities, available-for-sale, gross unrealized gains, after 5 years to 10 years	63		292
Securities, available-for-sale, gross unrealized losses, after 5 years to 10 years	0		0
Securities, available-for-sale, allowance for credit loss, after 5 years to 10 years	0
Securities, available-for-sale, fair value, after 5 years to 10 years	9,944		29,855
Securities, available-for-sale, amortized cost	13,441		34,280
Securities, available-for-sale, accumulated gross unrealized gain, before tax	96		315
Securities, available-for-sale, gross unrealized losses	0		0
Securities, available-for-sale, allowance for credit loss	0
Securities, available-for-sale, fair value	13,537		34,595
Residential Mortgage Backed Securities [Member]
Debt Securities, Held-to-maturity, Fair Value to Amortized Cost [Abstract]
Securities held-to-maturity, amortized cost, after 5 years to 10 years	6,325		9,083
Securities held-to-maturity, gross unrealized gains, after 5 years to 10 years	253		129
Securities held-to-maturity, gross unrealized losses, after 5 years to 10 years	0		0
Securities held-to-maturity, allowance for credit loss, after 5 years to 10 years	0
Securities held-to-maturity, fair value, after 5 years to 10 years	6,578		9,212
Securities held-to-maturity, amortized cost, over 10 years	137,934		175,972
Securities held-to-maturity, gross unrealized gains, over 10 years	4,644		2,749
Securities held-to-maturity, gross unrealized losses, over 10 years	0		(110)
Securities, held-to-maturity, allowance for credit loss, over 10 years	0
Securities Held-to-Maturity, Fair Value, Over 10 years	142,578		178,611
Investment securities held-to-maturity (fair value $156,325 and $194,886 at December 31, 2020 and 2019, respectively)	144,259		185,055
Securities held-to-maturity, gross unrealized gains	4,897		2,878
Securities held-to-maturity, gross unrealized losses	0		(110)
Securities, held-to-maturity, allowance for credit loss	0
Securities held-to-maturity, fair value	149,156		187,823
Debt Securities, Available-for-sale [Abstract]
Securities, available-for-sale, amortized cost, within 1 year	0		304
Securities, available-for-sale, gross unrealized gains, within 1 year	0		9
Securities, available-for-sale, gross unrealized losses, within 1 year	0		0
Securities, available-for-sale, allowance for credit loss, within 1 year	0
Securities, available-for-sale, fair value, within 1 year	0		313
Securities, available-for-sale, amortized cost, after 1 year to 5 years	323		611
Securities, available-for-sale, gross unrealized gains, after 1 year to 5 years	10		3
Securities, available-for-sale, gross unrealized losses, after 1 year to 5 years	0		(1)
Securities, available-for-sale, allowance for credit loss, after 1 year to 5 years	0
Securities, available-for-sale, fair value, after 1 year to 5 years	333		613
Securities, available-for-sale, amortized cost, after 5 years to 10 years	1,664		36,893
Securities, available-for-sale, gross unrealized gains, after 5 years to 10 years	58		107
Securities, available-for-sale, gross unrealized losses, after 5 years to 10 years	0		(21)
Securities, available-for-sale, allowance for credit loss, after 5 years to 10 years	0
Securities, available-for-sale, fair value, after 5 years to 10 years	1,722		36,979
Securities, available-for-sale, amortized cost, over 10 years	110,018		80,630
Securities, available-for-sale, gross unrealized gains, over 10 years	2,153		378
Securities, available-for-sale, gross unrealized losses, over 10 years	(63)		(453)
Securities available-for-sale, allowance for credit loss, over 10 years	0
Securities, available-for-sale, fair value, over 10 years	112,108		80,555
Securities, available-for-sale, amortized cost	112,005		118,438
Securities, available-for-sale, accumulated gross unrealized gain, before tax	2,221		497
Securities, available-for-sale, gross unrealized losses	(63)		(475)
Securities, available-for-sale, allowance for credit loss	0
Securities, available-for-sale, fair value	114,163		118,460
Collateralized Mortgage Obligations [Member]
Debt Securities, Available-for-sale [Abstract]
Securities, available-for-sale, amortized cost, after 5 years to 10 years	754		2,377
Securities, available-for-sale, gross unrealized gains, after 5 years to 10 years	21		6
Securities, available-for-sale, gross unrealized losses, after 5 years to 10 years	0		(22)
Securities, available-for-sale, allowance for credit loss, after 5 years to 10 years	0
Securities, available-for-sale, fair value, after 5 years to 10 years	775		2,361
Securities, available-for-sale, amortized cost, over 10 years	4,561		0
Securities, available-for-sale, gross unrealized gains, over 10 years	0		0
Securities, available-for-sale, gross unrealized losses, over 10 years	(15)		0
Securities available-for-sale, allowance for credit loss, over 10 years	0
Securities, available-for-sale, fair value, over 10 years	4,546		0
Securities, available-for-sale, amortized cost	5,315		2,377
Securities, available-for-sale, accumulated gross unrealized gain, before tax	21		6
Securities, available-for-sale, gross unrealized losses	(15)		(22)
Securities, available-for-sale, allowance for credit loss	0
Securities, available-for-sale, fair value	5,321		2,361
Corporate Bonds [Member]
Debt Securities, Available-for-sale [Abstract]
Securities, available-for-sale, amortized cost, within 1 year	499		6,012
Securities, available-for-sale, gross unrealized gains, within 1 year	2		1
Securities, available-for-sale, gross unrealized losses, within 1 year	0		(4)
Securities, available-for-sale, allowance for credit loss, within 1 year	0
Securities, available-for-sale, fair value, within 1 year	501		6,009
Securities, available-for-sale, amortized cost, after 1 year to 5 years	29,498		29,606
Securities, available-for-sale, gross unrealized gains, after 1 year to 5 years	1,440		596
Securities, available-for-sale, gross unrealized losses, after 1 year to 5 years	0		(61)
Securities, available-for-sale, allowance for credit loss, after 1 year to 5 years	(16)
Securities, available-for-sale, fair value, after 1 year to 5 years	30,922		30,141
Securities, available-for-sale, amortized cost, after 5 years to 10 years	60,496		0
Securities, available-for-sale, gross unrealized gains, after 5 years to 10 years	3		0
Securities, available-for-sale, gross unrealized losses, after 5 years to 10 years	(5,450)		0
Securities, available-for-sale, allowance for credit loss, after 5 years to 10 years	(853)
Securities, available-for-sale, fair value, after 5 years to 10 years	54,196		0
Securities, available-for-sale, amortized cost, over 10 years	0		60,000
Securities, available-for-sale, gross unrealized gains, over 10 years	0		0
Securities, available-for-sale, gross unrealized losses, over 10 years	0		(4,942)
Securities available-for-sale, allowance for credit loss, over 10 years	0
Securities, available-for-sale, fair value, over 10 years	0		55,058
Securities, available-for-sale, amortized cost	90,493		95,618
Securities, available-for-sale, accumulated gross unrealized gain, before tax	1,445		597
Securities, available-for-sale, gross unrealized losses	(5,450)		(5,007)
Securities, available-for-sale, allowance for credit loss	(869)	$ 0	0
Securities, available-for-sale, fair value	$ 85,619		$ 91,208