Securities - Narrative (Details)	12 Months Ended
	Dec. 31, 2023 USD ($) security	Dec. 31, 2022 USD ($)	Dec. 31, 2021 USD ($)
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Amortized cost	$ 1,372,575,000	$ 1,537,420,000
Fair value	1,248,439,000	1,371,757,000
Realized tax benefit (provision) gain (loss)	$ 23,500	95,300	$ 800
Securities unrealized loss | security	392
Cumulative OTTI		0
OTTI charges in earnings		0
Restricted stock, at cost	$ 5,964,000	16,443,000
Federal Home Loan Bank Certificates and Obligations (FHLB)
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Restricted stock, at cost	5,900,000	16,400,000
Community Bankers' Bank
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Restricted stock, at cost	50,000	50,000
U.S. Treasuries and government agencies
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Amortized cost	197,026,000	198,154,000
Fair value	$ 179,071,000	174,993,000
Securities in unrealized loss positions | security	12
Residential mortgage backed - agency
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Amortized cost	$ 47,074,000	57,883,000
Fair value	$ 42,238,000	53,061,000
Securities in unrealized loss positions | security	16
Commercial Mortgage Backed – Agency Securities
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Securities in unrealized loss positions | security	15
State and Municipal Securities
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Securities in unrealized loss positions | security	201
Residential mortgage backed - non-agency
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Amortized cost	$ 284,826,000	365,983,000
Fair value	$ 266,031,000	339,295,000
Securities in unrealized loss positions | security	90
Commercial mortgage backed - non-agency
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Amortized cost	$ 183,454,000	191,709,000
Fair value	$ 177,061,000	183,299,000
Securities in unrealized loss positions | security	33
Asset-backed
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Amortized cost	$ 79,315,000	101,791,000
Fair value	$ 77,936,000	98,626,000
Securities in unrealized loss positions | security	22
Other
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Amortized cost	$ 9,500,000	9,500,000
Fair value	$ 8,014,000	8,643,000
Securities in unrealized loss positions | security	3
Asset Pledged as Collateral
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Amortized cost	$ 826,500,000	637,100,000
Fair value	$ 742,500,000	$ 552,500,000