Loans - Segregated by Class of Loans (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019	Mar. 31, 2019
Loans and Leases Receivable Disclosure [Line Items]
Loans	$ 989,026	$ 968,814	$ 968,814
Legacy Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	840,652	847,100
Purchased Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	148,374	121,714
Construction, land and land development
Loans and Leases Receivable Disclosure [Line Items]
Loans	134,037		96,097
Other commercial real estate
Loans and Leases Receivable Disclosure [Line Items]
Loans	524,484		540,239
Residential real estate
Loans and Leases Receivable Disclosure [Line Items]
Loans	190,969	194,796	194,796
Residential real estate | Legacy Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	169,199	171,341
Residential real estate | Purchased Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	21,770	23,455
Commercial, financial, & agricultural
Loans and Leases Receivable Disclosure [Line Items]
Loans	116,786	114,360	114,360
Commercial, financial, & agricultural | Legacy Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	99,121	91,535
Commercial, financial, & agricultural | Purchased Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	17,665	22,825
Consumer and other
Loans and Leases Receivable Disclosure [Line Items]
Loans	22,750	23,322	$ 23,322
Consumer and other | Legacy Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	19,303	19,245
Consumer and other | Purchased Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	3,447	4,077
Commercial Real Estate Portfolio Segment
Loans and Leases Receivable Disclosure [Line Items]
Loans	658,521	636,336
Commercial Real Estate Portfolio Segment | Legacy Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	553,029	564,979
Commercial Real Estate Portfolio Segment | Purchased Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	105,492	71,357
Commercial Real Estate Portfolio Segment | Construction, land and land development
Loans and Leases Receivable Disclosure [Line Items]
Loans	134,037	96,097
Commercial Real Estate Portfolio Segment | Construction, land and land development | Legacy Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	86,268	83,036
Commercial Real Estate Portfolio Segment | Construction, land and land development | Purchased Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	47,769	13,061
Commercial Real Estate Portfolio Segment | Other commercial real estate
Loans and Leases Receivable Disclosure [Line Items]
Loans	524,484	540,239
Commercial Real Estate Portfolio Segment | Other commercial real estate | Legacy Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	466,761	481,943
Commercial Real Estate Portfolio Segment | Other commercial real estate | Purchased Loans
Loans and Leases Receivable Disclosure [Line Items]
Loans	$ 57,723	$ 58,296