Income Taxes - Summary of Net Deferred Tax Assets (Liabilities) (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Deferred Tax Assets, Gross [Abstract]
Allowance for loan losses	$ 8,949	$ 8,592
Premises and equipment	0	1,670
Other real estate owned	8	207
Accrued stock compensation	2,406	2,547
Federal tax loss carryforward	3,601	4,699
State tax loss carryforward	1,110	2,912
Alternative minimum tax credit carryforward	530	0
Lease liabilities	7,381	0
Net unrealized securities losses	0	4,658
Deferred compensation	2,458	2,287
Accrued interest and fee income	3,106	7,674
Other	378	1,627
Gross deferred tax assets	29,927	36,873
Less: Valuation allowance	0	0
Deferred tax assets net of valuation allowance	29,927	36,873
Deferred Tax Liabilities, Gross [Abstract]
Core deposit base intangible	(4,005)	(5,706)
Net unrealized securities gains	(1,210)	0
Premises and equipment	(114)	0
Right of use assets	(6,416)	0
Other	(1,725)	(2,213)
Gross deferred tax liabilities	(13,470)	(7,919)
Net deferred tax assets	$ 16,457	$ 28,954