Non-performing Loans and Impaired Loans - Schedule of TDRs by Loan Portfolio (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Dec. 31, 2019
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	$ 3,443	$ 2,006
Performing TDRs	2,039	3,354
Total	5,482	5,360
Commercial
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	2,163	1,081
Performing TDRs	167	1,484
Total	2,330	2,565
Commercial | Owner occupied real estate
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	629	629
Performing TDRs	167	139
Total	796	768
Commercial | Non-owner occupied real estate
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	350	374
Performing TDRs	0	0
Total	350	374
Commercial | Residential spec homes
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Commercial | Development & spec land
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Commercial | Commercial and industrial
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	1,184	78
Performing TDRs	0	1,345
Total	1,184	1,423
Real estate
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	1,054	708
Performing TDRs	1,537	1,561
Total	2,591	2,269
Real estate | Residential mortgage
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	1,054	708
Performing TDRs	1,537	1,561
Total	2,591	2,269
Real estate | Residential construction
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Real estate | Mortgage warehouse
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Consumer
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	226	217
Performing TDRs	335	309
Total	561	526
Consumer | Direct installment
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Consumer | Indirect installment
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Consumer | Home equity
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	226	217
Performing TDRs	335	309
Total	$ 561	$ 526