Fair Value - Carrying Amount and Fair Values (Details) - USD ($) $ in Thousands	Jun. 30, 2021	Dec. 31, 2020
Carrying amount | Quoted Prices in Active Markets for Identical Assets (Level 1)
Financial assets:
Cash and cash equivalents	$ 221,852	$ 219,311
Carrying amount | Significant Other Observable Inputs (Level 2)
Financial assets:
Securities	37,054	47,571
SBA loans held for sale	11,314	9,335
Loans, net of allowance for loan losses	1,619,873	1,595,377
Federal Home Loan Bank stock	9,060	10,594
Accrued interest receivable	9,486	10,429
Financial liabilities:
Deposits	1,594,316	1,557,959
Borrowed funds and subordinated debentures	175,310	210
Accrued interest payable	231	248
Carrying amount | Significant Unobservable Inputs (Level 3)
Financial assets:
Servicing assets	1,476	1,857
Carrying amount | Significant Unobservable Inputs (Level 3) | Recurring | Corporate and other securities
Financial assets:
Securities	4,700
Estimated fair value | Quoted Prices in Active Markets for Identical Assets (Level 1)
Financial assets:
Cash and cash equivalents	221,852	219,311
Estimated fair value | Significant Other Observable Inputs (Level 2)
Financial assets:
Securities	35,054	47,571
SBA loans held for sale	13,396	10,712
Loans, net of allowance for loan losses	1,634,039	1,613,593
Federal Home Loan Bank stock	9,060	10,594
Accrued interest receivable	9,486	10,429
Financial liabilities:
Deposits	1,593,544	1,561,502
Borrowed funds and subordinated debentures	176,552	212,358
Accrued interest payable	231	248
Estimated fair value | Significant Unobservable Inputs (Level 3)
Financial assets:
Servicing assets	1,476	$ 1,857
Estimated fair value | Significant Unobservable Inputs (Level 3) | Recurring | Corporate and other securities
Financial assets:
Securities	$ 4,400