Intangible Assets - Net of accumulated amortization (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2020	Dec. 31, 2019
Finite-Lived Intangible Assets [Line Items]
Goodwill, Gross Intangible Assets	$ 104,168	$ 104,168
Goodwill, Net Intangible Assets	104,168	104,168
Gross Intangible Assets	114,061	113,048
Additions	667	1,013
Accumulated Amortization	(9,614)	(9,322)
FHA MSR Sales		0
Finite-lived intangible assets, net	946
Net Intangible Assets	105,114	104,739
Core Deposits
Finite-Lived Intangible Assets [Line Items]
Finite-Lived intangible assets, gross	7,070	7,070
Accumulated Amortization	(7,070)	(7,027)
Finite-lived intangible assets, net	0	43
Excess Servicing
Finite-Lived Intangible Assets [Line Items]
Finite-Lived intangible assets, gross	2,478	1,465
Additions	667	1,013
Accumulated Amortization	(2,199)	(1,971)
FHA MSR Sales		0
Finite-lived intangible assets, net	946	507
Non-compete Agreements
Finite-Lived Intangible Assets [Line Items]
Finite-Lived intangible assets, gross	345	345
Accumulated Amortization	(345)	(324)
Finite-lived intangible assets, net	$ 0	$ 21