Fair Value of Financial Instruments - Financial Assets and Liabilities Reported Under the Fair Value Option (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2018
Financial Assets at Fair Value Option	$ 14,500	$ 14,300
Net loss from fair value adjustments	(2,142)	(5,353)	$ (4,122)
Collateralized Mortgage Backed Securities [Member]
Financial Assets at Fair Value Option	505	772
Net loss from fair value adjustments	3	3	(19)
Other Securities [Member]
Financial Assets at Fair Value Option	13,998	13,548
Net loss from fair value adjustments	230	427	(109)
Junior Subordinated Debentures [Member]
Financial Assets at Fair Value Option	43,136	44,384
Net loss from fair value adjustments	(50)	(2,802)	(4,913)
Financial Assets and Liabilities, Excluding Interest Rate Caps / Swaps [Member]
Net loss from fair value adjustments	$ 183	$ (2,372)	$ (5,041)