Fair Value of Financial Instruments - Financial Assets and Liabilities Reported Under the Fair Value Option (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2020	Jun. 30, 2019	Jun. 30, 2020	Jun. 30, 2019	Dec. 31, 2019
Financial Assets at Fair Value Option	$ 14,400		$ 14,400		$ 14,300
Net gain (loss) from fair value adjustments	10,205	$ (1,956)	4,212	$ (4,036)
Collateralized Mortgage Backed Securities [Member]
Financial Assets at Fair Value Option	703		703		772
Net gain (loss) from fair value adjustments	(1)	1	2	2
Other Securities [Member]
Financial Assets at Fair Value Option	13,707		13,707		13,548
Net gain (loss) from fair value adjustments	(182)	184	37	363
Junior Subordinated Debentures [Member]
Financial Assets at Fair Value Option	35,570		35,570		$ 44,384
Net gain (loss) from fair value adjustments	10,334	(544)	7,983	(1,754)
Financial Assets and Liabilities, Excluding Interest Rate Caps / Swaps [Member]
Net gain (loss) from fair value adjustments	$ 10,151	$ (359)	$ 8,022	$ (1,389)