Fair Value Measurements (Details 3)	6 Months Ended
	Jun. 30, 2019 USD ($)
Level 3
Level 3 CMO [Roll Forward]
Equity warrants, Balance, beginning of period	$ 4,793,000
Total included in earnings, Equity Warrants	3,493,000
Total included in other comprehensive income	0
Stock and Warrants Issued During Period, Value, Preferred Stock and Warrants	161,000
Sales, Equity Warrants	(4,453,000)
Net settlements, Equity Warrants	0
Fair Value, Measurements, Recurring
Level 3 CMO [Roll Forward]
Equity warrants, Balance, beginning of period	4,793,000
Equity warrants, Balance, end of period	3,931,000
Fair Value, Measurements, Recurring | Level 3
Level 3 CMO [Roll Forward]
Equity warrants, Balance, beginning of period	4,793,000
Equity warrants, Balance, end of period	3,931,000
Private Label CMOs | Fair Value, Measurements, Recurring | Level 3
Level 3 CMO [Roll Forward]
Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset Value	7,288,000
Total included in earnings	224,000
Total included in other comprehensive income	(64,000)
Stock and Warrants Issued During Period, Value, Preferred Stock and Warrants	0
Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Sales	0
Net settlements	(549,000)
Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset Value	6,899,000
Asset-backed | Fair Value, Measurements, Recurring | Level 3
Level 3 CMO [Roll Forward]
Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset Value	39,945,000
Total included in earnings	(56,000)
Total included in other comprehensive income	559,000
Stock and Warrants Issued During Period, Value, Preferred Stock and Warrants	0
Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Sales	0
Net settlements	(6,951,000)
Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset Value	33,497,000
Private label collateralized mortgage obligations
Level 3 CMO [Roll Forward]
Fair value transfers of assets measured on a recurring basis	0
Asset-backed Securities
Level 3 CMO [Roll Forward]
Fair value transfers of assets measured on a recurring basis	0
Warrant
Level 3 CMO [Roll Forward]
Fair value transfers of assets measured on a recurring basis	$ 63,000