INCOME TAXES (Schedule of Net Deferred Tax Asset ) (Details) - USD ($) $ in Thousands	Dec. 31, 2018	Dec. 31, 2017
Deferred tax assets:
Loan loss and REO	$ 24,156	$ 22,294
Deferred compensation	15,991	13,045
Net operating loss carryforward	37,828	43,721
Federal and state tax credits	7,614	7,614
State net operating losses	6,105	6,706
Deferred Tax Asset, Loan Discount	5,756	4,736
Other	983	4,326
Total deferred tax assets	98,433	102,442
Deferred tax liabilities:
Depreciation	(3,771)	(1,343)
Deferred loan fees, servicing rights and loan origination costs	10,196	9,564
Intangibles	(8,428)	(5,690)
Financial instruments accounted for under fair value accounting	(833)	(9,702)
Other	0	(325)
Total deferred tax liabilities	(23,228)	(26,624)
Deferred income tax asset	75,205	75,818
Valuation allowance	184	4,391
Deferred tax asset, net	$ 75,021	$ 71,427