INCOME TAXES (Schedule of Net Deferred Tax Asset ) (Details) - USD ($) $ in Thousands	Dec. 31, 2016	Dec. 31, 2015
Deferred tax assets:
Loan loss and REO	$ 36,719	$ 33,312
Deferred compensation	23,189	19,253
Net operating loss carryforward	82,714	91,893
Federal and state tax credits	7,711	7,877
State net operating losses	7,396	8,692
Deferred Tax Asset, Loan Discount	9,696	13,412
Other	6,217	5,620
Total deferred tax assets	173,642	180,059
Deferred tax liabilities:
Depreciation	(2,218)	(1,103)
Deferred loan fees, servicing rights and loan origination costs	13,291	9,884
Intangibles	(11,178)	(13,320)
Financial instruments accounted for under fair value accounting	(16,186)	(17,112)
Unrealized (gain) loss on securities - available-for-sale	(880)	(1,475)
Total deferred tax liabilities	(43,753)	(42,894)
Deferred income tax asset	129,889	137,165
Valuation allowance	2,195	2,195
Deferred tax asset, net	$ 127,694	$ 134,970