INCOME TAXES (Schedule of Net Deferred Tax Asset ) (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Deferred tax assets:
Loan loss and REO	$ 24,285	$ 24,156
Deferred compensation	17,470	15,991
Net operating loss carryforward	32,093	37,828
Federal and state tax credits	7,517	7,614
State net operating losses	5,632	6,105
Deferred Tax Asset, Loan Discount	5,466	5,756
Deferred Tax Asset, FAS 115	15,485	0
Unrealized loss on securities - available for sale	349	983
Total deferred tax assets	108,297	98,433
Deferred tax liabilities:
Depreciation	(5,373)	(3,771)
Deferred loan fees, servicing rights and loan origination costs	(11,525)	(10,197)
Intangibles	(7,756)	(8,428)
deferred tax liabilities, right-of-use asset	(14,531)	0
Financial instruments accounted for under fair value accounting	(1,143)	(833)
Other	(8,146)	0
Total deferred tax liabilities	(48,474)	(23,229)
Deferred income tax asset	59,823	75,204
Valuation allowance	184	184
Deferred tax asset, net	$ 59,639	$ 75,020