INCOME TAXES (Schedule of Net Deferred Tax Asset ) (Details) - USD ($) $ in Thousands	Dec. 31, 2021	Dec. 31, 2020
Deferred tax assets:
Loan loss and REO	$ 34,753	$ 43,158
Deferred compensation	21,193	18,309
Net operating loss carryforward	20,159	26,126
Federal and state tax credits	7,631	7,517
State net operating losses	5,179	5,400
Deferred Tax Asset, Loan Discount	1,830	3,365
Deferred Tax Asset, FAS 115	14,136	14,088
Other	5,091	9,177
Total deferred tax assets	109,972	127,140
Deferred tax liabilities:
Depreciation	(7,119)	(7,537)
Deferred loan fees, servicing rights and loan origination costs	(12,696)	(11,646)
Intangibles	(4,977)	(6,278)
deferred tax liabilities, right-of-use asset	(13,071)	(13,144)
deferred tax liability, unrealized gains on available-for-sale securities	91	(21,662)
Financial instruments accounted for under fair value accounting	(878)	(947)
Total deferred tax liabilities	(38,650)	(61,214)
Deferred income tax asset	71,322	65,926
Valuation allowance	(184)	(184)
Deferred tax asset, net	$ 71,138	$ 65,742