FAIR VALUE MEASUREMENTS - Schedule of Inputs Used In Valuing Residential Mortgage Loans, Consumer Loans, Mortgage Loans Receivable, Derivatives, and Mortgage Backed Securities (Details) $ in Thousands	Mar. 31, 2023 USD ($)
Residential Mortgage Loans, Held-for-Investment, at Fair Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans, held-for-investment, fair value	$ 426,259
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Minimum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.088
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Minimum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.029
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Minimum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.035
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Minimum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.197
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Maximum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.107
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Maximum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.080
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Maximum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.127
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Maximum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.522
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Weighted Average | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.091
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Weighted Average | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.065
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Weighted Average | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.059
Residential Mortgage Loans, Held-for-Investment, at Fair Value | Weighted Average | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for investment, measurement input	0.367
Consumer Loans Held-for-Investment, At Fair Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans	$ 340,525
Consumer Loans Held-for-Investment, At Fair Value | Minimum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.083
Consumer Loans Held-for-Investment, At Fair Value | Minimum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.074
Consumer Loans Held-for-Investment, At Fair Value | Minimum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.000
Consumer Loans Held-for-Investment, At Fair Value | Minimum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.594
Consumer Loans Held-for-Investment, At Fair Value | Maximum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.093
Consumer Loans Held-for-Investment, At Fair Value | Maximum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.328
Consumer Loans Held-for-Investment, At Fair Value | Maximum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.072
Consumer Loans Held-for-Investment, At Fair Value | Maximum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.594
Consumer Loans Held-for-Investment, At Fair Value | Weighted Average | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.086
Consumer Loans Held-for-Investment, At Fair Value | Weighted Average | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.278
Consumer Loans Held-for-Investment, At Fair Value | Weighted Average | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.042
Consumer Loans Held-for-Investment, At Fair Value | Weighted Average | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Consumer loans, held-for-investment, measurement input	0.594
Interest rate lock commitments
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Derivative, fair value	$ 35,026
Interest rate lock commitments | Minimum | Loan Funding Probability
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Derivative, measurement input	0.000
Interest rate lock commitments | Minimum | Fair Value of Initial Servicing Rights (Bps)
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Derivative, measurement input	0.00005
Interest rate lock commitments | Maximum | Loan Funding Probability
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Derivative, measurement input	1.000
Interest rate lock commitments | Maximum | Fair Value of Initial Servicing Rights (Bps)
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Derivative, measurement input	0.03368
Interest rate lock commitments | Weighted Average | Loan Funding Probability
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Derivative, measurement input	0.803
Interest rate lock commitments | Weighted Average | Fair Value of Initial Servicing Rights (Bps)
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Derivative, measurement input	0.02056
Mortgage-Backed Securities Issued
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, fair value	$ 286,653
Mortgage-Backed Securities Issued | Minimum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.052
Mortgage-Backed Securities Issued | Minimum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.207
Mortgage-Backed Securities Issued | Minimum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.044
Mortgage-Backed Securities Issued | Minimum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.947
Mortgage-Backed Securities Issued | Maximum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.052
Mortgage-Backed Securities Issued | Maximum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.207
Mortgage-Backed Securities Issued | Maximum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.044
Mortgage-Backed Securities Issued | Maximum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.947
Mortgage-Backed Securities Issued | Weighted Average | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.052
Mortgage-Backed Securities Issued | Weighted Average | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.207
Mortgage-Backed Securities Issued | Weighted Average | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.044
Mortgage-Backed Securities Issued | Weighted Average | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Securities, measurement input	0.947
Performing loans | Residential Mortgage Loans Held-for-Sale, At Fair Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held-for-sale, fair value	$ 222,293
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held-for-sale, fair value	$ 54,252
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Minimum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.074
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Minimum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.036
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Minimum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.028
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Minimum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.197
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Maximum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.101
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Maximum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.080
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Maximum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.037
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Maximum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.312
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Weighted Average | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.084
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Weighted Average | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.059
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Weighted Average | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.033
Performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Weighted Average | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.255
Performing loans | Originated loans | Residential Mortgage Loans Held-for-Sale, At Fair Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held-for-sale, fair value	$ 168,041
Non-performing loans | Residential Mortgage Loans Held-for-Sale, At Fair Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held-for-sale, fair value	33,127
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held-for-sale, fair value	$ 19,247
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Minimum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.107
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Minimum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.181
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Minimum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	2.4
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Minimum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	2.011
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Maximum | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.107
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Maximum | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.257
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Maximum | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	4.0
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Maximum | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	2.413
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Weighted Average | Discount Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.107
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Weighted Average | Prepayment Rate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	0.205
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Weighted Average | Delinquency
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	2.9
Non-performing loans | Acquired loans | Residential Mortgage Loans Held-for-Sale, At Fair Value | Weighted Average | Loss Severity
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held for sale, measurement input	2.141
Non-performing loans | Originated loans | Residential Mortgage Loans Held-for-Sale, At Fair Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans held-for-sale, fair value	$ 13,880