Fair Value of Financial Instruments - Additional Information (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2023	Dec. 31, 2022
Carrying Value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Other investments	$ 3,193	$ 6,155
Securities
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Fair value option elected aggregate carrying amount, asset	8,000	5,000
Residential Loans
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Fair value option elected aggregate carrying amount, asset	2,100,000	3,700,000
Business purpose residential loans, held-for-sale, at fair value
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Fair value option elected aggregate carrying amount, asset	1,700,000	2,900,000
Acquisitions	0	181,814
HEI
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Acquisitions	136,445	248,218
MSRs and Other Investments
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Acquisitions	$ 500	8,638
MSRs
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Acquisitions		$ 9,000