Derivative Financial Instruments - Aggregate Fair Value and Notional Amount of Derivative Financial Instruments (Details) - USD ($) $ in Thousands	Jun. 30, 2023	Dec. 31, 2022
Derivative [Line Items]
Fair Value	$ 18,120	$ 3,975
Notional Amount	1,674,369	1,772,298
TBAs
Derivative [Line Items]
Notional Amount	940,000	1,070,000
Interest rate futures
Derivative [Line Items]
Notional Amount	193,000	411,000
Derivative Liabilities
Derivative [Line Items]
Fair Value	(2,316)	(16,855)
Notional Amount	498,809	908,532
Derivative Liabilities | TBAs
Derivative [Line Items]
Fair Value	(920)	(16,784)
Notional Amount	275,000	845,000
Derivative Liabilities | Interest rate futures
Derivative [Line Items]
Fair Value	0	(57)
Notional Amount	0	60,000
Derivative Liabilities | Residential loan purchase commitments, net
Derivative [Line Items]
Fair Value	(1,396)	(14)
Notional Amount	223,809	3,532
Derivative Assets
Derivative [Line Items]
Fair Value	20,436	20,830
Notional Amount	1,175,560	863,766
Derivative Assets | Interest rate swaps
Derivative [Line Items]
Fair Value	10,125	14,625
Notional Amount	190,000	285,000
Derivative Assets | TBAs
Derivative [Line Items]
Fair Value	3,536	1,893
Notional Amount	665,000	220,000
Derivative Assets | Interest rate futures
Derivative [Line Items]
Fair Value	3,333	3,976
Notional Amount	193,000	350,600
Derivative Assets | Residential loan purchase commitments, net
Derivative [Line Items]
Fair Value	3,442	336
Notional Amount	$ 127,560	$ 8,166