Loans and Allowance for Credit Losses - Composition of Loans (Details) - USD ($) $ in Thousands	Dec. 31, 2023	Dec. 31, 2022
Loans:
Net unamortized premiums and unearned loan fees	$ 9,590	$ 9,011
Total loans, net of fees and costs excluding portfolio layer basis adjustments	6,907,899	6,934,769
Unallocated portfolio layer basis adjustments	(949)
Total loans, net of fees and costs	6,906,950	6,934,769
Multi-Family Residential
Loans:
Loans before allowance for credit losses, fee and costs	2,658,205	2,601,384
Commercial Real Estate
Loans:
Loans before allowance for credit losses, fee and costs	1,958,252	1,913,040
One-To-Four Family - Mixed Used Property
Loans:
Loans before allowance for credit losses, fee and costs	530,243	554,314
One-To-Four Family - Residential
Loans:
Loans before allowance for credit losses, fee and costs	220,213	241,246
Construction Portfolio Segment
Loans:
Loans before allowance for credit losses, fee and costs	58,673	70,951
Total loans, net of fees and costs excluding portfolio layer basis adjustments	58,261	70,824
Small Business Administration
Loans:
Loans before allowance for credit losses, fee and costs	20,205	23,275
Commercial Business and Other
Loans:
Loans before allowance for credit losses, fee and costs	$ 1,452,518	$ 1,521,548