Loans and Allowance for Credit Losses - Activity in the Allowance for Credit Losses (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2023	Dec. 31, 2022	Dec. 31, 2021
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Beginning balance	$ 40,442	$ 37,135	$ 45,153
Charge-offs	(11,157)	(3,348)	(5,134)
Recoveries	345	1,813	2,015
Provision (benefit)	10,531	4,842	(4,899)
Ending balance	40,161	40,442	37,135
Multi-family Residential Portfolio Segment [Member]
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Beginning balance	9,552	8,185	6,557
Charge-offs		(208)	(43)
Recoveries	2	77	10
Provision (benefit)	819	1,498	1,661
Ending balance	10,373	9,552	8,185
Commercial Real Estate [Member]
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Beginning balance	8,184	7,158	8,327
Charge-offs	(8)		(64)
Provision (benefit)	489	1,026	(1,105)
Ending balance	8,665	8,184	7,158
One-To-Four Family - Mixed-Use Property Portfolio Segment [Member]
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Beginning balance	1,875	1,755	1,986
Charge-offs			(33)
Recoveries	1		133
Provision (benefit)	(266)	120	(331)
Ending balance	1,610	1,875	1,755
One-To-Four Family - Residential Portfolio Segment [Member]
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Beginning balance	901	784	869
Charge-offs	(23)	(20)
Recoveries	52	5	157
Provision (benefit)	(262)	132	(242)
Ending balance	668	901	784
Construction Portfolio Segment
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Beginning balance	261	186	497
Provision (benefit)	(103)	75	(311)
Ending balance	158	261	186
Small Business Administration Portfolio Segment [Member]
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Beginning balance	2,198	1,209	2,251
Charge-offs	(7)	(1,053)
Recoveries	248	47	34
Provision (benefit)	(813)	1,995	(1,076)
Ending balance	1,626	2,198	1,209
Taxi Medallion Portfolio Segment [Member]
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Charge-offs			(2,758)
Recoveries		447	1,457
Provision (benefit)		(447)	1,301
Commercial Business and Other Portfolio Segment [Member]
Financing Receivable, Excluding Accrued Interest, Allowance for Credit Loss [Roll Forward]
Beginning balance	17,471	17,858	24,666
Charge-offs	(11,119)	(2,067)	(2,236)
Recoveries	42	1,237	224
Provision (benefit)	10,667	443	(4,796)
Ending balance	$ 17,061	$ 17,471	$ 17,858