Allowance for Credit Losses - Allocation of Allowance for Loan and Lease Losses (Details) - USD ($) $ in Thousands	3 Months Ended		12 Months Ended
	Mar. 31, 2024	Mar. 31, 2023	Dec. 31, 2023
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	$ 192,471	$ 195,651	$ 195,651
Charge-offs	(6,529)	(3,664)	(19,349)
Recoveries	110	380
Provision for Credit Losses	6,288	3,021
Ending ACL Balance	192,340	195,388	192,471
Investor loans secured by real estate
Allocation of allowance as well as the activity in allowance
Charge-offs	(1,180)		(5,452)
Investor loans secured by real estate | CRE non-owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	31,030	33,692	33,692
Charge-offs	(927)	(66)
Recoveries	0	15
Provision for Credit Losses	678	(1,926)
Ending ACL Balance	30,781	31,715	31,030
Investor loans secured by real estate | Multifamily
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	56,312	56,334	56,334
Charge-offs	0	(217)
Recoveries	5	0
Provision for Credit Losses	2,094	1,670
Ending ACL Balance	58,411	57,787	56,312
Investor loans secured by real estate | Construction and land
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	9,314	7,114	7,114
Charge-offs	0	0
Recoveries	0	0
Provision for Credit Losses	(1,143)	558
Ending ACL Balance	8,171	7,672	9,314
Investor loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	2,182	2,592	2,592
Charge-offs	(253)	0
Recoveries	0	0
Provision for Credit Losses	255	(301)
Ending ACL Balance	2,184	2,291	2,182
Business loans secured by real estate
Allocation of allowance as well as the activity in allowance
Charge-offs	(4,664)		(2,370)
Business loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	4,427	4,348	4,348
Charge-offs	0	0
Recoveries	1	0
Provision for Credit Losses	(140)	67
Ending ACL Balance	4,288	4,415	4,427
Business loans secured by real estate | CRE owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	28,787	32,340	32,340
Charge-offs	(4,452)	(2,163)
Recoveries	63	12
Provision for Credit Losses	4,362	(855)
Ending ACL Balance	28,760	29,334	28,787
Business loans secured by real estate | Franchise real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	7,499	7,019	7,019
Charge-offs	(212)	0
Recoveries	0	0
Provision for Credit Losses	(29)	771
Ending ACL Balance	7,258	7,790	7,499
Commercial loans
Allocation of allowance as well as the activity in allowance
Charge-offs	(685)		(10,541)
Commercial loans | Commercial and industrial
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	36,692	35,169	35,169
Charge-offs	(585)	(1,123)
Recoveries	39	211
Provision for Credit Losses	961	3,402
Ending ACL Balance	37,107	37,659	36,692
Commercial loans | Franchise non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	15,131	16,029	16,029
Charge-offs	(100)	0
Recoveries	0	100
Provision for Credit Losses	(711)	(408)
Ending ACL Balance	14,320	15,721	15,131
Commercial loans | SBA non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	458	441	441
Charge-offs	0	0
Recoveries	2	6
Provision for Credit Losses	35	(46)
Ending ACL Balance	495	401	458
Retail loans
Allocation of allowance as well as the activity in allowance
Charge-offs	0		(986)
Retail loans | Single family residential
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	505	352	352
Charge-offs	0	(90)
Recoveries	0	1
Provision for Credit Losses	(63)	129
Ending ACL Balance	442	392	505
Retail loans | Consumer
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	134	221	221
Charge-offs	0	(5)
Recoveries	0	35
Provision for Credit Losses	(11)	(40)
Ending ACL Balance	$ 123	$ 211	$ 134