Allowance for Credit Losses - Allocation of Allowance for Loan and Lease Losses (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2023	Sep. 30, 2022	Sep. 30, 2023	Sep. 30, 2022
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	$ 192,333	$ 196,075	$ 195,651	$ 197,752
Charge-offs	(7,561)	(1,318)	(15,211)	(9,448)
Recoveries	809	246	1,510	2,685
Provision for Credit Losses	2,517	546	6,148	4,560
Ending ACL Balance	188,098	195,549	188,098	195,549
Investor loans secured by real estate
Allocation of allowance as well as the activity in allowance
Charge-offs			(3,055)
Investor loans secured by real estate | CRE non-owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	31,545	37,221	33,692	37,380
Charge-offs	0	(1,128)	(2,657)	(1,128)
Recoveries	51	0	66	0
Provision for Credit Losses	(13)	1,011	482	852
Ending ACL Balance	31,583	37,104	31,583	37,104
Investor loans secured by real estate | Multifamily
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	55,648	56,293	56,334	55,209
Charge-offs	0	0	(290)	0
Recoveries	0	0	1	0
Provision for Credit Losses	(427)	(207)	(824)	877
Ending ACL Balance	55,221	56,086	55,221	56,086
Investor loans secured by real estate | Construction and land
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	7,707	5,436	7,114	5,211
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for Credit Losses	799	1,004	1,392	1,229
Ending ACL Balance	8,506	6,440	8,506	6,440
Investor loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	2,331	2,865	2,592	3,201
Charge-offs	(108)	0	(108)	(70)
Recoveries	0	0	0	0
Provision for Credit Losses	(24)	90	(285)	(176)
Ending ACL Balance	2,199	2,955	2,199	2,955
Business loans secured by real estate
Allocation of allowance as well as the activity in allowance
Charge-offs			(2,370)
Business loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	4,511	5,149	4,348	4,866
Charge-offs	0	0	0	0
Recoveries	128	0	208	0
Provision for Credit Losses	(77)	(364)	6	(81)
Ending ACL Balance	4,562	4,785	4,562	4,785
Business loans secured by real estate | CRE owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	28,515	31,461	32,340	29,575
Charge-offs	0	0	(2,370)	0
Recoveries	12	19	36	33
Provision for Credit Losses	559	346	(920)	2,218
Ending ACL Balance	29,086	31,826	29,086	31,826
Business loans secured by real estate | Franchise real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	6,855	6,530	7,019	7,985
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for Credit Losses	711	180	547	(1,275)
Ending ACL Balance	7,566	6,710	7,566	6,710
Commercial loans
Allocation of allowance as well as the activity in allowance
Charge-offs			(8,801)
Commercial loans | Commercial and industrial
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	39,586	37,048	35,169	38,136
Charge-offs	(7,386)	(190)	(8,734)	(7,750)
Recoveries	565	143	945	2,517
Provision for Credit Losses	(268)	(1,503)	5,117	2,595
Ending ACL Balance	32,497	35,498	32,497	35,498
Commercial loans | Franchise non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	14,642	13,124	16,029	15,084
Charge-offs	0	0	0	(448)
Recoveries	50	0	150	0
Provision for Credit Losses	1,087	70	(400)	(1,442)
Ending ACL Balance	15,779	13,194	15,779	13,194
Commercial loans | SBA non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	399	452	441	565
Charge-offs	(67)	0	(67)	(50)
Recoveries	3	26	68	44
Provision for Credit Losses	137	(38)	30	(119)
Ending ACL Balance	472	440	472	440
Retail loans
Allocation of allowance as well as the activity in allowance
Charge-offs			(985)
Retail loans | Single family residential
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	455	278	352	255
Charge-offs	0	0	(90)	0
Recoveries	0	58	1	91
Provision for Credit Losses	36	(40)	228	(50)
Ending ACL Balance	491	296	491	296
Retail loans | Consumer
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	139	218	221	285
Charge-offs	0	0	(895)	(2)
Recoveries	0	0	35	0
Provision for Credit Losses	(3)	(3)	775	(68)
Ending ACL Balance	$ 136	$ 215	$ 136	$ 215