Allowance for Credit Losses - Allocation of Allowance for Loan and Lease Losses (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2023	Mar. 31, 2022
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	$ 195,651	$ 197,752
Charge-offs	(3,664)	(2,299)
Recoveries	380	1,853
Provision for Credit Losses	3,021	211
Ending ACL Balance	195,388	197,517
Investor loans secured by real estate
Allocation of allowance as well as the activity in allowance
Charge-offs	(283)
Investor loans secured by real estate | CRE non-owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	33,692	37,380
Charge-offs	(66)	0
Recoveries	15	0
Provision for Credit Losses	(1,926)	(1,406)
Ending ACL Balance	31,715	35,974
Investor loans secured by real estate | Multifamily
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	56,334	55,209
Charge-offs	(217)	0
Recoveries	0	0
Provision for Credit Losses	1,670	(884)
Ending ACL Balance	57,787	54,325
Investor loans secured by real estate | Construction and land
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	7,114	5,211
Charge-offs	0	0
Recoveries	0	0
Provision for Credit Losses	558	8
Ending ACL Balance	7,672	5,219
Investor loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	2,592	3,201
Charge-offs	0	(70)
Recoveries	0	0
Provision for Credit Losses	(301)	(81)
Ending ACL Balance	2,291	3,050
Business loans secured by real estate
Allocation of allowance as well as the activity in allowance
Charge-offs	(2,163)
Business loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	4,348	4,866
Charge-offs	0	0
Recoveries	0	0
Provision for Credit Losses	67	329
Ending ACL Balance	4,415	5,195
Business loans secured by real estate | CRE owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	32,340	29,575
Charge-offs	(2,163)	0
Recoveries	12	10
Provision for Credit Losses	(855)	2,306
Ending ACL Balance	29,334	31,891
Business loans secured by real estate | Franchise real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	7,019	7,985
Charge-offs	0	0
Recoveries	0	0
Provision for Credit Losses	771	(8)
Ending ACL Balance	7,790	7,977
Commercial loans
Allocation of allowance as well as the activity in allowance
Charge-offs	(1,123)
Commercial loans | Commercial and industrial
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	35,169	38,136
Charge-offs	(1,123)	(2,179)
Recoveries	211	1,841
Provision for Credit Losses	3,402	800
Ending ACL Balance	37,659	38,598
Commercial loans | Franchise non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	16,029	15,084
Charge-offs	0	0
Recoveries	100	0
Provision for Credit Losses	(408)	(780)
Ending ACL Balance	15,721	14,304
Commercial loans | SBA non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	441	565
Charge-offs	0	(50)
Recoveries	6	2
Provision for Credit Losses	(46)	(27)
Ending ACL Balance	401	490
Retail loans
Allocation of allowance as well as the activity in allowance
Charge-offs	(95)
Retail loans | Single family residential
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	352	255
Charge-offs	(90)	0
Recoveries	1	0
Provision for Credit Losses	129	(22)
Ending ACL Balance	392	233
Retail loans | Consumer
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	221	285
Charge-offs	(5)	0
Recoveries	35	0
Provision for Credit Losses	(40)	(24)
Ending ACL Balance	$ 211	$ 261