Allowance for Credit Losses - Allocation of Allowance for Credit Losses (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2022	Dec. 31, 2021	Dec. 31, 2020
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	$ 197,752	$ 268,018	$ 35,698
Initial ACL Recorded for PCD Loans			21,242
Charge-offs	(13,719)	(8,616)	(19,858)
Recoveries	3,159	5,419	2,988
Provision for credit losses	8,459	(67,069)	172,262
Ending ACL Balance	195,651	197,752	268,018
Investor loans secured by real estate | CRE non-owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	37,380	49,176	1,899
Initial ACL Recorded for PCD Loans			3,025
Charge-offs	(4,760)	(154)	(839)
Recoveries	0	78	44
Provision for credit losses	1,072	(11,720)	36,624
Ending ACL Balance	33,692	37,380	49,176
Investor loans secured by real estate | Multifamily
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	55,209	62,534	729
Initial ACL Recorded for PCD Loans			8,710
Charge-offs	0	0	0
Recoveries	0	0	0
Provision for credit losses	1,125	(7,325)	43,921
Ending ACL Balance	56,334	55,209	62,534
Investor loans secured by real estate | Construction and land
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	5,211	12,435	4,484
Initial ACL Recorded for PCD Loans			2,051
Charge-offs	0	0	(539)
Recoveries	0	0	0
Provision for credit losses	1,903	(7,224)	6,563
Ending ACL Balance	7,114	5,211	12,435
Investor loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	3,201	5,159	1,915
Initial ACL Recorded for PCD Loans			0
Charge-offs	(70)	(424)	(705)
Recoveries	0	3	34
Provision for credit losses	(539)	(1,537)	5,316
Ending ACL Balance	2,592	3,201	5,159
Business loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	4,866	6,567	2,119
Initial ACL Recorded for PCD Loans			235
Charge-offs	0	(98)	(338)
Recoveries	0	130	147
Provision for credit losses	(518)	(1,733)	2,197
Ending ACL Balance	4,348	4,866	6,567
Business loans secured by real estate | CRE owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	29,575	50,517	2,781
Initial ACL Recorded for PCD Loans			3,766
Charge-offs	0	0	(1,739)
Recoveries	56	56	59
Provision for credit losses	2,709	(20,998)	25,484
Ending ACL Balance	32,340	29,575	50,517
Business loans secured by real estate | Franchise real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	7,985	11,451	592
Initial ACL Recorded for PCD Loans			0
Charge-offs	0	0	(932)
Recoveries	0	0	0
Provision for credit losses	(966)	(3,466)	6,592
Ending ACL Balance	7,019	7,985	11,451
Commercial loans | Commercial and industrial
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	38,136	46,964	13,857
Initial ACL Recorded for PCD Loans			2,325
Charge-offs	(8,387)	(5,384)	(6,891)
Recoveries	2,904	4,720	1,818
Provision for credit losses	2,516	(8,164)	35,768
Ending ACL Balance	35,169	38,136	46,964
Commercial loans | Franchise non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	15,084	20,525	5,816
Initial ACL Recorded for PCD Loans			0
Charge-offs	(448)	(2,554)	(6,731)
Recoveries	0	405	866
Provision for credit losses	1,393	(3,292)	11,360
Ending ACL Balance	16,029	15,084	20,525
Commercial loans | SBA non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	565	995	445
Initial ACL Recorded for PCD Loans			924
Charge-offs	(50)	0	(899)
Recoveries	51	21	14
Provision for credit losses	(125)	(451)	293
Ending ACL Balance	441	565	995
Retail loans | Single family residential
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	255	1,204	655
Initial ACL Recorded for PCD Loans			206
Charge-offs	0	0	(106)
Recoveries	148	3	2
Provision for credit losses	(51)	(952)	(94)
Ending ACL Balance	352	255	1,204
Retail loans | Consumer
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	285	491	406
Initial ACL Recorded for PCD Loans			0
Charge-offs	(4)	(2)	(139)
Recoveries	0	3	4
Provision for credit losses	(60)	(207)	(1,762)
Ending ACL Balance	$ 221	$ 285	491
Cumulative effect of the change in accounting principle
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			55,686
Cumulative effect of the change in accounting principle | Investor loans secured by real estate | CRE non-owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			8,423
Cumulative effect of the change in accounting principle | Investor loans secured by real estate | Multifamily
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			9,174
Cumulative effect of the change in accounting principle | Investor loans secured by real estate | Construction and land
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			(124)
Cumulative effect of the change in accounting principle | Investor loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			(1,401)
Cumulative effect of the change in accounting principle | Business loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			2,207
Cumulative effect of the change in accounting principle | Business loans secured by real estate | CRE owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			20,166
Cumulative effect of the change in accounting principle | Business loans secured by real estate | Franchise real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			5,199
Cumulative effect of the change in accounting principle | Commercial loans | Commercial and industrial
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			87
Cumulative effect of the change in accounting principle | Commercial loans | Franchise non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			9,214
Cumulative effect of the change in accounting principle | Commercial loans | SBA non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			218
Cumulative effect of the change in accounting principle | Retail loans | Single family residential
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			541
Cumulative effect of the change in accounting principle | Retail loans | Consumer
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance			$ 1,982