Segment Information (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2021	Jun. 30, 2020	Jun. 30, 2021	Jun. 30, 2020	Dec. 31, 2020
Segment Information
Interest income	$ 72,438	$ 68,204	$ 151,987	$ 128,621
Interest expense	8,031	16,970	15,617	39,034
Net Interest Income	64,407	51,234	136,370	89,587
Provision (credit) for loan losses	(315)	1,745	1,348	4,743
Net Interest Income After Provision for Loan Losses	64,722	49,489	135,022	84,844
Noninterest income	32,855	26,188	76,791	46,090
Noninterest expense	28,183	20,282	58,267	42,575
Income Before Income Taxes	69,394	55,395	153,546	88,359
Income taxes	17,977	14,233	40,146	22,614
Net Income	51,417	41,162	113,400	65,745
Total assets	9,881,532	9,439,400	9,881,532	9,439,400	$ 9,645,375
Other
Segment Information
Interest income	1,316	217	2,531	885
Interest expense	(784)	(1,193)	(1,361)	(3,021)
Net Interest Income	2,100	1,410	3,892	3,906
Net Interest Income After Provision for Loan Losses	2,100	1,410	3,892	3,906
Noninterest income	(1,409)	(942)	(2,502)	(1,863)
Noninterest expense	4,358	3,196	7,977	6,434
Income Before Income Taxes	(3,667)	(2,728)	(6,587)	(4,391)
Income taxes	(924)	(715)	(1,658)	(1,175)
Net Income	(2,743)	(2,013)	(4,929)	(3,216)
Total assets	49,521	42,521	49,521	42,521
Multifamily | Operating Segments
Segment Information
Interest income	204	260	411	680
Net Interest Income	204	260	411	680
Net Interest Income After Provision for Loan Losses	204	260	411	680
Noninterest income	28,572	12,325	61,806	29,689
Noninterest expense	13,626	7,468	30,070	17,816
Income Before Income Taxes	15,150	5,117	32,147	12,553
Income taxes	4,179	1,466	9,215	3,503
Net Income	10,971	3,651	22,932	9,050
Total assets	238,165	182,072	238,165	182,072
Mortgage Warehousing | Operating Segments
Segment Information
Interest income	29,935	42,044	68,522	72,143
Interest expense	1,599	7,786	3,323	19,871
Net Interest Income	28,336	34,258	65,199	52,272
Provision (credit) for loan losses	(40)	(800)	(1,124)	380
Net Interest Income After Provision for Loan Losses	28,376	35,058	66,323	51,892
Noninterest income	3,079	5,626	7,196	8,402
Noninterest expense	2,703	3,521	5,599	6,540
Income Before Income Taxes	28,752	37,163	67,920	53,754
Income taxes	7,304	9,451	17,289	13,605
Net Income	21,448	27,712	50,631	40,149
Total assets	4,265,162	5,575,169	4,265,162	5,575,169
Banking | Operating Segments
Segment Information
Interest income	40,983	25,683	80,523	54,913
Interest expense	7,216	10,377	13,655	22,184
Net Interest Income	33,767	15,306	66,868	32,729
Provision (credit) for loan losses	(275)	2,545	2,472	4,363
Net Interest Income After Provision for Loan Losses	34,042	12,761	64,396	28,366
Noninterest income	2,613	9,179	10,291	9,862
Noninterest expense	7,496	6,097	14,621	11,785
Income Before Income Taxes	29,159	15,843	60,066	26,443
Income taxes	7,418	4,031	15,300	6,681
Net Income	21,741	11,812	44,766	19,762
Total assets	$ 5,328,684	$ 3,639,638	$ 5,328,684	$ 3,639,638