Loans Held for Investment - Collateral Dependent Loans by Collateral Type (Details) - USD ($) $ in Thousands	Dec. 31, 2022	Dec. 31, 2021
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	$ 30,905	$ 18,858
Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,521	148
Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,087	441
Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	463	513
Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	5,051	5,197
Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	533	10,679
Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	8,780
Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	6,701
Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		10
Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,769	1,870
Investor loans secured by real estate
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	13,742	11,192
Investor loans secured by real estate | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	463	513
Investor loans secured by real estate | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	533	10,679
Investor loans secured by real estate | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	8,780
Investor loans secured by real estate | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,966
Investor loans secured by real estate | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Investor loans secured by real estate | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,429	10,255
Investor loans secured by real estate | CRE non-owner-occupied | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	463	513
Investor loans secured by real estate | CRE non-owner-occupied | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	9,742
Investor loans secured by real estate | CRE non-owner-occupied | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | CRE non-owner-occupied | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,966
Investor loans secured by real estate | CRE non-owner-occupied | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Investor loans secured by real estate | CRE non-owner-occupied | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Multifamily
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	8,780
Investor loans secured by real estate | Multifamily | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | Multifamily | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | Multifamily | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | Multifamily | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | Multifamily | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | Multifamily | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	8,780
Investor loans secured by real estate | Multifamily | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | Multifamily | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	533	937
Investor loans secured by real estate | SBA secured by real estate | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	533	937
Investor loans secured by real estate | SBA secured by real estate | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | SBA secured by real estate | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Investor loans secured by real estate | SBA secured by real estate | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Investor loans secured by real estate | SBA secured by real estate | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	12,666	5,541
Business loans secured by real estate | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,521	148
Business loans secured by real estate | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,087	441
Business loans secured by real estate | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,813	4,952
Business loans secured by real estate | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Business loans secured by real estate | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	2,245
Business loans secured by real estate | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Business loans secured by real estate | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,191	589
Business loans secured by real estate | SBA secured by real estate | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	104	148
Business loans secured by real estate | SBA secured by real estate | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,087	441
Business loans secured by real estate | SBA secured by real estate | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Business loans secured by real estate | SBA secured by real estate | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Business loans secured by real estate | SBA secured by real estate | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Business loans secured by real estate | SBA secured by real estate | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	11,475	4,952
Business loans secured by real estate | CRE owner-occupied | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,417	0
Business loans secured by real estate | CRE owner-occupied | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,813	4,952
Business loans secured by real estate | CRE owner-occupied | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Business loans secured by real estate | CRE owner-occupied | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	2,245
Business loans secured by real estate | CRE owner-occupied | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Business loans secured by real estate | CRE owner-occupied | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,497	2,115
Commercial loans | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	238	245
Commercial loans | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Commercial loans | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	490
Commercial loans | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Commercial loans | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,769	1,870
Commercial loans | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,908	1,462
Commercial loans | Commercial and industrial | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	238	245
Commercial loans | Commercial and industrial | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Commercial loans | Commercial and industrial | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	490
Commercial loans | Commercial and industrial | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Commercial loans | Commercial and industrial | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,180	1,217
Commercial loans | SBA non-real estate secured
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	589	653
Commercial loans | SBA non-real estate secured | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Commercial loans | SBA non-real estate secured | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0
Commercial loans | SBA non-real estate secured | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Commercial loans | SBA non-real estate secured | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	$ 589	653
Retail loans
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		10
Retail loans | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		10
Retail loans | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Single family residential
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		10
Retail loans | Single family residential | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Single family residential | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Single family residential | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Single family residential | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Single family residential | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		0
Retail loans | Single family residential | Residential Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		10
Retail loans | Single family residential | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans		$ 0