Loans Held for Investment - Collateral Dependent Loans by Collateral Type (Details) - USD ($) $ in Thousands	Mar. 31, 2023	Dec. 31, 2022
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	$ 24,872	$ 30,905
Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	5,574	4,521
Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,086	1,087
Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	450	463
Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,998	5,051
Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	519	533
Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,708	8,780
Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,966	6,701
Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,571	3,769
Investor loans secured by real estate
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	9,772	13,742
Investor loans secured by real estate | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,129	0
Investor loans secured by real estate | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	450	463
Investor loans secured by real estate | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	519	533
Investor loans secured by real estate | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,708	8,780
Investor loans secured by real estate | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,966	3,966
Investor loans secured by real estate | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	5,545	4,429
Investor loans secured by real estate | CRE non-owner-occupied | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,129	0
Investor loans secured by real estate | CRE non-owner-occupied | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	450	463
Investor loans secured by real estate | CRE non-owner-occupied | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | CRE non-owner-occupied | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,966	3,966
Investor loans secured by real estate | CRE non-owner-occupied | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Multifamily
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,708	8,780
Investor loans secured by real estate | Multifamily | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Multifamily | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Multifamily | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Multifamily | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Multifamily | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Multifamily | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,708	8,780
Investor loans secured by real estate | Multifamily | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | Multifamily | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	519	533
Investor loans secured by real estate | SBA secured by real estate | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	519	533
Investor loans secured by real estate | SBA secured by real estate | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Investor loans secured by real estate | SBA secured by real estate | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	10,292	12,666
Business loans secured by real estate | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,445	4,521
Business loans secured by real estate | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,086	1,087
Business loans secured by real estate | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,761	4,813
Business loans secured by real estate | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	2,245
Business loans secured by real estate | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,190	1,191
Business loans secured by real estate | SBA secured by real estate | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	104	104
Business loans secured by real estate | SBA secured by real estate | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	1,086	1,087
Business loans secured by real estate | SBA secured by real estate | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | SBA secured by real estate | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	9,102	11,475
Business loans secured by real estate | CRE owner-occupied | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,341	4,417
Business loans secured by real estate | CRE owner-occupied | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,761	4,813
Business loans secured by real estate | CRE owner-occupied | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Business loans secured by real estate | CRE owner-occupied | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	2,245
Business loans secured by real estate | CRE owner-occupied | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,808	4,497
Commercial loans | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	237	238
Commercial loans | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	490
Commercial loans | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,571	3,769
Commercial loans | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	4,236	3,908
Commercial loans | Commercial and industrial | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	237	238
Commercial loans | Commercial and industrial | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | Commercial and industrial | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	490
Commercial loans | Commercial and industrial | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	3,999	3,180
Commercial loans | SBA non-real estate secured
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	572	589
Commercial loans | SBA non-real estate secured | Office Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Industrial Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Retail Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Land Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Hotel Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Multifamily Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Other CRE Properties
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	0	0
Commercial loans | SBA non-real estate secured | Business Assets
Financing Receivable, Past Due [Line Items]
Collateral dependent loans	$ 572	$ 589