Debt - Narrative (Details)		3 Months Ended			9 Months Ended
	Jan. 13, 2022 USD ($)	Sep. 30, 2023 USD ($)	Sep. 30, 2022 USD ($)	Aug. 31, 2020 USD ($)	Sep. 30, 2023 USD ($)	Sep. 30, 2022 USD ($)	Aug. 31, 2023	Dec. 31, 2022 USD ($)
Debt Conversion [Line Items]
Loans pledged to the FHLB		$ 1,659,712,000			$ 1,659,712,000			$ 1,630,939,000
Total borrowing capacity with the FHLB		1,213,992,000			1,213,992,000			1,139,356,000
Additional borrowing availability with the FHLB		1,051,446,000			1,051,446,000
Convertible notes payable, net		0			0			5,355,000
Trust preferred securities, aggregate liquidation valuation amount		419,000			419,000
Trust Preferred Securities | New Mexico Banquest Capital Trust I (NMBCT I)
Debt Conversion [Line Items]
Debt instrument, face amount		9,279,000			9,279,000
Trust Preferred Securities | New Mexico Banquest Capital Trust II (NMBCT II)
Debt Conversion [Line Items]
Debt instrument, face amount		4,640,000			$ 4,640,000
Convertible Notes Payable | Convertible Debt
Debt Conversion [Line Items]
Convertible notes payable, net								5,456,000
Debt instrument, interest rate							3.29%
Convertible debt, conversion ratio					0.0156717
Amortization of debt discount		25,000	$ 38,000		$ 101,000	$ 1,093,000
Debt discount on the convertible notes								$ 101,000
Subordinated Notes Due July 1, 2030 | Subordinated Debt
Debt Conversion [Line Items]
Debt instrument, interest rate				6.00%
Debt instrument, face amount				$ 40,000,000
Debt redemption period from issuance date				5 years
Costs related to the issuance of the subordinated notes				$ 933,000
Subordinated Notes Due January 15, 2032 | Subordinated Debt
Debt Conversion [Line Items]
Debt instrument, interest rate	3.375%
Debt instrument, face amount	$ 25,000,000
Debt redemption period from issuance date	5 years
Costs related to the issuance of the subordinated notes	$ 534,000
Subordinated Debt related to Trust Preferred Securities | Subordinated Debt
Debt Conversion [Line Items]
Debt instrument, face amount		13,919,000			13,919,000
Debt discount on the convertible notes		$ 4,293,000			$ 4,293,000
SOFR | Subordinated Notes Due July 1, 2030 | Subordinated Debt
Debt Conversion [Line Items]
Interest rate margin on variable rate basis				5.89%
SOFR | Subordinated Notes Due January 15, 2032 | Subordinated Debt
Debt Conversion [Line Items]
Interest rate margin on variable rate basis	2.03%
LIBOR | Trust Preferred Securities | New Mexico Banquest Capital Trust I (NMBCT I)
Debt Conversion [Line Items]
Interest rate margin on variable rate basis					3.35%
Rate		8.51%	5.60%		8.51%	5.60%
LIBOR | Trust Preferred Securities | New Mexico Banquest Capital Trust II (NMBCT II)
Debt Conversion [Line Items]
Interest rate margin on variable rate basis					2.00%
Rate		7.39%	4.96%		7.39%	4.96%
Line of Credit | Other Financial Institutions
Debt Conversion [Line Items]
Line of credit facility, maximum borrowing capacity		$ 105,000,000			$ 105,000,000
Line of credit outstanding		0			0
Line of Credit | Federal Reserve Bank stock
Debt Conversion [Line Items]
Line of credit facility, maximum borrowing capacity		1,980,993,000			1,980,993,000
Debt collateral amount		2,468,593,000			2,468,593,000
Line of credit outstanding		$ 0			$ 0
Line of Credit | Federal Reserve Bank stock | Fed Funds target rate
Debt Conversion [Line Items]
Interest rate margin on variable rate basis					0.50%