Loans and Allowance for Credit Losses - Nonaccrual Loans (Details) - USD ($) $ in Thousands	Jun. 30, 2021	Jun. 30, 2020
Financing Receivable, Nonaccrual [Line Items]
Nonaccrual loans	$ 5,868	$ 8,657
Residential Real Estate
Financing Receivable, Nonaccrual [Line Items]
Nonaccrual loans	3,235	4,010
Construction Real Estate
Financing Receivable, Nonaccrual [Line Items]
Nonaccrual loans	30
Commercial Real Estate
Financing Receivable, Nonaccrual [Line Items]
Nonaccrual loans	1,914	3,106
Consumer loans
Financing Receivable, Nonaccrual [Line Items]
Nonaccrual loans	100	196
Commercial loans
Financing Receivable, Nonaccrual [Line Items]
Nonaccrual loans	$ 589	$ 1,345