Loans and Allowance for Credit Losses - Credit risk profile based on rating and payment activity (Details) - USD ($) $ in Thousands	12 Months Ended
	Jun. 30, 2021	Jun. 30, 2020
Pass
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL	$ 3,200	$ 5,900
Watch
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL	9,000	10,300
Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL	0	0
Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL	2,700	5,600
Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL	$ 0	0
Residential Real Estate
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		627,357
Residential Real Estate | Pass
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		620,004
Residential Real Estate | Watch
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		1,900
Residential Real Estate | Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		5,453
Construction Real Estate
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		107,472
Construction Real Estate | Pass
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		103,105
Construction Real Estate | Watch
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		4,367
Commercial Real Estate
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		887,419
Commercial Real Estate | Pass
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		829,276
Commercial Real Estate | Watch
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		45,262
Commercial Real Estate | Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		403
Commercial Real Estate | Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		11,590
Commercial Real Estate | Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		888
Consumer loans
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		80,767
Consumer loans | Pass
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		80,517
Consumer loans | Watch
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		45
Consumer loans | Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		25
Consumer loans | Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		180
Commercial loans
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		468,448
Commercial loans | Pass
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		457,385
Commercial loans | Watch
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		4,708
Commercial loans | Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
PCD loans receivable, net of ACL		$ 6,355