Loans and Allowance for Loan Losses - Nonperforming of Troubled Debt Restructuring in non accural loans (Details) - USD ($) $ in Thousands	12 Months Ended
	Jun. 30, 2020	Jun. 30, 2019
Total Loans
Number of modifications	20	40
Recorded investment	$ 8,580	$ 13,289
Commercial loans
Number of modifications	7	10
Recorded investment	$ 3,245	$ 5,630
Residential Real Estate
Number of modifications	3	10
Recorded investment	$ 791	$ 1,130
Commercial
Number of modifications	10	20
Recorded investment	$ 4,544	$ 6,529