Fair Value of Financial Instruments - Schedule of Quantitative Information About Level 3 Fair Value Measurements (Details) - USD ($) $ in Thousands	12 Months Ended
	Jun. 30, 2016	Jun. 30, 2015
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Financial assets measured on non-recurring basis	$ 5,356	$ 7,382
Nonrecurring Measurements | Impaired loans, net
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Financial assets measured on non-recurring basis	$ 4,239
Valuation Techniques	Discounted Appraisals
Unobservable Input	Collateral discounts
Weighted Average	12.00%
Nonrecurring Measurements | REO
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Financial assets measured on non-recurring basis	$ 1,117
Valuation Techniques	Discounted Appraisals
Unobservable Input	Collateral discounts
Weighted Average	16.00%
Nonrecurring Measurements | Minimum | Impaired loans, net
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Weighted Average	0.00%
Nonrecurring Measurements | Minimum | REO
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Weighted Average	10.00%
Nonrecurring Measurements | Maximum | Impaired loans, net
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Weighted Average	60.00%
Nonrecurring Measurements | Maximum | REO
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Weighted Average	20.00%