Parent Company Financial Information - Condensed Income Statement (Details) - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Jun. 30, 2016	Mar. 31, 2016	Dec. 31, 2015	Sep. 30, 2015	Jun. 30, 2015	Mar. 31, 2015	Dec. 31, 2014	Sep. 30, 2014	Jun. 30, 2016	Jun. 30, 2015	Jun. 30, 2014
Income:
Interest income	$ 22,375	$ 21,797	$ 21,566	$ 22,009	$ 22,197	$ 21,536	$ 21,559	$ 19,864	$ 87,747	$ 85,156	$ 60,281
Expense:
Loss (gain) on sale and impairment of REO									534	28	646
Provision for (recovery of) loan losses	0	0	0	0	400	0	0	(250)
Income Tax Expense	1,406	1,090	864	1,541	553	314	825	866	4,901	2,558	4,513
Net Income	$ 3,302	$ 3,141	$ 2,449	$ 2,564	$ 2,558	$ 1,162	$ 2,049	$ 2,256	11,456	8,025	10,342
Parent Company
Income:
Interest income									716	969	1,418
Other income									0	1	9
Equity earnings in Bank subsidiary									11,284	6,848	9,444
Total income									12,000	7,818	10,871
Expense:
Management fee expense									317	290	351
REO expense									71	136	237
Loss (gain) on sale and impairment of REO									115	(83)	118
Provision for (recovery of) loan losses									(275)	(1,025)	(357)
Other expense									166	152	137
Total expense									394	(530)	486
Income Before Income Taxes									11,606	8,348	10,385
Income Tax Expense									150	323	43
Net Income									$ 11,456	$ 8,025	$ 10,342