Loans - Schedule of Past Due Financing Receivables (Details) - USD ($) $ in Thousands	Sep. 30, 2017	Jun. 30, 2017
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	$ 17,680	$ 15,222
Current	2,378,360	2,337,193
Total Loans Receivable	2,396,040	2,352,415
30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	7,309	5,997
30-89 Days | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	898	4,772
90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	10,371	9,225
90 Days | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	3,875	4,211
Retail Consumer Loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Loans Receivable	1,207,151	1,202,479
Retail Consumer Loans | One-to-four family
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	8,604	7,486
Current	676,352	676,603
Total Loans Receivable	684,956	684,089
Retail Consumer Loans | One-to-four family | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	4,799	3,496
Retail Consumer Loans | One-to-four family | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	3,805	3,990
Retail Consumer Loans | HELOCs - originated
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	1,542	1,311
Current	151,437	155,757
Total Loans Receivable	152,979	157,068
Retail Consumer Loans | HELOCs - originated | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	601	1,037
Retail Consumer Loans | HELOCs - originated | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	941	274
Retail Consumer Loans | HELOCs - purchased
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Current	162,518	162,407
Total Loans Receivable	162,518	162,407
Retail Consumer Loans | HELOCs - purchased | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Retail Consumer Loans | HELOCs - purchased | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Retail Consumer Loans | Construction and land/lots
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	275	261
Current	54,694	49,875
Total Loans Receivable	54,969	50,136
Retail Consumer Loans | Construction and land/lots | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	211	132
Retail Consumer Loans | Construction and land/lots | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	64	129
Retail Consumer Loans | Indirect auto finance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	383	96
Current	142,532	140,783
Total Loans Receivable	142,915	140,879
Retail Consumer Loans | Indirect auto finance | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	377	96
Retail Consumer Loans | Indirect auto finance | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	6	0
Retail Consumer Loans | Consumer
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	13	19
Current	8,801	7,881
Total Loans Receivable	8,814	7,900
Retail Consumer Loans | Consumer | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	5	5
Retail Consumer Loans | Consumer | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	8	14
Commercial Loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Loans Receivable	1,188,889	1,149,936
Commercial Loans | Commercial real estate
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	4,588	3,909
Current	749,269	726,499
Total Loans Receivable	753,857	730,408
Commercial Loans | Commercial real estate | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	1,091	809
Commercial Loans | Commercial real estate | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	3,497	3,100
Commercial Loans | Construction and development
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	1,357	1,272
Current	208,315	196,694
Total Loans Receivable	209,672	197,966
Commercial Loans | Construction and development | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	141	385
Commercial Loans | Construction and development | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	1,216	887
Commercial Loans | Commercial and industrial
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	918	868
Current	123,804	119,519
Total Loans Receivable	124,722	120,387
Commercial Loans | Commercial and industrial | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	84	37
Commercial Loans | Commercial and industrial | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	834	831
Commercial Loans | Municipal leases
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Current	100,638	101,175
Total Loans Receivable	100,638	101,175
Commercial Loans | Municipal leases | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Commercial Loans | Municipal leases | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	$ 0	$ 0