Loans - Schedule of Past Due Financing Receivables (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Jun. 30, 2016
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	$ 15,222	$ 19,487
Current	2,337,193	1,812,972
Total Loans Receivable	2,352,415	1,832,459
30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	5,997	6,043
90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	9,225	13,444
Retail Consumer Loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Loans Receivable	1,202,479	1,082,586
Retail Consumer Loans | One-to-four family
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	7,486	8,990
Current	676,603	614,711
Total Loans Receivable	684,089	623,701
Retail Consumer Loans | One-to-four family | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	3,496	3,514
Retail Consumer Loans | One-to-four family | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	3,990	5,476
Retail Consumer Loans | HELOCs - originated
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	1,311	597
Current	155,757	162,696
Total Loans Receivable	157,068	163,293
Retail Consumer Loans | HELOCs - originated | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	1,037	220
Retail Consumer Loans | HELOCs - originated | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	274	377
Retail Consumer Loans | HELOCs - purchased
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Current	162,407	144,377
Total Loans Receivable	162,407	144,377
Retail Consumer Loans | HELOCs - purchased | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Retail Consumer Loans | HELOCs - purchased | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Retail Consumer Loans | Construction and land/lots
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	261	219
Current	49,875	37,883
Total Loans Receivable	50,136	38,102
Retail Consumer Loans | Construction and land/lots | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	132	100
Retail Consumer Loans | Construction and land/lots | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	129	119
Retail Consumer Loans | Indirect auto finance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	96	182
Current	140,783	108,296
Total Loans Receivable	140,879	108,478
Retail Consumer Loans | Indirect auto finance | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	96	182
Retail Consumer Loans | Indirect auto finance | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Retail Consumer Loans | Consumer
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	19	8
Current	7,881	4,627
Total Loans Receivable	7,900	4,635
Retail Consumer Loans | Consumer | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	5	4
Retail Consumer Loans | Consumer | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	14	4
Commercial Loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Loans Receivable	1,149,936	749,873
Commercial Loans | Commercial real estate
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	3,909	4,789
Current	726,499	481,772
Total Loans Receivable	730,408	486,561
Commercial Loans | Commercial real estate | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	809	1,436
Commercial Loans | Commercial real estate | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	3,100	3,353
Commercial Loans | Construction and development
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	1,272	1,667
Current	196,694	85,173
Total Loans Receivable	197,966	86,840
Commercial Loans | Construction and development | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	385	371
Commercial Loans | Construction and development | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	887	1,296
Commercial Loans | Commercial and industrial
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	868	3,035
Current	119,519	70,254
Total Loans Receivable	120,387	73,289
Commercial Loans | Commercial and industrial | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	37	216
Commercial Loans | Commercial and industrial | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	831	2,819
Commercial Loans | Municipal leases
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Current	101,175	103,183
Total Loans Receivable	101,175	103,183
Commercial Loans | Municipal leases | 30-89 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	0	0
Commercial Loans | Municipal leases | 90 Days
Financing Receivable, Recorded Investment, Past Due [Line Items]
Past Due	$ 0	$ 0