Loans - Schedule of PCI Loans Credit Quality Indicators (Details) - USD ($) $ in Thousands	Mar. 31, 2017	Jun. 30, 2016
Financing Receivable, Recorded Investment
Total loans	$ 2,248,408	$ 1,796,495
Pass
Financing Receivable, Recorded Investment
Total loans	2,192,032	1,731,571
Special Mention
Financing Receivable, Recorded Investment
Total loans	19,591	20,015
Substandard
Financing Receivable, Recorded Investment
Total loans	35,054	43,516
Doubtful
Financing Receivable, Recorded Investment
Total loans	1,674	1,361
Loss
Financing Receivable, Recorded Investment
Total loans	57	32
Retail Consumer Loans | One-to-four family
Financing Receivable, Recorded Investment
Total loans	674,797	616,663
Retail Consumer Loans | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	159,796	163,015
Retail Consumer Loans | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	46,322	37,528
Retail Consumer Loans | Consumer
Financing Receivable, Recorded Investment
Total loans	7,709	4,626
Retail Consumer Loans | Pass | One-to-four family
Financing Receivable, Recorded Investment
Total loans	649,469	587,440
Retail Consumer Loans | Pass | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	156,411	159,275
Retail Consumer Loans | Pass | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	44,890	36,298
Retail Consumer Loans | Pass | Consumer
Financing Receivable, Recorded Investment
Total loans	7,527	4,390
Retail Consumer Loans | Special Mention | One-to-four family
Financing Receivable, Recorded Investment
Total loans	7,407	7,800
Retail Consumer Loans | Special Mention | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	923	678
Retail Consumer Loans | Special Mention | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	582	542
Retail Consumer Loans | Special Mention | Consumer
Financing Receivable, Recorded Investment
Total loans	18	1
Retail Consumer Loans | Substandard | One-to-four family
Financing Receivable, Recorded Investment
Total loans	16,597	20,129
Retail Consumer Loans | Substandard | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	2,336	2,997
Retail Consumer Loans | Substandard | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	720	679
Retail Consumer Loans | Substandard | Consumer
Financing Receivable, Recorded Investment
Total loans	154	224
Retail Consumer Loans | Doubtful | One-to-four family
Financing Receivable, Recorded Investment
Total loans	1,318	1,283
Retail Consumer Loans | Doubtful | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	88	55
Retail Consumer Loans | Doubtful | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	130	9
Retail Consumer Loans | Doubtful | Consumer
Financing Receivable, Recorded Investment
Total loans	2	2
Retail Consumer Loans | Loss | One-to-four family
Financing Receivable, Recorded Investment
Total loans	6	11
Retail Consumer Loans | Loss | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	38	10
Retail Consumer Loans | Loss | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	0	0
Retail Consumer Loans | Loss | Consumer
Financing Receivable, Recorded Investment
Total loans	8	9
Commercial Loans | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	687,487	465,238
Commercial Loans | Construction and development
Financing Receivable, Recorded Investment
Total loans	174,271	83,693
Commercial Loans | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	102,462	69,694
Commercial Loans | Municipal leases
Financing Receivable, Recorded Investment
Total loans	101,776	103,183
Commercial Loans | Pass | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	671,778	448,188
Commercial Loans | Pass | Construction and development
Financing Receivable, Recorded Investment
Total loans	170,496	79,005
Commercial Loans | Pass | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	97,769	63,299
Commercial Loans | Pass | Municipal leases
Financing Receivable, Recorded Investment
Total loans	100,394	100,867
Commercial Loans | Special Mention | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	6,933	7,817
Commercial Loans | Special Mention | Construction and development
Financing Receivable, Recorded Investment
Total loans	937	480
Commercial Loans | Special Mention | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	1,508	1,032
Commercial Loans | Special Mention | Municipal leases
Financing Receivable, Recorded Investment
Total loans	1,271	1,651
Commercial Loans | Substandard | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	8,776	9,232
Commercial Loans | Substandard | Construction and development
Financing Receivable, Recorded Investment
Total loans	2,838	4,208
Commercial Loans | Substandard | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	3,182	5,361
Commercial Loans | Substandard | Municipal leases
Financing Receivable, Recorded Investment
Total loans	111	665
Commercial Loans | Doubtful | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	0	1
Commercial Loans | Doubtful | Construction and development
Financing Receivable, Recorded Investment
Total loans	0	0
Commercial Loans | Doubtful | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	0	0
Commercial Loans | Doubtful | Municipal leases
Financing Receivable, Recorded Investment
Total loans	0	0
Commercial Loans | Loss | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	0	0
Commercial Loans | Loss | Construction and development
Financing Receivable, Recorded Investment
Total loans	0	0
Commercial Loans | Loss | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	3	2
Commercial Loans | Loss | Municipal leases
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans
Financing Receivable, Recorded Investment
Total loans	33,870	35,964
Purchased Credit Impaired (PCI) Loans | Pass
Financing Receivable, Recorded Investment
Total loans	16,666	22,791
Purchased Credit Impaired (PCI) Loans | Special Mention
Financing Receivable, Recorded Investment
Total loans	7,394	5,129
Purchased Credit Impaired (PCI) Loans | Substandard
Financing Receivable, Recorded Investment
Total loans	9,604	8,014
Purchased Credit Impaired (PCI) Loans | Doubtful
Financing Receivable, Recorded Investment
Total loans	206	14
Purchased Credit Impaired (PCI) Loans | Loss
Financing Receivable, Recorded Investment
Total loans	0	16
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | One-to-four family
Financing Receivable, Recorded Investment
Total loans	8,586	7,038
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	287	278
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	534	574
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Consumer
Financing Receivable, Recorded Investment
Total loans	20	9
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Pass | One-to-four family
Financing Receivable, Recorded Investment
Total loans	3,272	5,039
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Pass | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	258	258
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Pass | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	493	522
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Pass | Consumer
Financing Receivable, Recorded Investment
Total loans	5	8
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Special Mention | One-to-four family
Financing Receivable, Recorded Investment
Total loans	1,569	377
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Special Mention | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Special Mention | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Special Mention | Consumer
Financing Receivable, Recorded Investment
Total loans	15	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Substandard | One-to-four family
Financing Receivable, Recorded Investment
Total loans	3,539	1,593
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Substandard | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	29	20
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Substandard | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	41	52
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Substandard | Consumer
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Doubtful | One-to-four family
Financing Receivable, Recorded Investment
Total loans	206	14
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Doubtful | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Doubtful | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Doubtful | Consumer
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Loss | One-to-four family
Financing Receivable, Recorded Investment
Total loans	0	15
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Loss | HELOCs - originated
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Loss | Construction and land/lots
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Retail Consumer Loans | Loss | Consumer
Financing Receivable, Recorded Investment
Total loans	0	1
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	18,790	21,323
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Construction and development
Financing Receivable, Recorded Investment
Total loans	2,816	3,147
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	2,837	3,595
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Municipal leases
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Pass | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	9,608	12,594
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Pass | Construction and development
Financing Receivable, Recorded Investment
Total loans	390	1,136
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Pass | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	2,640	3,234
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Special Mention | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	5,228	4,266
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Special Mention | Construction and development
Financing Receivable, Recorded Investment
Total loans	431	292
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Special Mention | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	151	194
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Substandard | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	3,954	4,463
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Substandard | Construction and development
Financing Receivable, Recorded Investment
Total loans	1,995	1,719
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Substandard | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	46	167
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Doubtful | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Doubtful | Construction and development
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Doubtful | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Loss | Commercial real estate
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Loss | Construction and development
Financing Receivable, Recorded Investment
Total loans	0	0
Purchased Credit Impaired (PCI) Loans | Commercial Loans | Loss | Commercial and industrial
Financing Receivable, Recorded Investment
Total loans	$ 0	$ 0