Loans - Schedule of Ending Balances of Loans and the Related Allowance by Segment and Class (Details) - USD ($) $ in Thousands	Mar. 31, 2017	Dec. 31, 2016	Jun. 30, 2016	Mar. 31, 2016	Dec. 31, 2015	Jun. 30, 2015
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	$ 21,097	$ 20,986	$ 21,292	$ 21,761	$ 21,977	$ 22,374
Allowance for loan losses, Loans individually evaluated for impairment	1,174		686
Allowance for loan losses, Loans collectively evaluated	19,449		20,245
Allowance for loan losses, Total	21,097		21,292
Total loans receivable, PCI	2,248,408		1,796,495
Total loans receivable, Loans individually evaluated for impairment	23,055		24,345
Total loans receivable, Loans collectively evaluated	2,225,353		1,772,150
Total loans	2,282,278		1,832,459
Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	474	336	361	345	355	401
Total loans receivable, PCI	33,870		35,964
Retail Consumer Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	8,879	9,813	11,549	11,945	12,070	12,575
Total loans	1,191,839		1,082,586
Retail Consumer Loans | One-to-four family
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	297		187
Allowance for loan losses, Loans collectively evaluated	4,573		6,385
Allowance for loan losses, Total	4,886		6,595
Total loans receivable, PCI	674,797		616,663
Total loans receivable, Loans individually evaluated for impairment	10,777		12,411
Total loans receivable, Loans collectively evaluated	664,020		604,252
Total loans	683,383		623,701
Retail Consumer Loans | One-to-four family | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	16		23
Total loans receivable, PCI	8,586		7,038
Retail Consumer Loans | HELOCs - originated
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	38		288
Allowance for loan losses, Loans collectively evaluated	1,484		1,709
Allowance for loan losses, Total	1,522		1,997
Total loans receivable, PCI	159,796		163,015
Total loans receivable, Loans individually evaluated for impairment	43		1,145
Total loans receivable, Loans collectively evaluated	159,753		161,870
Total loans	160,083		163,293
Retail Consumer Loans | HELOCs - originated | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	0		0
Total loans receivable, PCI	287		278
Retail Consumer Loans | HELOCs - purchased
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	0		0
Allowance for loan losses, Loans collectively evaluated	643		558
Allowance for loan losses, Total	643		558
Total loans receivable, PCI	160,829		144,377
Total loans receivable, Loans individually evaluated for impairment	0		0
Total loans receivable, Loans collectively evaluated	160,829		144,377
Total loans	160,829		144,377
Retail Consumer Loans | HELOCs - purchased | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	0		0
Total loans receivable, PCI	0		0
Retail Consumer Loans | Construction and land/lots
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	26		198
Allowance for loan losses, Loans collectively evaluated	903		1,146
Allowance for loan losses, Total	929		1,344
Total loans receivable, PCI	46,322		37,528
Total loans receivable, Loans individually evaluated for impairment	648		392
Total loans receivable, Loans collectively evaluated	45,674		37,136
Total loans	46,856		38,102
Retail Consumer Loans | Construction and land/lots | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	0		0
Total loans receivable, PCI	534		574
Retail Consumer Loans | Indirect auto finance
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	2		0
Allowance for loan losses, Loans collectively evaluated	857		1,016
Allowance for loan losses, Total	859		1,016
Total loans receivable, PCI	132,959		108,478
Total loans receivable, Loans individually evaluated for impairment	8		0
Total loans receivable, Loans collectively evaluated	132,951		108,478
Total loans	132,959		108,478
Retail Consumer Loans | Indirect auto finance | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	0		0
Total loans receivable, PCI	0		0
Retail Consumer Loans | Consumer
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	8		10
Allowance for loan losses, Loans collectively evaluated	48		51
Allowance for loan losses, Total	56		61
Total loans receivable, PCI	7,709		4,626
Total loans receivable, Loans individually evaluated for impairment	2		0
Total loans receivable, Loans collectively evaluated	7,707		4,626
Total loans	7,729		4,635
Retail Consumer Loans | Consumer | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	0		0
Total loans receivable, PCI	20		9
Commercial Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	11,744	$ 10,837	9,382	$ 9,471	$ 9,552	$ 9,398
Total loans	1,090,439		749,873
Commercial Loans | Commercial real estate
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	254		0
Allowance for loan losses, Loans collectively evaluated	6,708		6,142
Allowance for loan losses, Total	7,259		6,430
Total loans receivable, PCI	687,487		465,238
Total loans receivable, Loans individually evaluated for impairment	7,290		5,376
Total loans receivable, Loans collectively evaluated	680,197		459,862
Total loans	706,277		486,561
Commercial Loans | Commercial real estate | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	297		288
Total loans receivable, PCI	18,790		21,323
Commercial Loans | Construction and development
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	5		0
Allowance for loan losses, Loans collectively evaluated	2,746		1,891
Allowance for loan losses, Total	2,896		1,908
Total loans receivable, PCI	174,271		83,693
Total loans receivable, Loans individually evaluated for impairment	2,188		1,789
Total loans receivable, Loans collectively evaluated	172,083		81,904
Total loans	177,087		86,840
Commercial Loans | Construction and development | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	145		17
Total loans receivable, PCI	2,816		3,147
Commercial Loans | Commercial and industrial
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	544		3
Allowance for loan losses, Loans collectively evaluated	974		685
Allowance for loan losses, Total	1,534		721
Total loans receivable, PCI	102,462		69,694
Total loans receivable, Loans individually evaluated for impairment	1,805		2,927
Total loans receivable, Loans collectively evaluated	100,657		66,767
Total loans	105,299		73,289
Commercial Loans | Commercial and industrial | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	16		33
Total loans receivable, PCI	2,837		3,595
Commercial Loans | Municipal leases
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, Loans individually evaluated for impairment	0		0
Allowance for loan losses, Loans collectively evaluated	513		662
Allowance for loan losses, Total	513		662
Total loans receivable, PCI	101,776		103,183
Total loans receivable, Loans individually evaluated for impairment	294		305
Total loans receivable, Loans collectively evaluated	101,482		102,878
Total loans	101,776		103,183
Commercial Loans | Municipal leases | Purchased Credit Impaired (PCI) Loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Allowance for loan losses, PCI	0		0
Total loans receivable, PCI	$ 0		$ 0