Consolidated Statements of Changes in Stockholders' Equity - USD ($) $ in Thousands	Total	Common Stock	Additional Paid In Capital	Retained Earnings	Unearned ESOP Shares	Accumulated Other Comprehensive Income (Loss)
Beginning balance at Jun. 30, 2013	$ 367,515	$ 208	$ 227,397	$ 149,990	$ (10,051)	$ (29)
Beginning balance (in shares) at Jun. 30, 2013		20,824,900
Increase (Decrease) in Stockholders' Equity
Net income	10,342			10,342
Stock repurchased	$ (29,460)	$ (18)	(29,442)
Stock repurchased (in shares)		(1,845,744)
Granted restricted stock (in shares)	7,050
Forfeited restricted stock (in shares)		(18,900)
Retired stock	$ (226)		226
Retired stock (in shares)		(14,555)
Shares issued for Jefferson Bancshares, Inc. merger	25,239	$ 17	25,222
Shares issued for Jefferson Bancshares, Inc. merger (in shares)		1,679,257
Stock option expense	1,273		1,273
Restricted stock expense	1,350		1,350
ESOP shares allocated	844		315		529
Other comprehensive income	274					274
Ending balance, shares (in shares) at Jun. 30, 2014		20,632,008
Ending balance at Jun. 30, 2014	377,151	$ 207	225,889	160,332	(9,522)	245
Increase (Decrease) in Stockholders' Equity
Net income	8,025			8,025
Stock repurchased	(18,470)	$ (12)	(18,458)
Stock repurchased (in shares)		(1,147,927)
Forfeited restricted stock (in shares)		(1,600)
Retired stock	(188)		188
Retired stock (in shares)		(12,032)
Exercised stock options	259		259
Exercised stock options (in shares)		18,000
Stock option expense	1,394		1,394
Restricted stock expense	1,427		1,427
ESOP shares allocated	827		298		529
Other comprehensive income	$ 625					625
Ending balance, shares (in shares) at Jun. 30, 2015	19,488,449	19,488,449
Ending balance at Jun. 30, 2015	$ 371,050	$ 195	210,621	168,357	(8,993)	870
Increase (Decrease) in Stockholders' Equity
Net income	11,456			11,456
Stock repurchased	$ (27,734)	$ (15)	(27,719)
Stock repurchased (in shares)		(1,510,994)
Granted restricted stock (in shares)	34,500
Forfeited restricted stock (in shares)		(2,550)
Retired stock	$ (223)		223
Retired stock (in shares)		(12,855)
Exercised stock options	32	$ 0	32
Exercised stock options (in shares)		2,200
Stock option expense	1,512		1,512
Restricted stock expense	1,427		1,427
ESOP shares allocated	983		454		529
Other comprehensive income	$ 1,473					1,473
Ending balance, shares (in shares) at Jun. 30, 2016	17,998,750	17,998,750
Ending balance at Jun. 30, 2016	$ 359,976	$ 180	$ 186,104	$ 179,813	$ (8,464)	$ 2,343