Parent Company Financial Information - Condensed Cash Flow Statement (Details) - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2018	Sep. 30, 2018	Jun. 30, 2018	Mar. 31, 2018	Dec. 31, 2017	Sep. 30, 2017	Jun. 30, 2019	Jun. 30, 2018	Jun. 30, 2017
Operating Activities:
Net Income	$ 8,013	$ 3,302	$ 8,041	$ 7,790	$ 7,207	$ 6,127	$ (10,666)	$ 5,567	$ 27,146	$ 8,235	$ 11,847
Provision for (recovery of) loan losses	200	$ 5,500	$ 0	0	0	$ 0	$ 0	0
Loss on sale and impairment of REO									439	127	300
ESOP compensation expense									1,422	1,367	1,186
Net cash provided by operating activities									7,662	31,342	15,115
Investing Activities:
Maturities of certificates of deposit in other banks									33,086	82,538	71,476
Net cash used in investing activities									(150,489)	(134,017)	(106,756)
Financing Activities:
Cash dividends paid									(3,176)	0	0
Retired stock									(205)	(494)	(569)
Stock options exercised									1,173	651	3,068
Net cash provided by financing activities									143,124	86,436	126,030
Net Increase (Decrease) in Cash and Cash Equivalents									297	(16,239)	34,389
Cash and Cash Equivalents at Beginning of Period				70,746				86,985	70,746	86,985	52,596
Cash and Cash Equivalents at End of Period	71,043				70,746				71,043	70,746	86,985
Parent Company
Operating Activities:
Net Income									27,146	8,235	11,847
Provision for (recovery of) loan losses									(259)	(131)	90
Loss on sale and impairment of REO									114	158	39
Decrease (increase) in accrued interest receivable and other assets									52	291	(30)
Equity in undistributed income of Bank									(27,287)	(8,427)	(12,003)
ESOP compensation expense									1,422	1,367	1,186
Restricted stock and stock option expense									1,601	3,027	4,166
Decrease in other liabilities									0	(48)	(260)
Net cash provided by operating activities									2,789	4,472	5,035
Investing Activities:
Maturities of certificates of deposit in other banks									248	6,217	1,245
Repayment of loans									2,796	1,514	2,176
Increase in investment in Bank subsidiary									(1,556)	(1,367)	(3,408)
Dividend from subsidiary									13,454	0	10,291
ESOP principal payments received									484	472	462
Proceeds from sale of REO									70	499	61
Acquisition of TriSummit Bancorp, Inc.									0	0	(13,862)
Net cash used in investing activities									15,496	7,335	(3,035)
Financing Activities:
Common stock repurchased									(30,638)	0	0
Cash dividends paid									(3,176)	0	0
Retired stock									(205)	(494)	(569)
Stock options exercised									1,173	651	3,068
Net cash provided by financing activities									(32,846)	157	2,499
Net Increase (Decrease) in Cash and Cash Equivalents									(14,561)	11,964	4,499
Cash and Cash Equivalents at Beginning of Period				$ 23,042				$ 11,078	23,042	11,078	6,579
Cash and Cash Equivalents at End of Period	$ 8,481				$ 23,042				$ 8,481	$ 23,042	$ 11,078