Condensed Parent Company Only Financial Statements - Parent Company Condensed Statements of Cash Flows (Details) - USD ($) $ in Thousands	12 Months Ended
	Jun. 30, 2020	Jun. 30, 2019	Jun. 30, 2018
NET INCOME	$ 27,545	$ 28,904	$ 20,929
NET CASH PROVIDED BY OPERATING ACTIVITIES	40,301	38,601	30,644
NET CASH USED IN INVESTING ACTIVITIES	(272,360)	(112,992)	(108,479)
Exercise of stock options	64		172
Payments to acquire treasury stock	(5,771)	(1,166)
NET CASH USED IN FINANCING ACTIVITIES	250,904	83,465	73,375
Increase (decrease) in cash and cash equivalents	18,845	9,074	(4,460)
Cash and cash equivalents at beginning of period	35,400	26,326	30,786
Cash and cash equivalents at end of period	54,245	35,400	26,326
Parent Company
NET INCOME	27,545	28,904	20,929
Equity in undistributed income of the Bank	4,469	(7,427)	(16,299)
Other adjustments, net	(904)	(635)	40
NET CASH PROVIDED BY OPERATING ACTIVITIES	31,110	20,842	4,670
Investments in Bank subsidiaries	(20,463)	(10,747)	(3,488)
NET CASH USED IN INVESTING ACTIVITIES	(20,463)	(10,747)	(3,488)
Dividends on common stock	(5,513)	(4,763)	(3,827)
Exercise of stock options	64		172
Repayments of long term debt	(3,000)	(4,400)
NET CASH USED IN FINANCING ACTIVITIES	(14,220)	(10,329)	(3,655)
Increase (decrease) in cash and cash equivalents	(3,573)	(234)	(2,473)
Cash and cash equivalents at beginning of period	8,149	8,383	10,856
Cash and cash equivalents at end of period	$ 4,576	$ 8,149	$ 8,383