Fair Value of Financial Instruments - Schedule of Fair Value, by Balance Sheet Grouping (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2015	Jun. 30, 2014
Cash and interest-bearing deposits
Financial Instruments Owned	$ 294,659	$ 45,830
Certificates of deposit in other banks
Financial Instruments Owned	204,596	163,780
Securities available for sale
Financial Instruments Owned	230,512	168,749
Other Investments
Financial Instruments Owned	19,142	3,697
Loans held for sale
Financial Instruments Owned	2,225	2,537
Loans, net
Financial Instruments Owned	1,618,376	1,473,099
Accrued interest receivable
Financial Instruments Owned	7,249	6,787
Noninterest-bearing and NOW deposits
Financial Instruments Owned	592,338	418,671
Money market accounts
Financial Instruments Owned	489,606	354,247
Savings accounts
Financial Instruments Owned	223,748	175,974
Certificates of deposit
Financial Instruments Owned	608,081	634,154
Other borrowings
Financial Instruments Owned	250,000	50,000
Accrued interest payable
Financial Instruments Owned	146	244
Fair Value, Inputs, Level 1 | Cash and interest-bearing deposits
Financial Instruments Owned	294,659	45,830
Fair Value, Inputs, Level 1 | Other Investments
Financial Instruments Owned	19,142	3,697
Fair Value, Inputs, Level 2 | Certificates of deposit in other banks
Financial Instruments Owned	204,596	163,780
Fair Value, Inputs, Level 2 | Securities available for sale
Financial Instruments Owned	229,512	168,749
Fair Value, Inputs, Level 2 | Accrued interest receivable
Financial Instruments Owned	1,095	736
Fair Value, Inputs, Level 2 | Noninterest-bearing and NOW deposits
Financial Instruments Owned	592,338	418,671
Fair Value, Inputs, Level 2 | Money market accounts
Financial Instruments Owned	489,606	354,247
Fair Value, Inputs, Level 2 | Savings accounts
Financial Instruments Owned	223,748	175,974
Fair Value, Inputs, Level 2 | Certificates of deposit
Financial Instruments Owned	607,650	620,196
Fair Value, Inputs, Level 2 | Other borrowings
Financial Instruments Owned	250,000	50,000
Fair Value, Inputs, Level 2 | Accrued interest payable
Financial Instruments Owned	146	244
Fair Value, Inputs, Level 3 | Securities available for sale
Financial Instruments Owned	1,000	0
Fair Value, Inputs, Level 3 | Loans held for sale
Financial Instruments Owned	2,261	2,578
Fair Value, Inputs, Level 3 | Loans, net
Financial Instruments Owned	1,524,874	1,381,438
Fair Value, Inputs, Level 3 | Accrued interest receivable
Financial Instruments Owned	6,154	6,051
Estimate of Fair Value Measurement [Member] | Cash and interest-bearing deposits
Financial Instruments Owned	294,659	45,830
Estimate of Fair Value Measurement [Member] | Certificates of deposit in other banks
Financial Instruments Owned	204,596	163,780
Estimate of Fair Value Measurement [Member] | Securities available for sale
Financial Instruments Owned	230,512	168,749
Estimate of Fair Value Measurement [Member] | Other Investments
Financial Instruments Owned	19,142	3,697
Estimate of Fair Value Measurement [Member] | Loans held for sale
Financial Instruments Owned	2,261	2,578
Estimate of Fair Value Measurement [Member] | Loans, net
Financial Instruments Owned	1,524,874	1,381,438
Estimate of Fair Value Measurement [Member] | Accrued interest receivable
Financial Instruments Owned	7,249	6,787
Estimate of Fair Value Measurement [Member] | Noninterest-bearing and NOW deposits
Financial Instruments Owned	592,338	418,671
Estimate of Fair Value Measurement [Member] | Money market accounts
Financial Instruments Owned	489,606	354,247
Estimate of Fair Value Measurement [Member] | Savings accounts
Financial Instruments Owned	223,748	175,974
Estimate of Fair Value Measurement [Member] | Certificates of deposit
Financial Instruments Owned	607,650	620,196
Estimate of Fair Value Measurement [Member] | Other borrowings
Financial Instruments Owned	250,000	50,000
Estimate of Fair Value Measurement [Member] | Accrued interest payable
Financial Instruments Owned	$ 146	$ 244