Fair Value Accounting and Measurement - Company Assets Measured at Fair Value on a Recurring Basis (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2015	Jun. 30, 2014
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	$ 290,372	$ 178,972
Recurring
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	290,372	178,972
Recurring | Municipal bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	10,006	7,525
Recurring | Agency bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	24,118
Recurring | ABS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	9,346	10,140
Recurring | ABS Corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	29,596
Recurring | SBA
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	34,987	28,944
Recurring | MBS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	173,485	132,363
Recurring | Corporate issued mortgage-backed securities (MBS corporate)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	8,834
Recurring | Quoted Prices in Active Markets for Identical Assets or Liabilities (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Quoted Prices in Active Markets for Identical Assets or Liabilities (Level 1) | Municipal bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Quoted Prices in Active Markets for Identical Assets or Liabilities (Level 1) | Agency bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0
Recurring | Quoted Prices in Active Markets for Identical Assets or Liabilities (Level 1) | ABS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Quoted Prices in Active Markets for Identical Assets or Liabilities (Level 1) | ABS Corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0
Recurring | Quoted Prices in Active Markets for Identical Assets or Liabilities (Level 1) | SBA
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Quoted Prices in Active Markets for Identical Assets or Liabilities (Level 1) | MBS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Quoted Prices in Active Markets for Identical Assets or Liabilities (Level 1) | Corporate issued mortgage-backed securities (MBS corporate)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0
Recurring | Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	290,372	178,972
Recurring | Significant Other Observable Inputs (Level 2) | Municipal bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	10,006	7,525
Recurring | Significant Other Observable Inputs (Level 2) | Agency bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	24,118
Recurring | Significant Other Observable Inputs (Level 2) | ABS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	9,346	10,140
Recurring | Significant Other Observable Inputs (Level 2) | ABS Corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	29,596
Recurring | Significant Other Observable Inputs (Level 2) | SBA
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	34,987	28,944
Recurring | Significant Other Observable Inputs (Level 2) | MBS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	173,485	132,363
Recurring | Significant Other Observable Inputs (Level 2) | Corporate issued mortgage-backed securities (MBS corporate)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	8,834
Recurring | Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Significant Unobservable Inputs (Level 3) | Municipal bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Significant Unobservable Inputs (Level 3) | Agency bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0
Recurring | Significant Unobservable Inputs (Level 3) | ABS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Significant Unobservable Inputs (Level 3) | ABS Corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0
Recurring | Significant Unobservable Inputs (Level 3) | SBA
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Significant Unobservable Inputs (Level 3) | MBS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	0	0
Recurring | Significant Unobservable Inputs (Level 3) | Corporate issued mortgage-backed securities (MBS corporate)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale	$ 0