Business Combinations - Schedule of Business Acquisition, Consideration Paid, Assets Acquired and Liabilities Assumed - Bank of Commerce (Details) - USD ($) $ in Thousands	Jul. 31, 2014	Jun. 30, 2017	Jun. 30, 2016	Jun. 30, 2015	Jun. 30, 2014	Jun. 30, 2013
Assets
Cash and cash equivalents		$ 86,985	$ 52,596	$ 116,160	$ 45,830
Securities available for sale, at fair value		199,667	200,652
Real estate owned (REO)		6,318	5,956		$ 7,024
Premises and equipment, net		63,648	54,231
Accrued interest receivable		8,758	7,405
Deferred income taxes		63,329	61,513
Core deposit intangibles		7,173	7,136
Other assets		7,560	4,838
Total Assets		3,206,533	2,717,677
Liabilities
Deposits		2,048,451	1,802,696
Borrowings		696,500	491,000
Other liabilities		61,998	62,047
Liabilities		2,808,886	2,357,701
Goodwill		$ 25,638	$ 12,673			$ 12,673
Bank of Commerce
Consideration Paid
Cash paid as deposit premium	$ 10,000
Total consideration	10,000
Assets
Cash and cash equivalents	2,241
Fair value adjustments, cash and cash equivalents	0
Cash and cash equivalents	2,241
Securities available for sale, at fair value	24,228
Fair value adjustments, securities available for sale	0
Securities available for sale	24,228
Loans, net of allowance	89,339
Fair value adjustments, loans net of allowance	(2,855)
Loans, net of allowance	86,484
FHLB Stock	791
Fair value adjustments, FHLB stock	0
FHLB Stock	791
Real estate owned (REO)	224
Fair value adjustments, REO	(14)
REO	210
Premises and equipment, net	135
Fair value adjustments, premises and equipment, net	0
Premises and equipment, net	135
Accrued interest receivable	355
Fair value adjustments, accrued interest receivable	(100)
Accrued interest receivable	255
Deferred income taxes	286
Fair value adjustments, deferred income tax	2,839
Deferred income taxes	3,125
Core deposit intangibles	0
Fair value adjustments, core deposit intangibles	640
Core deposit intangibles	640
Other assets	4,931
Fair value adjustments, other assets	(6)
Other assets	4,925
Total Assets	122,530
Fair value adjustments, total assets	504
Total assets acquired	123,034
Liabilities
Deposits	93,303
Fair value adjustments, deposits	112
Deposits	93,415
Borrowings	15,000
Fair value adjustments, borrowings	172
Borrowings	15,172
Other liabilities	6,369
Fair value adjustments, other liabilities	0
Other liabilities	6,369
Liabilities	114,672
Fair value adjustments, total liabilities	284
Total liabilities assumed	114,956
Net identifiable assets acquired over liabilities assumed	7,858
Fair value adjustments, net identifiable assets acquired over liabilities assumed	220
Net identifiable assets acquired over liabilities assumed	8,078
Goodwill	$ 1,922