Allowance for Loan and Lease Losses and Unfunded Commitments and Letters of Credit (Allowance for Loan and Lease Losses) (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2017	Sep. 30, 2016	Sep. 30, 2017	Sep. 30, 2016
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	$ 72,984	$ 69,304	$ 70,043	$ 68,172
Charged-offs	(3,258)	(4,604)	(13,091)	(17,743)
Recoveries	2,538	3,698	9,360	9,075
Provision (recapture) for loan and lease losses	(648)	1,866	5,304	10,760
Ending balance	71,616	70,264	71,616	70,264
Specific Reserve	102	1,300	102	1,300
General Allocation	71,514	68,964	71,514	68,964
Secured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	39,539	31,808	36,050	32,321
Charged-offs	(1,362)	(2,128)	(6,071)	(8,798)
Recoveries	550	787	3,750	2,126
Provision (recapture) for loan and lease losses	(969)	2,008	4,029	6,826
Ending balance	37,758	32,475	37,758	32,475
Specific Reserve	0	873	0	873
General Allocation	37,758	31,602	37,758	31,602
Unsecured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,147	1,265	960	1,299
Charged-offs	0	(31)	(18)	(75)
Recoveries	138	67	247	143
Provision (recapture) for loan and lease losses	(298)	(128)	(202)	(194)
Ending balance	987	1,173	987	1,173
Specific Reserve	0	0	0	0
General Allocation	987	1,173	987	1,173
One-to-Four Family Residential [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	628	675	599	916
Charged-offs	0	0	(460)	(35)
Recoveries	40	81	380	142
Provision (recapture) for loan and lease losses	3	221	152	(46)
Ending balance	671	977	671	977
Specific Reserve	26	353	26	353
General Allocation	645	624	645	624
Commercial Land [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	2,356	1,422	1,797	1,178
Charged-offs	0	0	0	(26)
Recoveries	45	0	45	2
Provision (recapture) for loan and lease losses	(97)	92	462	360
Ending balance	2,304	1,514	2,304	1,514
Specific Reserve	0	0	0	0
General Allocation	2,304	1,514	2,304	1,514
Income Property Multifamily [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	6,854	8,046	7,342	6,616
Charged-offs	0	0	0	0
Recoveries	9	10	104	191
Provision (recapture) for loan and lease losses	241	149	(342)	1,398
Ending balance	7,104	8,205	7,104	8,205
Specific Reserve	25	28	25	28
General Allocation	7,079	8,177	7,079	8,177
Owner Occupied [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	6,512	6,336	6,439	5,550
Charged-offs	0	0	0	0
Recoveries	4	10	114	26
Provision (recapture) for loan and lease losses	306	487	269	1,257
Ending balance	6,822	6,833	6,822	6,833
Specific Reserve	0	0	0	0
General Allocation	6,822	6,833	6,822	6,833
Land And Acquisition [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	361	587	316	339
Charged-offs	0	0	(14)	0
Recoveries	14	2	61	55
Provision (recapture) for loan and lease losses	(83)	(134)	(71)	61
Ending balance	292	455	292	455
Specific Reserve	0	0	0	0
General Allocation	292	455	292	455
Residential Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,377	1,376	669	733
Charged-offs	0	0	0	0
Recoveries	6	19	46	225
Provision (recapture) for loan and lease losses	(272)	(393)	396	44
Ending balance	1,111	1,002	1,111	1,002
Specific Reserve	0	0	0	0
General Allocation	1,111	1,002	1,111	1,002
Income Property Multifamily Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	985	904	404	388
Charged-offs	0	0	0	0
Recoveries	0	107	0	109
Provision (recapture) for loan and lease losses	279	(480)	860	34
Ending balance	1,264	531	1,264	531
Specific Reserve	0	0	0	0
General Allocation	1,264	531	1,264	531
Owner Occupied Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,382	1,384	1,192	1,006
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision (recapture) for loan and lease losses	(87)	57	103	435
Ending balance	1,295	1,441	1,295	1,441
Specific Reserve	0	0	0	0
General Allocation	1,295	1,441	1,295	1,441
Consumer Portfolio Segment [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	3,551	3,559	3,534	3,531
Charged-offs	(263)	(383)	(1,156)	(983)
Recoveries	343	399	876	765
Provision (recapture) for loan and lease losses	42	168	419	430
Ending balance	3,673	3,743	3,673	3,743
Specific Reserve	51	46	51	46
General Allocation	3,622	3,697	3,622	3,697
Purchased Credit Impaired Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	8,061	11,781	10,515	13,726
Charged-offs	(1,633)	(2,062)	(5,372)	(7,826)
Recoveries	1,389	2,216	3,737	5,291
Provision (recapture) for loan and lease losses	(473)	(433)	(1,536)	311
Ending balance	7,344	11,502	7,344	11,502
Specific Reserve	0	0	0	0
General Allocation	7,344	11,502	7,344	11,502
Unallocated Financing Receivables [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	231	161	226	569
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision (recapture) for loan and lease losses	760	252	765	(156)
Ending balance	991	413	991	413
Specific Reserve	0	0	0	0
General Allocation	$ 991	$ 413	$ 991	$ 413