Allowance for Loan and Lease Losses and Unfunded Commitments and Letters of Credit (Allowance for Loan and Lease Losses) (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2018	Sep. 30, 2017	Sep. 30, 2018	Sep. 30, 2017
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	$ 80,150	$ 72,984	$ 75,646	$ 70,043
Charged-offs	(2,091)	(3,258)	(13,640)	(13,091)
Recoveries	2,575	2,538	8,801	9,360
Provision (recapture) for loan and lease losses	3,153	(648)	12,980	5,304
Ending balance	83,787	71,616	83,787	71,616
Specific Reserve	1,255	102	1,255	102
General Allocation	82,532	71,514	82,532	71,514
Secured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	40,350	39,539	29,341	36,050
Charged-offs	(576)	(1,362)	(8,741)	(6,071)
Recoveries	496	550	2,536	3,750
Provision (recapture) for loan and lease losses	2,912	(969)	20,046	4,029
Ending balance	43,182	37,758	43,182	37,758
Specific Reserve	1,139	0	1,139	0
General Allocation	42,043	37,758	42,043	37,758
Unsecured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	2,443	1,147	2,000	960
Charged-offs	(30)	0	(117)	(18)
Recoveries	51	138	356	247
Provision (recapture) for loan and lease losses	(41)	(298)	184	(202)
Ending balance	2,423	987	2,423	987
Specific Reserve	0	0	0	0
General Allocation	2,423	987	2,423	987
One-to-Four Family Residential [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	461	628	701	599
Charged-offs	0	0	0	(460)
Recoveries	21	40	389	380
Provision (recapture) for loan and lease losses	(110)	3	(718)	152
Ending balance	372	671	372	671
Specific Reserve	8	26	8	26
General Allocation	364	645	364	645
Commercial Land [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	3,278	2,356	4,265	1,797
Charged-offs	0	0	0	0
Recoveries	8	45	92	45
Provision (recapture) for loan and lease losses	(87)	(97)	(1,158)	462
Ending balance	3,199	2,304	3,199	2,304
Specific Reserve	0	0	0	0
General Allocation	3,199	2,304	3,199	2,304
Income Property Multifamily [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,102	6,854	5,672	7,342
Charged-offs	0	0	(223)	0
Recoveries	202	9	901	104
Provision (recapture) for loan and lease losses	(292)	241	(2,338)	(342)
Ending balance	4,012	7,104	4,012	7,104
Specific Reserve	1	25	1	25
General Allocation	4,011	7,079	4,011	7,079
Owner Occupied [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,356	6,512	5,459	6,439
Charged-offs	0	0	0	0
Recoveries	3	4	19	114
Provision (recapture) for loan and lease losses	316	306	(803)	269
Ending balance	4,675	6,822	4,675	6,822
Specific Reserve	71	0	71	0
General Allocation	4,604	6,822	4,604	6,822
Land And Acquisition [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	848	361	963	316
Charged-offs	0	0	0	(14)
Recoveries	582	14	610	61
Provision (recapture) for loan and lease losses	(742)	(83)	(885)	(71)
Ending balance	688	292	688	292
Specific Reserve	0	0	0	0
General Allocation	688	292	688	292
Residential Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,572	1,377	3,709	669
Charged-offs	0	0	0	0
Recoveries	1	6	6	46
Provision (recapture) for loan and lease losses	660	(272)	1,518	396
Ending balance	5,233	1,111	5,233	1,111
Specific Reserve	0	0	0	0
General Allocation	5,233	1,111	5,233	1,111
Income Property Multifamily Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	7,367	985	7,053	404
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision (recapture) for loan and lease losses	573	279	887	860
Ending balance	7,940	1,264	7,940	1,264
Specific Reserve	0	0	0	0
General Allocation	7,940	1,264	7,940	1,264
Owner Occupied Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	2,299	1,382	4,413	1,192
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision (recapture) for loan and lease losses	138	(87)	(1,976)	103
Ending balance	2,437	1,295	2,437	1,295
Specific Reserve	0	0	0	0
General Allocation	2,437	1,295	2,437	1,295
Consumer Portfolio Segment [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,292	3,551	5,163	3,534
Charged-offs	(277)	(263)	(773)	(1,156)
Recoveries	266	343	796	876
Provision (recapture) for loan and lease losses	(258)	42	(163)	419
Ending balance	5,023	3,673	5,023	3,673
Specific Reserve	36	51	36	51
General Allocation	4,987	3,622	4,987	3,622
Purchased Credit Impaired Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,782	8,061	6,907	10,515
Charged-offs	(1,208)	(1,633)	(3,786)	(5,372)
Recoveries	945	1,389	3,096	3,737
Provision (recapture) for loan and lease losses	(502)	(473)	(2,200)	(1,536)
Ending balance	4,017	7,344	4,017	7,344
Specific Reserve	0	0	0	0
General Allocation	4,017	7,344	4,017	7,344
Unallocated Financing Receivables [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	0	231	0	226
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision (recapture) for loan and lease losses	586	760	586	765
Ending balance	586	991	586	991
Specific Reserve	0	0	0	0
General Allocation	$ 586	$ 991	$ 586	$ 991