Allowance for Loan and Lease Losses and Unfunded Commitments and Letters of Credit (Allowance for Loan and Lease Losses) (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2016	Sep. 30, 2015	Sep. 30, 2016	Sep. 30, 2015
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	$ 69,304	$ 69,257	$ 68,172	$ 69,569
Charged-offs	(4,604)	(6,277)	(17,743)	(18,315)
Recoveries	3,698	3,238	9,075	11,553
Provision for loan and lease losses	1,866	2,831	10,760	6,242
Ending balance	70,264	69,049	70,264	69,049
Specific Reserve	1,300	1,199	1,300	1,199
General Allocation	68,964	67,850	68,964	67,850
Secured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	31,808	27,708	32,321	25,923
Charged-offs	(2,128)	(2,439)	(8,798)	(5,847)
Recoveries	787	530	2,126	1,242
Provision for loan and lease losses	2,008	5,189	6,826	9,670
Ending balance	32,475	30,988	32,475	30,988
Specific Reserve	873	1,020	873	1,020
General Allocation	31,602	29,968	31,602	29,968
Unsecured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,265	857	1,299	927
Charged-offs	(31)	(131)	(75)	(235)
Recoveries	67	93	143	208
Provision for loan and lease losses	(128)	471	(194)	390
Ending balance	1,173	1,290	1,173	1,290
Specific Reserve	0	0	0	0
General Allocation	1,173	1,290	1,173	1,290
One-to-Four Family Residential [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	675	1,355	916	2,281
Charged-offs	0	0	(35)	(297)
Recoveries	81	261	142	288
Provision for loan and lease losses	221	(420)	(46)	(1,076)
Ending balance	977	1,196	977	1,196
Specific Reserve	353	84	353	84
General Allocation	624	1,112	624	1,112
Commercial Land [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,422	1,581	1,178	799
Charged-offs	0	0	(26)	0
Recoveries	0	130	2	130
Provision for loan and lease losses	92	123	360	905
Ending balance	1,514	1,834	1,514	1,834
Specific Reserve	0	0	0	0
General Allocation	1,514	1,834	1,514	1,834
Income Property Multifamily [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	8,046	8,197	6,616	9,159
Charged-offs	0	(83)	0	(126)
Recoveries	10	273	191	3,532
Provision for loan and lease losses	149	22	1,398	(4,156)
Ending balance	8,205	8,409	8,205	8,409
Specific Reserve	28	0	28	0
General Allocation	8,177	8,409	8,177	8,409
Owner Occupied [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	6,336	5,801	5,550	5,007
Charged-offs	0	(115)	0	(115)
Recoveries	10	14	26	36
Provision for loan and lease losses	487	473	1,257	1,245
Ending balance	6,833	6,173	6,833	6,173
Specific Reserve	0	17	0	17
General Allocation	6,833	6,156	6,833	6,156
Land And Acquisition [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	587	497	339	1,197
Charged-offs	0	0	0	0
Recoveries	2	98	55	101
Provision for loan and lease losses	(134)	(206)	61	(909)
Ending balance	455	389	455	389
Specific Reserve	0	64	0	64
General Allocation	455	325	455	325
Residential Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,376	958	733	1,860
Charged-offs	0	0	0	0
Recoveries	19	7	225	40
Provision for loan and lease losses	(393)	(250)	44	(1,185)
Ending balance	1,002	715	1,002	715
Specific Reserve	0	0	0	0
General Allocation	1,002	715	1,002	715
Income Property Multifamily Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	904	407	388	622
Charged-offs	0	0	0	0
Recoveries	107	2	109	7
Provision for loan and lease losses	(480)	(68)	34	(288)
Ending balance	531	341	531	341
Specific Reserve	0	0	0	0
General Allocation	531	341	531	341
Owner Occupied Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,384	441	1,006	434
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	57	(31)	435	(24)
Ending balance	1,441	410	1,441	410
Specific Reserve	0	0	0	0
General Allocation	1,441	410	1,441	410
Consumer Portfolio Segment [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	3,559	3,182	3,531	3,180
Charged-offs	(383)	(311)	(983)	(1,521)
Recoveries	399	297	765	707
Provision for loan and lease losses	168	49	430	851
Ending balance	3,743	3,217	3,743	3,217
Specific Reserve	46	14	46	14
General Allocation	3,697	3,203	3,697	3,203
Purchased Credit Impaired Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	11,781	16,174	13,726	16,336
Charged-offs	(2,062)	(3,198)	(7,826)	(10,174)
Recoveries	2,216	1,533	5,291	5,262
Provision for loan and lease losses	(433)	(519)	311	2,566
Ending balance	11,502	13,990	11,502	13,990
Specific Reserve	0	0	0	0
General Allocation	11,502	13,990	11,502	13,990
Unallocated Financing Receivables [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	161	2,099	569	1,844
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	252	(2,002)	(156)	(1,747)
Ending balance	413	97	413	97
Specific Reserve	0	0	0	0
General Allocation	$ 413	$ 97	$ 413	$ 97