Allowance for Loan and Lease Losses and Unfunded Commitments and Letters of Credit (Allowance for Loan and Lease Losses) (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2018	Jun. 30, 2017	Jun. 30, 2018	Jun. 30, 2017
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	$ 79,827	$ 71,021	$ 75,646	$ 70,043
Charged-offs	(7,242)	(6,018)	(11,549)	(9,833)
Recoveries	3,590	4,804	6,226	6,822
Provision for loan and lease losses	3,975	3,177	9,827	5,952
Ending balance	80,150	72,984	80,150	72,984
Specific Reserve	256	3,499	256	3,499
General Allocation	79,894	69,485	79,894	69,485
Secured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	37,331	35,672	29,341	36,050
Charged-offs	(5,751)	(3,600)	(8,165)	(4,709)
Recoveries	1,487	2,903	2,040	3,200
Provision for loan and lease losses	7,283	4,564	17,134	4,998
Ending balance	40,350	39,539	40,350	39,539
Specific Reserve	67	3,425	67	3,425
General Allocation	40,283	36,114	40,283	36,114
Unsecured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	2,595	1,188	2,000	960
Charged-offs	(24)	0	(87)	(18)
Recoveries	56	41	305	109
Provision for loan and lease losses	(184)	(82)	225	96
Ending balance	2,443	1,147	2,443	1,147
Specific Reserve	0	0	0	0
General Allocation	2,443	1,147	2,443	1,147
One-to-Four Family Residential [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	558	645	701	599
Charged-offs	0	(153)	0	(460)
Recoveries	196	223	368	340
Provision for loan and lease losses	(293)	(87)	(608)	149
Ending balance	461	628	461	628
Specific Reserve	8	4	8	4
General Allocation	453	624	453	624
Commercial Land [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	3,745	2,288	4,265	1,797
Charged-offs	0	0	0	0
Recoveries	78	0	84	0
Provision for loan and lease losses	(545)	68	(1,071)	559
Ending balance	3,278	2,356	3,278	2,356
Specific Reserve	0	0	0	0
General Allocation	3,278	2,356	3,278	2,356
Income Property Multifamily [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,702	6,803	5,672	7,342
Charged-offs	0	0	(223)	0
Recoveries	558	60	699	95
Provision for loan and lease losses	(1,158)	(9)	(2,046)	(583)
Ending balance	4,102	6,854	4,102	6,854
Specific Reserve	0	25	0	25
General Allocation	4,102	6,829	4,102	6,829
Owner Occupied [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,749	6,534	5,459	6,439
Charged-offs	0	0	0	0
Recoveries	4	67	16	110
Provision for loan and lease losses	(397)	(89)	(1,119)	(37)
Ending balance	4,356	6,512	4,356	6,512
Specific Reserve	86	0	86	0
General Allocation	4,270	6,512	4,270	6,512
Land And Acquisition [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	912	509	963	316
Charged-offs	0	0	0	(14)
Recoveries	12	27	28	47
Provision for loan and lease losses	(76)	(175)	(143)	12
Ending balance	848	361	848	361
Specific Reserve	0	0	0	0
General Allocation	848	361	848	361
Residential Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,636	1,109	3,709	669
Charged-offs	0	0	0	0
Recoveries	2	31	5	40
Provision for loan and lease losses	(66)	237	858	668
Ending balance	4,572	1,377	4,572	1,377
Specific Reserve	0	0	0	0
General Allocation	4,572	1,377	4,572	1,377
Income Property Multifamily Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	7,474	782	7,053	404
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	(107)	203	314	581
Ending balance	7,367	985	7,367	985
Specific Reserve	0	0	0	0
General Allocation	7,367	985	7,367	985
Owner Occupied Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,923	1,768	4,413	1,192
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	376	(386)	(2,114)	190
Ending balance	2,299	1,382	2,299	1,382
Specific Reserve	0	0	0	0
General Allocation	2,299	1,382	2,299	1,382
Consumer Portfolio Segment [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,216	3,360	5,163	3,534
Charged-offs	(232)	(465)	(496)	(893)
Recoveries	270	248	530	533
Provision for loan and lease losses	38	408	95	377
Ending balance	5,292	3,551	5,292	3,551
Specific Reserve	95	45	95	45
General Allocation	5,197	3,506	5,197	3,506
Purchased Credit Impaired Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,665	9,395	6,907	10,515
Charged-offs	(1,235)	(1,800)	(2,578)	(3,739)
Recoveries	927	1,204	2,151	2,348
Provision for loan and lease losses	(575)	(738)	(1,698)	(1,063)
Ending balance	4,782	8,061	4,782	8,061
Specific Reserve	0	0	0	0
General Allocation	4,782	8,061	4,782	8,061
Unallocated Financing Receivables [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	321	968	0	226
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	(321)	(737)	0	5
Ending balance	0	231	0	231
Specific Reserve	0	0	0	0
General Allocation	$ 0	$ 231	$ 0	$ 231