Allowance for Loan and Lease Losses and Unfunded Commitments and Letters of Credit (Allowance for Loan and Lease Losses) (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2019	Jun. 30, 2018	Jun. 30, 2019	Jun. 30, 2018
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	$ 83,274	$ 79,827	$ 83,369	$ 75,646
Charged-offs	(5,287)	(7,242)	(8,275)	(11,549)
Recoveries	2,312	3,590	3,843	6,226
Provision for loan and lease losses	218	3,975	1,580	9,827
Ending balance	80,517	80,150	80,517	80,150
Specific Reserve	1,475	256	1,475	256
General Allocation	79,042	79,894	79,042	79,894
Secured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	43,617	37,331	43,188	29,341
Charged-offs	(4,103)	(5,751)	(5,352)	(8,165)
Recoveries	515	1,487	838	2,040
Provision for loan and lease losses	(2,167)	7,283	(812)	17,134
Ending balance	37,862	40,350	37,862	40,350
Specific Reserve	740	67	740	67
General Allocation	37,122	40,283	37,122	40,283
Unsecured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	2,495	2,595	2,626	2,000
Charged-offs	(15)	(24)	(15)	(87)
Recoveries	32	56	189	305
Provision for loan and lease losses	498	(184)	210	225
Ending balance	3,010	2,443	3,010	2,443
Specific Reserve	0	0	0	0
General Allocation	3,010	2,443	3,010	2,443
One-to-Four Family Residential [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	616	558	593	701
Charged-offs	0	0	(2)	0
Recoveries	20	196	37	368
Provision for loan and lease losses	9	(293)	17	(608)
Ending balance	645	461	645	461
Specific Reserve	6	8	6	8
General Allocation	639	453	639	453
Commercial Land [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,588	3,745	3,947	4,265
Charged-offs	0	0	0	0
Recoveries	7	78	14	84
Provision for loan and lease losses	814	(545)	1,448	(1,071)
Ending balance	5,409	3,278	5,409	3,278
Specific Reserve	666	0	666	0
General Allocation	4,743	3,278	4,743	3,278
Income Property Multifamily [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,018	4,702	4,044	5,672
Charged-offs	0	0	0	(223)
Recoveries	25	558	48	699
Provision for loan and lease losses	282	(1,158)	1,233	(2,046)
Ending balance	5,325	4,102	5,325	4,102
Specific Reserve	0	0	0	0
General Allocation	5,325	4,102	5,325	4,102
Owner Occupied [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,966	4,749	4,533	5,459
Charged-offs	0	0	0	0
Recoveries	1	4	2	16
Provision for loan and lease losses	263	(397)	695	(1,119)
Ending balance	5,230	4,356	5,230	4,356
Specific Reserve	43	86	43	86
General Allocation	5,187	4,270	5,187	4,270
Land And Acquisition [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	407	912	549	963
Charged-offs	0	0	0	0
Recoveries	72	12	131	28
Provision for loan and lease losses	(326)	(76)	(527)	(143)
Ending balance	153	848	153	848
Specific Reserve	0	0	0	0
General Allocation	153	848	153	848
Residential Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,466	4,636	5,536	3,709
Charged-offs	0	0	(170)	0
Recoveries	589	2	590	5
Provision for loan and lease losses	48	(66)	147	858
Ending balance	6,103	4,572	6,103	4,572
Specific Reserve	0	0	0	0
General Allocation	6,103	4,572	6,103	4,572
Income Property Multifamily Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,517	7,474	5,784	7,053
Charged-offs	0	0	0	0
Recoveries	1	0	1	0
Provision for loan and lease losses	(320)	(107)	(1,587)	314
Ending balance	4,198	7,367	4,198	7,367
Specific Reserve	0	0	0	0
General Allocation	4,198	7,367	4,198	7,367
Owner Occupied Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	2,220	1,923	2,604	4,413
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	192	376	(192)	(2,114)
Ending balance	2,412	2,299	2,412	2,299
Specific Reserve	0	0	0	0
General Allocation	2,412	2,299	2,412	2,299
Consumer Portfolio Segment [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,545	5,216	5,301	5,163
Charged-offs	(354)	(232)	(832)	(496)
Recoveries	178	270	416	530
Provision for loan and lease losses	(175)	38	309	95
Ending balance	5,194	5,292	5,194	5,292
Specific Reserve	20	95	20	95
General Allocation	5,174	5,197	5,174	5,197
Purchased Credit Impaired Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	3,245	5,665	3,611	6,907
Charged-offs	(815)	(1,235)	(1,904)	(2,578)
Recoveries	872	927	1,577	2,151
Provision for loan and lease losses	(33)	(575)	(15)	(1,698)
Ending balance	3,269	4,782	3,269	4,782
Specific Reserve	0	0	0	0
General Allocation	3,269	4,782	3,269	4,782
Unallocated Financing Receivables [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	574	321	1,053	0
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	1,133	(321)	654	0
Ending balance	1,707	0	1,707	0
Specific Reserve	0	0	0	0
General Allocation	$ 1,707	$ 0	$ 1,707	$ 0