Allowance for Loan and Lease Losses and Unfunded Commitments and Letters of Credit (Allowance for Loan and Lease Losses) (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2019	Sep. 30, 2018	Sep. 30, 2019	Sep. 30, 2018
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	$ 80,517	$ 80,150	$ 83,369	$ 75,646
Charged-offs	(3,372)	(2,091)	(11,647)	(13,640)
Recoveries	5,216	2,575	9,059	8,801
Provision for loan and lease losses	299	3,153	1,879	12,980
Ending balance	82,660	83,787	82,660	83,787
Specific Reserve	2,326	1,255	2,326	1,255
General Allocation	80,334	82,532	80,334	82,532
Secured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	37,862	40,350	43,188	29,341
Charged-offs	(2,365)	(576)	(7,717)	(8,741)
Recoveries	202	496	1,040	2,536
Provision for loan and lease losses	5,721	2,912	4,909	20,046
Ending balance	41,420	43,182	41,420	43,182
Specific Reserve	1,879	1,139	1,879	1,139
General Allocation	39,541	42,043	39,541	42,043
Unsecured Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	3,010	2,443	2,626	2,000
Charged-offs	0	(30)	(15)	(117)
Recoveries	156	51	345	356
Provision for loan and lease losses	423	(41)	633	184
Ending balance	3,589	2,423	3,589	2,423
Specific Reserve	0	0	0	0
General Allocation	3,589	2,423	3,589	2,423
One-to-Four Family Residential [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	645	461	593	701
Charged-offs	0	0	(2)	0
Recoveries	65	21	102	389
Provision for loan and lease losses	(107)	(110)	(90)	(718)
Ending balance	603	372	603	372
Specific Reserve	5	8	5	8
General Allocation	598	364	598	364
Commercial Land [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,409	3,278	3,947	4,265
Charged-offs	0	0	0	0
Recoveries	79	8	93	92
Provision for loan and lease losses	560	(87)	2,008	(1,158)
Ending balance	6,048	3,199	6,048	3,199
Specific Reserve	320	0	320	0
General Allocation	5,728	3,199	5,728	3,199
Income Property Multifamily [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,325	4,102	4,044	5,672
Charged-offs	0	0	0	(223)
Recoveries	104	202	152	901
Provision for loan and lease losses	35	(292)	1,268	(2,338)
Ending balance	5,464	4,012	5,464	4,012
Specific Reserve	0	1	0	1
General Allocation	5,464	4,011	5,464	4,011
Owner Occupied [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,230	4,356	4,533	5,459
Charged-offs	0	0	0	0
Recoveries	1	3	3	19
Provision for loan and lease losses	500	316	1,195	(803)
Ending balance	5,731	4,675	5,731	4,675
Specific Reserve	105	71	105	71
General Allocation	5,626	4,604	5,626	4,604
Land And Acquisition [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	153	848	549	963
Charged-offs	0	0	0	0
Recoveries	105	582	236	610
Provision for loan and lease losses	(124)	(742)	(651)	(885)
Ending balance	134	688	134	688
Specific Reserve	0	0	0	0
General Allocation	134	688	134	688
Residential Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	6,103	4,572	5,536	3,709
Charged-offs	0	0	(170)	0
Recoveries	2,366	1	2,956	6
Provision for loan and lease losses	(2,852)	660	(2,705)	1,518
Ending balance	5,617	5,233	5,617	5,233
Specific Reserve	0	0	0	0
General Allocation	5,617	5,233	5,617	5,233
Income Property Multifamily Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	4,198	7,367	5,784	7,053
Charged-offs	0	0	0	0
Recoveries	0	0	1	0
Provision for loan and lease losses	(505)	573	(2,092)	887
Ending balance	3,693	7,940	3,693	7,940
Specific Reserve	0	0	0	0
General Allocation	3,693	7,940	3,693	7,940
Owner Occupied Construction [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	2,412	2,299	2,604	4,413
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	595	138	403	(1,976)
Ending balance	3,007	2,437	3,007	2,437
Specific Reserve	0	0	0	0
General Allocation	3,007	2,437	3,007	2,437
Consumer Portfolio Segment [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	5,194	5,292	5,301	5,163
Charged-offs	(285)	(277)	(1,117)	(773)
Recoveries	326	266	742	796
Provision for loan and lease losses	(1,010)	(258)	(701)	(163)
Ending balance	4,225	5,023	4,225	5,023
Specific Reserve	17	36	17	36
General Allocation	4,208	4,987	4,208	4,987
Purchased Credit Impaired Loans [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	3,269	4,782	3,611	6,907
Charged-offs	(722)	(1,208)	(2,626)	(3,786)
Recoveries	1,812	945	3,389	3,096
Provision for loan and lease losses	(1,301)	(502)	(1,316)	(2,200)
Ending balance	3,058	4,017	3,058	4,017
Specific Reserve	0	0	0	0
General Allocation	3,058	4,017	3,058	4,017
Unallocated Financing Receivables [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Beginning balance	1,707	0	1,053	0
Charged-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for loan and lease losses	(1,636)	586	(982)	586
Ending balance	71	586	71	586
Specific Reserve	0	0	0	0
General Allocation	$ 71	$ 586	$ 71	$ 586