Loans Receivable (Aging of recorded investment in gross loans) (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2013	Dec. 31, 2012
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due		$ 48,403
60 - 89 Days Past Due		17,483
Total Loans		1,432,161
Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	20,853	58,542
60 - 89 Days Past Due	27,309	21,441
90+ Days Past Due	84,150	138,963
Total Past Due	132,312	218,946
Current	1,647,760	1,038,782
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	2,121
Residential Related Loans [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	48,137
60 - 89 Days Past Due	23,622	20,760
90+ Days Past Due	69,237	120,710
Total Past Due	92,859	189,607
Current	662,439	615,335
Total Loans	755,298	804,942
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	2,121
Residential Related Loans [Member] | Conventional Loan [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	36,354
60 - 89 Days Past Due	17,109	15,044
90+ Days Past Due	20,213	63,875
Total Past Due	37,322	115,273
Current	550,669	518,128
Total Loans	587,991	633,401
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	515
Residential Related Loans [Member] | Conventional Loan [Member] | Originated Up To The Year 2002 [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	6,906
60 - 89 Days Past Due	2,937	2,116
90+ Days Past Due	6,993	11,363
Total Past Due	9,930	20,385
Current	79,666	80,883
Total Loans	89,596	101,268
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	6
Residential Related Loans [Member] | Conventional Loan [Member] | Originated In The Years 2003 And 2004 [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	12,048
60 - 89 Days Past Due	5,413	5,206
90+ Days Past Due	3,429	18,162
Total Past Due	8,842	35,416
Current	117,754	114,446
Total Loans	126,596	149,862
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Residential Related Loans [Member] | Conventional Loan [Member] | Originated In The Year 2005 [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	4,983
60 - 89 Days Past Due	2,136	1,746
90+ Days Past Due	1,431	8,860
Total Past Due	3,567	15,589
Current	65,196	65,312
Total Loans	68,763	80,901
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Residential Related Loans [Member] | Conventional Loan [Member] | Originated In The Year 2006 [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	9,153
60 - 89 Days Past Due	3,369	3,525
90+ Days Past Due	2,838	15,363
Total Past Due	6,207	28,041
Current	87,614	85,045
Total Loans	93,821	113,086
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Residential Related Loans [Member] | Conventional Loan [Member] | Originated In The Years 2007 2008 And 2009 [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	2,632
60 - 89 Days Past Due	2,863	1,682
90+ Days Past Due	3,407	8,965
Total Past Due	6,270	13,279
Current	104,169	108,358
Total Loans	110,439	121,637
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	433
Residential Related Loans [Member] | Conventional Loan [Member] | Originated In The Years 2010 2011 2012 And 2013 [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	632
60 - 89 Days Past Due	391	769
90+ Days Past Due	2,115	1,162
Total Past Due	2,506	2,563
Current	96,270	64,084
Total Loans	98,776	66,647
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	76
Residential Related Loans [Member] | NonTraditional Mortgage [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	2,850
60 - 89 Days Past Due	1,520	1,067
90+ Days Past Due	2,212	11,160
Total Past Due	3,732	15,077
Current	42,695	42,742
Total Loans	46,427	57,819
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Residential Related Loans [Member] | Loss Mitigation Program [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	8,933
60 - 89 Days Past Due	4,993	4,649
90+ Days Past Due	14,287	19,989
Total Past Due	19,280	33,571
Current	68,335	53,739
Total Loans	87,615	87,310
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	1,606
Residential Related Loans [Member] | Residential Mortgage [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	48,137
60 - 89 Days Past Due	23,622	20,760
90+ Days Past Due	36,712	95,024
Total Past Due	60,334	163,921
Current	661,699	614,609
Total Loans	722,033	778,530
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	2,121
Residential Related Loans [Member] | Loans And Leases Receivable Consumer Home Equity [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	0
60 - 89 Days Past Due	0	0
90+ Days Past Due	12	10
Total Past Due	12	10
Current	740	726
Total Loans	752	736
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Residential Related Loans [Member] | GNMA's Buy Back Option related | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	0	0
60 - 89 Days Past Due	0	0
90+ Days Past Due	32,513	25,676
Total Past Due	32,513	25,676
Current	0	0
Total Loans	32,513	25,676
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Commercial Loan [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	11,357	9,407
60 - 89 Days Past Due	1,447	460
90+ Days Past Due	13,447	17,713
Total Past Due	26,251	27,580
Current	675,823	326,350
Total Loans	702,074	353,930
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Commercial Loan [Member] | Commercial Secured [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	11,033	9,062
60 - 89 Days Past Due	1,381	271
90+ Days Past Due	12,694	15,335
Total Past Due	25,108	24,668
Current	386,236	226,606
Total Loans	411,344	251,274
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Commercial Loan [Member] | Other commercial [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	324	345
60 - 89 Days Past Due	66	189
90+ Days Past Due	753	2,378
Total Past Due	1,143	2,912
Current	289,587	99,744
Total Loans	290,730	102,656
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Consumer Loan [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	660	747
60 - 89 Days Past Due	156	92
Total Loans	89,608	48,136
Consumer Loan [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	670	747
60 - 89 Days Past Due	165	92
90+ Days Past Due	370	409
Total Past Due	1,205	1,248
Current	88,403	46,888
Total Loans	89,608	48,136
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Consumer Loans Auto Financing Receivable Member
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	8,826
60 - 89 Days Past Due	2,075
Total Loans	233,092
Consumer Loans Auto Financing Receivable Member | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	8,826	251
60 - 89 Days Past Due	2,075	129
90+ Days Past Due	1,096	131
Total Past Due	11,997	511
Current	221,095	50,209
Total Loans	233,092	50,720
Financing Receivable Recorded Investment 90 Days Past Due And Stil lAccruing	0
Consumer Loans Auto Financing Receivable Member | Automobile Loan
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due		251
60 - 89 Days Past Due		129
Total Loans		50,720
Most recent acquired loans accounted under ASC 310-20
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	10,616	7,735
60 - 89 Days Past Due	1,899	1,023
Total Loans	436,339	528,363
Most recent acquired loans accounted under ASC 310-20 | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	10,916	8,765
60 - 89 Days Past Due	2,033	1,099
90+ Days Past Due	2,236	1,563
Total Past Due	15,185	11,427
Current	575,906	861,804
Most recent acquired loans accounted under ASC 310-20 | Other commercial [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	291	715
60 - 89 Days Past Due	134	76
90+ Days Past Due	493	193
Total Past Due	918	984
Current	139,316	316,260
Total Loans	140,234	317,244
Most recent acquired loans accounted under ASC 310-20 | Automobile Loan
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	8,849	6,753
60 - 89 Days Past Due	1,892	1,023
Total Loans	373,588	457,894
Most recent acquired loans accounted under ASC 310-20 | Automobile Loan | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	8,849	6,753
60 - 89 Days Past Due	1,892	1,023
90+ Days Past Due	674	275
Total Past Due	11,415	8,051
Current	362,172	449,843
Total Loans	373,587	457,894
Most recent acquired loans accounted under ASC 310-20 | Consumer Loan [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	1,767	982
60 - 89 Days Past Due	7	0
Total Loans	62,751	68,878
Most recent acquired loans accounted under ASC 310-20 | lines of credit and credit cards [Member] | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	1,767	982
60 - 89 Days Past Due	7	0
90+ Days Past Due	1,069	1,095
Total Past Due	2,843	2,077
Current	59,908	66,801
Total Loans	62,751	68,878
Most recent acquired loans accounted under ASC 310-20 | Commercial Real Estate and Construction | Loans and Leases Held for Investment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
30 - 59 Days Past Due	9	315
60 - 89 Days Past Due	0	0
90+ Days Past Due	0	0
Total Past Due	9	315
Current	14,510	28,900
Total Loans	$ 14,519	$ 29,215