Loans Held for Investment (Details 6) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2013	Dec. 31, 2012	Mar. 31, 2012
Other information concerning the credit quality
Current	$ 942,975	$ 985,303	$ 693,177
30-59 Days Past Due	58	106	11
60-89 Days Past Due	1,077	303	697
90+ Days Past Due	1,881	482	1,864
Total	945,991	986,194	695,749
Non-Accruing	3,102	2,206	3,696
Business loans: Commercial and industrial
Other information concerning the credit quality
Current	140,365	115,078	83,937
30-59 Days Past Due	9		10
60-89 Days Past Due		58
90+ Days Past Due	218	218
Total	140,592	115,354	83,947
Non-Accruing	333	347	100
Business loans: Commercial owner occupied
Other information concerning the credit quality
Current	166,326	150,689	145,580
60-89 Days Past Due		245	478
90+ Days Past Due	245		846
Total	166,571	150,934	146,904
Non-Accruing	245	14	1,325
Business loans: SBA
Other information concerning the credit quality
Current	5,044	6,697	3,435
90+ Days Past Due	72	185	513
Total	5,116	6,882	3,948
Non-Accruing	121	260	544
Business loans: Warehouse facilities
Other information concerning the credit quality
Current	138,935	195,761	44,246
Total	138,935	195,761	44,246
Real estate loans: Commercial non-owner occupied
Other information concerning the credit quality
Current	254,678	253,409	168,487
90+ Days Past Due	1,337		185
Total	256,015	253,409	168,672
Non-Accruing	1,974	670	648
Real estate loans: Multi-family
Other information concerning the credit quality
Current	138,053	156,424	185,367
60-89 Days Past Due	1,047
Total	139,100	156,424	185,367
Non-Accruing		266	287
Real estate loans: One-to-four family
Other information concerning the credit quality
Current	87,021	97,283	51,741
30-59 Days Past Due	49	101
60-89 Days Past Due	30		219
90+ Days Past Due	9	79	320
Total	87,109	97,463	52,280
Non-Accruing	429	522	792
Real estate loans: Land
Other information concerning the credit quality
Current	7,863	8,774	7,246
Total	7,863	8,774	7,246
Non-Accruing		127
Other loans
Other information concerning the credit quality
Current	4,690	1,188	3,138
30-59 Days Past Due		5	1
Total	$ 4,690	$ 1,193	$ 3,139