Loans Held for Investment (Details 4) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012	Dec. 31, 2011
Other information concerning the credit quality
Current	$ 985,303	$ 733,564
30-59 Days Past Due	106	699
60-89 Days Past Due	303	731
90+ Days Past Due	482	4,260
Total	986,194	739,254
Non-Accruing	2,205	6,093
Real estate loans: Multi-family
Other information concerning the credit quality
Current	156,424	193,830
Total	156,424	193,830
Non-Accruing	266	293
Real estate loans: Commercial non-owner occupied
Other information concerning the credit quality
Current	253,409	162,663
30-59 Days Past Due		434
90+ Days Past Due		1,244
Total	253,409	164,341
Non-Accruing	670	1,495
Real estate loans: One-to-four family
Other information concerning the credit quality
Current	97,283	59,503
30-59 Days Past Due	101	201
90+ Days Past Due	79	323
Total	97,463	60,027
Non-Accruing	522	323
Real estate loans: Land
Other information concerning the credit quality
Current	8,774	5,769
60-89 Days Past Due		617
90+ Days Past Due		52
Total	8,774	6,438
Non-Accruing	127	52
Business loans: Commercial owner occupied
Other information concerning the credit quality
Current	150,689	151,380
60-89 Days Past Due	245
90+ Days Past Due		919
Total	150,934	152,299
Non-Accruing	14	2,053
Business loans: Commercial and industrial
Other information concerning the credit quality
Current	115,078	85,615
30-59 Days Past Due		12
60-89 Days Past Due	58
90+ Days Past Due	218	1,057
Total	115,354	86,684
Non-Accruing	347	1,177
Business loans: Warehouse facilities
Other information concerning the credit quality
Current	195,761	67,518
Total	195,761	67,518
Business loans: SBA
Other information concerning the credit quality
Current	6,697	3,900
30-59 Days Past Due		49
60-89 Days Past Due		113
90+ Days Past Due	185	665
Total	6,882	4,727
Non-Accruing	259	700
Other loans
Other information concerning the credit quality
Current	1,188	3,386
30-59 Days Past Due	5	3
60-89 Days Past Due		1
Total	$ 1,193	$ 3,390