Loans Held for Investment (Details 6) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2012	Dec. 31, 2011	Jun. 30, 2011
Other information concerning the credit quality
Current	$ 791,645	$ 733,564	$ 697,579
30-59 Days Past Due	399	699	2,556
60-89 Days Past Due	2,885	731	3,262
90+ Days Past Due	3,423	4,260	7,795
Total	798,352	739,254	711,192
Non-Accruing	8,426	6,093	10,888
Real estate loans: Multi-family
Other information concerning the credit quality
Current	180,907	193,830	228,899
60-89 Days Past Due	2,835
90+ Days Past Due			2,705
Total	183,742	193,830	231,604
Non-Accruing	3,115	293	3,011
Real estate loans: Commercial non-owner occupied
Other information concerning the credit quality
Current	241,290	162,663	153,280
30-59 Days Past Due	259	434	328
60-89 Days Past Due			989
90+ Days Past Due	1,151	1,244	822
Total	242,700	164,341	155,419
Non-Accruing	2,094	1,495	2,502
Real estate loans: One-to-four family
Other information concerning the credit quality
Current	56,588	59,503	63,591
30-59 Days Past Due	93	201	116
60-89 Days Past Due			518
90+ Days Past Due	13	323	325
Total	56,694	60,027	64,550
Non-Accruing	486	323	332
Real estate loans: Construction
Other information concerning the credit quality
Current	281
Total	281
Real estate loans: Land
Other information concerning the credit quality
Current	10,934	5,769	8,433
30-59 Days Past Due			62
60-89 Days Past Due		617
90+ Days Past Due	257	52	257
Total	11,191	6,438	8,752
Non-Accruing	691	52	257
Business loans: Commercial owner occupied
Other information concerning the credit quality
Current	148,900	151,380	142,756
30-59 Days Past Due			852
60-89 Days Past Due			1,709
90+ Days Past Due	1,528	919	1,869
Total	150,428	152,299	147,186
Non-Accruing	1,528	2,053	1,869
Business loans: Commercial and industrial
Other information concerning the credit quality
Current	84,141	85,615	68,557
30-59 Days Past Due		12	1,089
60-89 Days Past Due	50		20
90+ Days Past Due		1,057	1,078
Total	84,191	86,684	70,744
Non-Accruing	9	1,177	2,063
Business loans: Warehouse facilities
Other information concerning the credit quality
Current	61,111	67,518	21,758
Total	61,111	67,518	21,758
Business loans: SBA
Other information concerning the credit quality
Current	3,475	3,900	3,890
30-59 Days Past Due	46	49	72
60-89 Days Past Due		113
90+ Days Past Due	474	665	720
Total	3,995	4,727	4,682
Non-Accruing	503	700	834
Other loans
Other information concerning the credit quality
Current	4,018	3,386	6,415
30-59 Days Past Due	1	3	37
60-89 Days Past Due		1	26
90+ Days Past Due			19
Total	4,019	3,390	6,497
Non-Accruing			$ 20