Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended	6 Months Ended
	Jun. 30, 2013	Jun. 30, 2013	Jun. 30, 2012	Dec. 31, 2012
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		$ 7,994	$ 8,522
Charge-offs		(847)	(959)
Recoveries		229	95
Provisions for (reduction in) loan losses	322	618
Balance, at the end of the period	7,994	7,994	7,658
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans	593	593		665
Amount of allowance attributed to: General portfolio allocation	7,401	7,401	7,658
Loans individually evaluated for impairment	2,606	2,606	5,193
Specific reserves to total loans individually evaluated for impairment (as a percent)		22.76%	0.00%
Loans collectively evaluated for impairment	1,057,351	1,057,351	793,159
General reserves to total loans collectively evaluated for impairment (as a percent)		0.70%	0.97%
Total gross loans	1,059,957	1,059,957	798,352	986,194
Total allowance to gross loans (as a percent)		0.75%	0.96%
Owner Occupied Commercial Real Estate Loans, Commercial and Industrial Loans and SBA Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor		36 months
Trailing period one considered for determination of allowance for loan losses factor		24 months
Trailing period two considered for determination of allowance for loan losses factor		12 months
Annualized trailing period considered for determination of allowance for loan losses factor		6 months
Period considered for comparison of allowance for loan losses factor		10 years
Period considered for comparison of entity's allowance for loan losses factor		15 years
Trailing period considered for comparison of allowance for loan losses factor		12 months
Multi-Family and Non-Owner Occupied Commercial Real Estate Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor		36 months
Trailing period one considered for determination of allowance for loan losses factor		24 months
Trailing period two considered for determination of allowance for loan losses factor		12 months
Annualized trailing period considered for determination of allowance for loan losses factor		6 months
Period considered for comparison of allowance for loan losses factor		10 years
Period considered for comparison of entity's allowance for loan losses factor		15 years
Trailing period considered for comparison of allowance for loan losses factor		12 months
One-to-Four Family and Consumer Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor		36 months
Trailing period one considered for determination of allowance for loan losses factor		24 months
Trailing period two considered for determination of allowance for loan losses factor		12 months
Annualized trailing period considered for determination of allowance for loan losses factor		6 months
Period considered for comparison of allowance for loan losses factor		10 years
Period considered for comparison of entity's allowance for loan losses factor		15 years
Trailing period considered for comparison of allowance for loan losses factor		12 months
Single Family and Consumer Loans and Warehouse Repurchase Facilities
Allowance for Loan Losses
Period considered for comparison of allowance for loan losses factor		10 years
Period considered for comparison of entity's allowance for loan losses factor		15 years
Trailing period considered for comparison of allowance for loan losses factor		12 months
Commercial and industrial
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		1,310	1,361
Charge-offs		(58)	(191)
Recoveries		21	2
Provisions for (reduction in) loan losses		806	78
Balance, at the end of the period	2,079	2,079	1,250
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans	233	233		270
Amount of allowance attributed to: General portfolio allocation	1,846	1,846	1,250
Loans individually evaluated for impairment	308	308
Specific reserves to total loans individually evaluated for impairment (as a percent)		75.65%	0.00%
Loans collectively evaluated for impairment	145,932	145,932	84,191
General reserves to total loans collectively evaluated for impairment (as a percent)		1.26%	1.48%
Total gross loans	146,240	146,240	84,191	115,354
Total allowance to gross loans (as a percent)		1.42%	1.48%
Commercial owner occupied
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		1,512	1,119
Charge-offs			(265)
Provisions for (reduction in) loan losses		229	222
Balance, at the end of the period	1,741	1,741	1,076
Other disclosures
Amount of allowance attributed to: General portfolio allocation	1,741	1,741	1,076
Loans individually evaluated for impairment			478
Specific reserves to total loans individually evaluated for impairment (as a percent)		0.00%	0.00%
Loans collectively evaluated for impairment	201,802	201,802	149,950
General reserves to total loans collectively evaluated for impairment (as a percent)		0.86%	0.72%
Total gross loans	201,802	201,802	150,428	150,934
Total allowance to gross loans (as a percent)		0.86%	0.72%
SBA
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		79	80
Charge-offs		(5)	(109)
Recoveries		44	77
Provisions for (reduction in) loan losses		(50)	103
Balance, at the end of the period	68	68	151
Other disclosures
Amount of allowance attributed to: General portfolio allocation	68	68	151
Loans individually evaluated for impairment			549
Specific reserves to total loans individually evaluated for impairment (as a percent)		0.00%	0.00%
Loans collectively evaluated for impairment	5,820	5,820	3,446
General reserves to total loans collectively evaluated for impairment (as a percent)		1.17%	4.38%
Total gross loans	5,820	5,820	3,995	6,882
Total allowance to gross loans (as a percent)		1.17%	3.78%
Warehouse
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		1,544	1,347
Provisions for (reduction in) loan losses		(844)	(439)
Balance, at the end of the period	700	700	908
Other disclosures
Amount of allowance attributed to: General portfolio allocation	700	700	908
Specific reserves to total loans individually evaluated for impairment (as a percent)		0.00%	0.00%
Loans collectively evaluated for impairment	135,317	135,317	61,111
General reserves to total loans collectively evaluated for impairment (as a percent)		0.52%	1.49%
Total gross loans	135,317	135,317	61,111	195,761
Total allowance to gross loans (as a percent)		0.52%	1.49%
Commercial non-owner occupied
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		1,459	1,287
Charge-offs		(757)	(88)
Provisions for (reduction in) loan losses		806	468
Balance, at the end of the period	1,508	1,508	1,667
Other disclosures
Amount of allowance attributed to: General portfolio allocation	1,508	1,508	1,667
Loans individually evaluated for impairment	450	450	2,095
Specific reserves to total loans individually evaluated for impairment (as a percent)		0.00%	0.00%
Loans collectively evaluated for impairment	295,317	295,317	240,605
General reserves to total loans collectively evaluated for impairment (as a percent)		0.51%	0.69%
Total gross loans	295,767	295,767	242,700	253,409
Total allowance to gross loans (as a percent)		0.51%	0.69%
Multi-family
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		1,145	2,281
Charge-offs		(11)
Provisions for (reduction in) loan losses		(593)	3
Balance, at the end of the period	541	541	2,284
Other disclosures
Amount of allowance attributed to: General portfolio allocation	541	541	2,284
Loans individually evaluated for impairment	1,035	1,035	1,404
Specific reserves to total loans individually evaluated for impairment (as a percent)		0.00%	0.00%
Loans collectively evaluated for impairment	171,762	171,762	182,338
General reserves to total loans collectively evaluated for impairment (as a percent)		0.31%	1.25%
Total gross loans	172,797	172,797	183,742	156,424
Total allowance to gross loans (as a percent)		0.31%	1.24%
One-to-four family
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		862	931
Charge-offs		(10)	(305)
Recoveries		44	5
Provisions for (reduction in) loan losses		243	(328)
Balance, at the end of the period	1,139	1,139	303
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans	360	360		395
Amount of allowance attributed to: General portfolio allocation	779	779	303
Loans individually evaluated for impairment	813	813	667
Specific reserves to total loans individually evaluated for impairment (as a percent)		44.28%	0.00%
Loans collectively evaluated for impairment	83,859	83,859	56,027
General reserves to total loans collectively evaluated for impairment (as a percent)		0.93%	0.54%
Total gross loans	84,672	84,672	56,694	97,463
Total allowance to gross loans (as a percent)		1.35%	0.53%
Construction
Other disclosures
Specific reserves to total loans individually evaluated for impairment (as a percent)		0.00%	0.00%
Loans collectively evaluated for impairment	2,135	2,135	281
General reserves to total loans collectively evaluated for impairment (as a percent)		0.00%	0.00%
Total gross loans	2,135	2,135	281
Total allowance to gross loans (as a percent)		0.00%	0.00%
Land
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		31	39
Provisions for (reduction in) loan losses		149	(39)
Balance, at the end of the period	180	180
Other disclosures
Amount of allowance attributed to: General portfolio allocation	180	180
Specific reserves to total loans individually evaluated for impairment (as a percent)		0.00%	0.00%
Loans collectively evaluated for impairment	10,438	10,438	11,191
General reserves to total loans collectively evaluated for impairment (as a percent)		1.72%	0.00%
Total gross loans	10,438	10,438	11,191	8,774
Total allowance to gross loans (as a percent)		1.72%	0.00%
Other loans
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period		52	77
Charge-offs		(6)	(1)
Recoveries		120	11
Provisions for (reduction in) loan losses		(128)	(68)
Balance, at the end of the period	38	38	19
Other disclosures
Amount of allowance attributed to: General portfolio allocation	38	38	19
Specific reserves to total loans individually evaluated for impairment (as a percent)		0.00%	0.00%
Loans collectively evaluated for impairment	4,969	4,969	4,019
General reserves to total loans collectively evaluated for impairment (as a percent)		0.76%	0.47%
Total gross loans	$ 4,969	$ 4,969	$ 4,019	$ 1,193
Total allowance to gross loans (as a percent)		0.76%	0.47%