Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended
	Sep. 30, 2014	Sep. 30, 2013	Sep. 30, 2014	Sep. 30, 2013	Dec. 31, 2013
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			$ 8,200	$ 7,994
Charge-offs			(783)	(1,608)
Recoveries			87	344
Provisions for (reduction in) loan losses	1,284	646	3,263	1,264
Balance, at the end of the period	10,767	7,994	10,767	7,994
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans		104		104	105
Amount of allowance attributed to: General portfolio allocation	10,767	7,890	10,767	7,890
Loans individually evaluated for impairment	1,807	1,161	1,807	1,161
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	8.96%
Loans collectively evaluated for impairment	1,546,104	1,140,854	1,546,104	1,140,854
General reserves to total loans collectively evaluated for impairment (as a percent)			0.70%	0.69%
Total gross loans	1,547,911	1,142,015	1,547,911	1,142,015	1,243,252
Total allowance to gross loans (as a percent)			0.70%	0.70%
Owner Occupied Commercial Real Estate Loans, Commercial and Industrial Loans and SBA Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor			36 months
Trailing period one considered for determination of allowance for loan losses factor			24 months
Trailing period two considered for determination of allowance for loan losses factor			12 months
Annualized trailing period considered for determination of allowance for loan losses factor			6 months
Period considered for comparison of allowance for loan losses factor			10 years
Period considered for comparison of entity's allowance for loan losses factor			15 years
Trailing period considered for comparison of allowance for loan losses factor			12 months
Multi-Family and Non-Owner Occupied Commercial Real Estate Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor			36 months
Trailing period one considered for determination of allowance for loan losses factor			24 months
Trailing period two considered for determination of allowance for loan losses factor			12 months
Annualized trailing period considered for determination of allowance for loan losses factor			6 months
Period considered for comparison of allowance for loan losses factor			10 years
Period considered for comparison of entity's allowance for loan losses factor			15 years
Trailing period considered for comparison of allowance for loan losses factor			12 months
One-to-Four Family and Consumer Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor			36 months
Trailing period one considered for determination of allowance for loan losses factor			24 months
Trailing period two considered for determination of allowance for loan losses factor			12 months
Annualized trailing period considered for determination of allowance for loan losses factor			6 months
Period considered for comparison of allowance for loan losses factor			10 years
Period considered for comparison of entity's allowance for loan losses factor			15 years
Trailing period considered for comparison of allowance for loan losses factor			12 months
Commercial and industrial
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			1,968	1,310
Charge-offs			(223)	(291)
Recoveries			(33)	107
Provisions for (reduction in) loan losses			1,597	1,675
Balance, at the end of the period	3,375	2,801	3,375	2,801
Other disclosures
Amount of allowance attributed to: General portfolio allocation	3,375	2,801	3,375	2,801
Loans individually evaluated for impairment		68		68
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	360,700	173,652	360,700	173,652
General reserves to total loans collectively evaluated for impairment (as a percent)			0.94%	1.61%
Total gross loans	360,700	173,720	360,700	173,720	187,035
Total allowance to gross loans (as a percent)			0.94%	1.61%
Commercial owner occupied
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			1,818	1,512
Charge-offs				(163)
Provisions for (reduction in) loan losses			38	170
Balance, at the end of the period	1,856	1,519	1,856	1,519
Other disclosures
Amount of allowance attributed to: General portfolio allocation	1,856	1,519	1,856	1,519
Loans individually evaluated for impairment	398		398
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	237,598	222,162	237,598	222,162
General reserves to total loans collectively evaluated for impairment (as a percent)			0.78%	0.68%
Total gross loans	237,996	222,162	237,996	222,162	221,089
Total allowance to gross loans (as a percent)			0.78%	0.68%
SBA
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			151	79
Charge-offs				(16)
Recoveries			(4)	51
Provisions for (reduction in) loan losses			290	(64)
Balance, at the end of the period	445	50	445	50
Other disclosures
Amount of allowance attributed to: General portfolio allocation	445	50	445	50
Loans individually evaluated for impairment		14		14
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	20,482	6,441	20,482	6,441
General reserves to total loans collectively evaluated for impairment (as a percent)			2.17%	0.78%
Total gross loans	20,482	6,455	20,482	6,455	10,659
Total allowance to gross loans (as a percent)			2.17%	0.77%
Warehouse
Allowance for Loan Losses
Period considered for comparison of allowance for loan losses factor			10 years
Period considered for comparison of entity's allowance for loan losses factor			15 years
Trailing period considered for comparison of allowance for loan losses factor			12 months
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			392	1,544
Provisions for (reduction in) loan losses			102	(1,319)
Balance, at the end of the period	494	225	494	225
Other disclosures
Amount of allowance attributed to: General portfolio allocation	494	225	494	225
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	108,093	49,104	108,093	49,104
General reserves to total loans collectively evaluated for impairment (as a percent)			0.46%	0.46%
Total gross loans	108,093	49,104	108,093	49,104	87,517
Total allowance to gross loans (as a percent)			0.46%	0.46%
Commercial non-owner occupied
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			1,658	1,459
Charge-offs			(365)	(757)
Provisions for (reduction in) loan losses			608	701
Balance, at the end of the period	1,901	1,403	1,901	1,403
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans					1
Amount of allowance attributed to: General portfolio allocation	1,901	1,403	1,901	1,403
Loans individually evaluated for impairment	883	437	883	437
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	355,101	304,542	355,101	304,542
General reserves to total loans collectively evaluated for impairment (as a percent)			0.54%	0.46%
Total gross loans	355,984	304,979	355,984	304,979	333,544
Total allowance to gross loans (as a percent)			0.53%	0.46%
Multi-family
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			817	1,145
Charge-offs				(101)
Provisions for (reduction in) loan losses			194	(538)
Balance, at the end of the period	1,011	506	1,011	506
Other disclosures
Amount of allowance attributed to: General portfolio allocation	1,011	506	1,011	506
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	262,588	218,929	262,588	218,929
General reserves to total loans collectively evaluated for impairment (as a percent)			0.39%	0.23%
Total gross loans	262,588	218,929	262,588	218,929	233,689
Total allowance to gross loans (as a percent)			0.39%	0.23%
One-to-four family
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			1,099	862
Charge-offs			(195)	(273)
Recoveries			(32)	45
Provisions for (reduction in) loan losses			(121)	540
Balance, at the end of the period	815	1,174	815	1,174
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans		104		104	104
Amount of allowance attributed to: General portfolio allocation	815	1,070	815	1,070
Loans individually evaluated for impairment	526	642	526	642
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	16.20%
Loans collectively evaluated for impairment	124,800	152,025	124,800	152,025
General reserves to total loans collectively evaluated for impairment (as a percent)			0.65%	0.70%
Total gross loans	125,326	152,667	125,326	152,667	145,235
Total allowance to gross loans (as a percent)			0.65%	0.77%
Construction
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			136
Provisions for (reduction in) loan losses			639	121
Balance, at the end of the period	775	121	775	121
Other disclosures
Amount of allowance attributed to: General portfolio allocation	775	121	775	121
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	67,118	2,835	67,118	2,835
General reserves to total loans collectively evaluated for impairment (as a percent)			1.15%	4.27%
Total gross loans	67,118	2,835	67,118	2,835	13,040
Total allowance to gross loans (as a percent)			1.15%	4.27%
Land
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			127	31
Provisions for (reduction in) loan losses			(55)	116
Balance, at the end of the period	72	147	72	147
Other disclosures
Amount of allowance attributed to: General portfolio allocation	72	147	72	147
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	6,103	7,371	6,103	7,371
General reserves to total loans collectively evaluated for impairment (as a percent)			1.18%	1.99%
Total gross loans	6,103	7,371	6,103	7,371	7,605
Total allowance to gross loans (as a percent)			1.18%	1.99%
Other loans
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			34	52
Charge-offs				(7)
Recoveries			(18)	141
Provisions for (reduction in) loan losses			(29)	(138)
Balance, at the end of the period	23	48	23	48
Other disclosures
Amount of allowance attributed to: General portfolio allocation	23	48	23	48
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	3,521	3,793	3,521	3,793
General reserves to total loans collectively evaluated for impairment (as a percent)			0.65%	1.27%
Total gross loans	$ 3,521	$ 3,793	$ 3,521	$ 3,793	$ 3,839
Total allowance to gross loans (as a percent)			0.65%	1.27%