Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2014	Jun. 30, 2013	Dec. 31, 2013
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			$ 8,200	$ 7,994
Charge-offs			(501)	(847)
Recoveries			55	229
Provisions for (reduction in) loan losses	1,030	322	1,979	618
Balance, at the end of the period	9,733	7,994	9,733	7,994
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans	104	593	104	593	105
Amount of allowance attributed to: General portfolio allocation	9,629	7,401	9,629	7,401
Loans individually evaluated for impairment	1,530	2,606	1,530	2,606
Specific reserves to total loans individually evaluated for impairment (as a percent)			6.80%	22.76%
Loans collectively evaluated for impairment	1,464,820	1,057,351	1,464,820	1,057,351
General reserves to total loans collectively evaluated for impairment (as a percent)			0.66%	0.70%
Total gross loans	1,466,350	1,059,957	1,466,350	1,059,957	1,243,252
Total allowance to gross loans (as a percent)			0.66%	0.75%
Owner Occupied Commercial Real Estate Loans, Commercial and Industrial Loans and SBA Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor			36 months
Trailing period one considered for determination of allowance for loan losses factor			24 months
Trailing period two considered for determination of allowance for loan losses factor			12 months
Annualized trailing period considered for determination of allowance for loan losses factor			6 months
Period considered for comparison of allowance for loan losses factor			10 years
Period considered for comparison of entity's allowance for loan losses factor			15 years
Trailing period considered for comparison of allowance for loan losses factor			12 months
Multi-Family and Non-Owner Occupied Commercial Real Estate Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor			36 months
Trailing period one considered for determination of allowance for loan losses factor			24 months
Trailing period two considered for determination of allowance for loan losses factor			12 months
Annualized trailing period considered for determination of allowance for loan losses factor			6 months
Period considered for comparison of allowance for loan losses factor			10 years
Period considered for comparison of entity's allowance for loan losses factor			15 years
Trailing period considered for comparison of allowance for loan losses factor			12 months
One-to-Four Family and Consumer Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor			36 months
Trailing period one considered for determination of allowance for loan losses factor			24 months
Trailing period two considered for determination of allowance for loan losses factor			12 months
Annualized trailing period considered for determination of allowance for loan losses factor			6 months
Period considered for comparison of allowance for loan losses factor			10 years
Period considered for comparison of entity's allowance for loan losses factor			15 years
Trailing period considered for comparison of allowance for loan losses factor			12 months
Commercial and industrial
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			1,968	1,310
Charge-offs			(124)	(58)
Recoveries			21	21
Provisions for (reduction in) loan losses			1,036	806
Balance, at the end of the period	2,901	2,079	2,901	2,079
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans		233		233
Amount of allowance attributed to: General portfolio allocation	2,901	1,846	2,901	1,846
Loans individually evaluated for impairment	24	308	24	308
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	75.65%
Loans collectively evaluated for impairment	319,517	145,932	319,517	145,932
General reserves to total loans collectively evaluated for impairment (as a percent)			0.91%	1.26%
Total gross loans	319,541	146,240	319,541	146,240	187,035
Total allowance to gross loans (as a percent)			0.91%	1.42%
Commercial owner occupied
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			1,818	1,512
Provisions for (reduction in) loan losses			(72)	229
Balance, at the end of the period	1,746	1,741	1,746	1,741
Other disclosures
Amount of allowance attributed to: General portfolio allocation	1,746	1,741	1,746	1,741
Loans individually evaluated for impairment	417		417
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	216,367	201,802	216,367	201,802
General reserves to total loans collectively evaluated for impairment (as a percent)			0.81%	0.86%
Total gross loans	216,784	201,802	216,784	201,802	221,089
Total allowance to gross loans (as a percent)			0.81%	0.86%
SBA
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			151	79
Charge-offs				(5)
Recoveries			3	44
Provisions for (reduction in) loan losses			110	(50)
Balance, at the end of the period	264	68	264	68
Other disclosures
Amount of allowance attributed to: General portfolio allocation	264	68	264	68
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	15,115	5,820	15,115	5,820
General reserves to total loans collectively evaluated for impairment (as a percent)			1.75%	1.17%
Total gross loans	15,115	5,820	15,115	5,820	10,659
Total allowance to gross loans (as a percent)			1.75%	1.17%
Warehouse
Allowance for Loan Losses
Period considered for comparison of allowance for loan losses factor			10 years
Period considered for comparison of entity's allowance for loan losses factor			15 years
Trailing period considered for comparison of allowance for loan losses factor			12 months
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			392	1,544
Provisions for (reduction in) loan losses			64	(844)
Balance, at the end of the period	456	700	456	700
Other disclosures
Amount of allowance attributed to: General portfolio allocation	456	700	456	700
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	114,032	135,317	114,032	135,317
General reserves to total loans collectively evaluated for impairment (as a percent)			0.40%	0.52%
Total gross loans	114,032	135,317	114,032	135,317	87,517
Total allowance to gross loans (as a percent)			0.40%	0.52%
Commercial non-owner occupied
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			1,658	1,459
Charge-offs			(365)	(757)
Provisions for (reduction in) loan losses			698	806
Balance, at the end of the period	1,991	1,508	1,991	1,508
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans					1
Amount of allowance attributed to: General portfolio allocation	1,991	1,508	1,991	1,508
Loans individually evaluated for impairment	514	450	514	450
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	359,774	295,317	359,774	295,317
General reserves to total loans collectively evaluated for impairment (as a percent)			0.55%	0.51%
Total gross loans	360,288	295,767	360,288	295,767	333,544
Total allowance to gross loans (as a percent)			0.55%	0.51%
Multi-family
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			817	1,145
Charge-offs				(11)
Provisions for (reduction in) loan losses			120	(593)
Balance, at the end of the period	937	541	937	541
Other disclosures
Amount of allowance attributed to: General portfolio allocation	937	541	937	541
Loans individually evaluated for impairment		1,035		1,035
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	251,512	171,762	251,512	171,762
General reserves to total loans collectively evaluated for impairment (as a percent)			0.37%	0.31%
Total gross loans	251,512	172,797	251,512	172,797	233,689
Total allowance to gross loans (as a percent)			0.37%	0.31%
One-to-four family
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			1,099	862
Charge-offs			(12)	(10)
Recoveries			30	44
Provisions for (reduction in) loan losses			(299)	243
Balance, at the end of the period	818	1,139	818	1,139
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans	104	360	104	360	104
Amount of allowance attributed to: General portfolio allocation	714	779	714	779
Loans individually evaluated for impairment	575	813	575	813
Specific reserves to total loans individually evaluated for impairment (as a percent)			18.09%	44.28%
Loans collectively evaluated for impairment	131,445	83,859	131,445	83,859
General reserves to total loans collectively evaluated for impairment (as a percent)			0.54%	0.93%
Total gross loans	132,020	84,672	132,020	84,672	145,235
Total allowance to gross loans (as a percent)			0.62%	1.35%
Construction
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			136
Provisions for (reduction in) loan losses			391
Balance, at the end of the period	527		527
Other disclosures
Amount of allowance attributed to: General portfolio allocation	527		527
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	47,034	2,135	47,034	2,135
General reserves to total loans collectively evaluated for impairment (as a percent)			1.12%	0.00%
Total gross loans	47,034	2,135	47,034	2,135	13,040
Total allowance to gross loans (as a percent)			1.12%	0.00%
Land
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			127	31
Provisions for (reduction in) loan losses			(60)	149
Balance, at the end of the period	67	180	67	180
Other disclosures
Amount of allowance attributed to: General portfolio allocation	67	180	67	180
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	6,271	10,438	6,271	10,438
General reserves to total loans collectively evaluated for impairment (as a percent)			1.07%	1.72%
Total gross loans	6,271	10,438	6,271	10,438	7,605
Total allowance to gross loans (as a percent)			1.07%	1.72%
Other loans
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period			34	52
Charge-offs				(6)
Recoveries			1	120
Provisions for (reduction in) loan losses			(9)	(128)
Balance, at the end of the period	26	38	26	38
Other disclosures
Amount of allowance attributed to: General portfolio allocation	26	38	26	38
Specific reserves to total loans individually evaluated for impairment (as a percent)			0.00%	0.00%
Loans collectively evaluated for impairment	3,753	4,969	3,753	4,969
General reserves to total loans collectively evaluated for impairment (as a percent)			0.69%	0.76%
Total gross loans	$ 3,753	$ 4,969	$ 3,753	$ 4,969	$ 3,839
Total allowance to gross loans (as a percent)			0.69%	0.76%