Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended						12 Months Ended
	Dec. 31, 2013	Sep. 30, 2013	Jun. 30, 2013	Mar. 31, 2013	Dec. 31, 2012	Sep. 30, 2012	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				$ 7,994			$ 7,994	$ 8,522
Charge-offs							(2,031)	(1,515)
Recoveries							377	236	402
Provisions for (reduction in) loan losses	596	646	322	296	606	145	1,860	751	3,255
Balance, at the end of the period	8,200				7,994		8,200	7,994	8,522
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans	105				665		105	665
Amount of allowance attributed to: General portfolio allocation	8,095				7,329		8,095	7,329
Loans individually evaluated for impairment	2,427				2,736		2,427	2,736
Specific reserves to total loans individually evaluated for impairment (as a percent)							4.33%	24.31%
Loans collectively evaluated for impairment	1,240,825				983,458		1,240,825	983,458
General reserves to total loans collectively evaluated for impairment (as a percent)							0.65%	0.75%
Total gross loans	1,243,252				986,194		1,243,252	986,194
Total allowance to gross loans (as a percent)							0.66%	0.81%
Commercial Business Loans, Owner-Occupied Commercial Real Estate Loans, and SBA Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor							36 months
Trailing period one considered for determination of allowance for loan losses factor							24 months
Trailing period two considered for determination of allowance for loan losses factor							12 months
Annualized trailing period considered for determination of allowance for loan losses factor							6 months
Period considered for comparison of allowance for loan losses factor							10 years
Period considered for comparison of entity's allowance for loan losses factor							15 years
Trailing period considered for comparison of allowance for loan losses factor							12 months
Non-Owner Occupied Commercial Real Estate, Multi-Family, Land and Construction Loans
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor							36 months
Trailing period one considered for determination of allowance for loan losses factor							24 months
Trailing period two considered for determination of allowance for loan losses factor							12 months
Annualized trailing period considered for determination of allowance for loan losses factor							6 months
Period considered for comparison of allowance for loan losses factor							10 years
Period considered for comparison of entity's allowance for loan losses factor							15 years
Trailing period considered for comparison of allowance for loan losses factor							12 months
Single Family and Consumer Loans and Warehouse Repurchase Facilities
Allowance for Loan Losses
Actual trailing period considered for determination of allowance for loan losses factor							36 months
Trailing period one considered for determination of allowance for loan losses factor							24 months
Trailing period two considered for determination of allowance for loan losses factor							12 months
Annualized trailing period considered for determination of allowance for loan losses factor							6 months
Period considered for comparison of allowance for loan losses factor							10 years
Period considered for comparison of entity's allowance for loan losses factor							15 years
Trailing period considered for comparison of allowance for loan losses factor							12 months
Commercial and industrial
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				1,310			1,310	1,361
Charge-offs							(509)	(512)
Recoveries							138	2
Provisions for (reduction in) loan losses							1,029	459
Balance, at the end of the period	1,968				1,310		1,968	1,310
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans					270			270
Amount of allowance attributed to: General portfolio allocation	1,968				1,040		1,968	1,040
Loans individually evaluated for impairment					593			593
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.00%	45.53%
Loans collectively evaluated for impairment	187,035				114,761		187,035	114,761
General reserves to total loans collectively evaluated for impairment (as a percent)							1.05%	0.91%
Total gross loans	187,035				115,354		187,035	115,354
Total allowance to gross loans (as a percent)							1.05%	1.14%
Commercial owner occupied
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				1,512			1,512	1,119
Charge-offs							(232)	(265)
Provisions for (reduction in) loan losses							538	658
Balance, at the end of the period	1,818				1,512		1,818	1,512
Other disclosures
Amount of allowance attributed to: General portfolio allocation	1,818				1,512		1,818	1,512
Loans individually evaluated for impairment	747						747
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.00%	0.00%
Loans collectively evaluated for impairment	220,342				150,934		220,342	150,934
General reserves to total loans collectively evaluated for impairment (as a percent)							0.83%	1.00%
Total gross loans	221,089				150,934		221,089	150,934
Total allowance to gross loans (as a percent)							0.82%	1.00%
SBA
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				79			79	80
Charge-offs							(143)	(132)
Recoveries							50	163
Provisions for (reduction in) loan losses							165	(32)
Balance, at the end of the period	151				79		151	79
Other disclosures
Amount of allowance attributed to: General portfolio allocation	151				79		151	79
Loans individually evaluated for impairment	14				259		14	259
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.00%	0.00%
Loans collectively evaluated for impairment	10,645				6,623		10,645	6,623
General reserves to total loans collectively evaluated for impairment (as a percent)							1.42%	1.19%
Total gross loans	10,659				6,882		10,659	6,882
Total allowance to gross loans (as a percent)							1.42%	1.15%
Warehouse
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				1,544			1,544	1,347
Provisions for (reduction in) loan losses							(1,152)	197
Balance, at the end of the period	392				1,544		392	1,544
Other disclosures
Amount of allowance attributed to: General portfolio allocation	392				1,544		392	1,544
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.00%	0.00%
Loans collectively evaluated for impairment	87,517				195,761		87,517	195,761
General reserves to total loans collectively evaluated for impairment (as a percent)							0.45%	0.79%
Total gross loans	87,517				195,761		87,517	195,761
Total allowance to gross loans (as a percent)							0.45%	0.79%
Commercial non-owner occupied
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				1,459			1,459	1,287
Charge-offs							(756)	(88)
Recoveries								21
Provisions for (reduction in) loan losses							955	239
Balance, at the end of the period	1,658				1,459		1,658	1,459
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans	1						1
Amount of allowance attributed to: General portfolio allocation	1,657				1,459		1,657	1,459
Loans individually evaluated for impairment	983				670		983	670
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.10%	0.00%
Loans collectively evaluated for impairment	332,561				252,739		332,561	252,739
General reserves to total loans collectively evaluated for impairment (as a percent)							0.50%	0.58%
Total gross loans	333,544				253,409		333,544	253,409
Total allowance to gross loans (as a percent)							0.50%	0.58%
Multi-family
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				1,145			1,145	2,281
Charge-offs							(101)
Provisions for (reduction in) loan losses							(227)	(1,136)
Balance, at the end of the period	817				1,145		817	1,145
Other disclosures
Amount of allowance attributed to: General portfolio allocation	817				1,145		817	1,145
Loans individually evaluated for impairment					266			266
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.00%	0.00%
Loans collectively evaluated for impairment	233,689				156,158		233,689	156,158
General reserves to total loans collectively evaluated for impairment (as a percent)							0.35%	0.73%
Total gross loans	233,689				156,424		233,689	156,424
Total allowance to gross loans (as a percent)							0.35%	0.73%
One-to-four family
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				862			862	931
Charge-offs							(272)	(371)
Recoveries							47	8
Provisions for (reduction in) loan losses							462	294
Balance, at the end of the period	1,099				862		1,099	862
Other disclosures
Amount of allowance attributed to: Specifically evaluated impaired loans	104				395		104	395
Amount of allowance attributed to: General portfolio allocation	995				467		995	467
Loans individually evaluated for impairment	683				948		683	948
Specific reserves to total loans individually evaluated for impairment (as a percent)							15.23%	41.67%
Loans collectively evaluated for impairment	144,552				96,515		144,552	96,515
General reserves to total loans collectively evaluated for impairment (as a percent)							0.69%	0.48%
Total gross loans	145,235				97,463		145,235	97,463
Total allowance to gross loans (as a percent)							0.76%	0.88%
Construction
Allocation of allowance as well as the activity in allowance
Provisions for (reduction in) loan losses							136
Balance, at the end of the period	136						136
Other disclosures
Amount of allowance attributed to: General portfolio allocation	136						136
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.00%	0.00%
Loans collectively evaluated for impairment	13,040						13,040
General reserves to total loans collectively evaluated for impairment (as a percent)							1.04%	0.00%
Total gross loans	13,040						13,040
Total allowance to gross loans (as a percent)							1.04%	0.00%
Land
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				31			31	39
Charge-offs								(145)
Provisions for (reduction in) loan losses							96	137
Balance, at the end of the period	127				31		127	31
Other disclosures
Amount of allowance attributed to: General portfolio allocation	127				31		127	31
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.00%	0.00%
Loans collectively evaluated for impairment	7,605				8,774		7,605	8,774
General reserves to total loans collectively evaluated for impairment (as a percent)							1.67%	0.35%
Total gross loans	7,605				8,774		7,605	8,774
Total allowance to gross loans (as a percent)							1.67%	0.35%
Other loans
Allocation of allowance as well as the activity in allowance
Balance, at the beginning of the period				52			52	77
Charge-offs							(18)	(2)
Recoveries							142	42
Provisions for (reduction in) loan losses							(142)	(65)
Balance, at the end of the period	34				52		34	52
Other disclosures
Amount of allowance attributed to: General portfolio allocation	34				52		34	52
Specific reserves to total loans individually evaluated for impairment (as a percent)							0.00%	0.00%
Loans collectively evaluated for impairment	3,839				1,193		3,839	1,193
General reserves to total loans collectively evaluated for impairment (as a percent)							0.89%	4.36%
Total gross loans	$ 3,839				$ 1,193		$ 3,839	$ 1,193
Total allowance to gross loans (as a percent)							0.89%	4.36%