Loans Held for Investment (Details 2) (USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2014	Mar. 31, 2014 Canyon National	Mar. 31, 2014 Palm Desert National	Dec. 31, 2013 Palm Desert National
Accretable yield on purchased credit impaired
Balance at the beginning of period	$ 1,676	$ 1,623	$ 53	$ 53
Accretion	(68)	(68)
Balance at the end of period	$ 1,608	$ 1,555	$ 53	$ 53