Portfolio Loans Not Covered by Loss Share ("Non-covered") Loans to Executives and Directors (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Receivables [Abstract]
Notes Receivable, Related Parties	$ 11,752	$ 16,875	$ 13,413	$ 13,887
Origination of Notes Receivable from Related Parties	6,519	8,162	9,927
Repayment of Notes Receivable from Related Parties	$ (11,642)	$ (4,700)	$ (10,401)