Portfolio Loans Covered by Loss Share ("Covered") - Allowance for Credit Losses on Financing Receivables (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Summary of Activity in the Allowance for Loan Losses for Covered Loans [Roll Forward]
Balance at beginning of period	$ 11,547
Provision charged to expense	4,332	22,790	16,103
Balance at beginning of period	$ 15,438	$ 11,547