Loans and Allowance for Loan Losses (Allowance for Loan Losses) (Details) (USD $)	12 Months Ended
	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Allowance for Loan and Lease Losses [Roll Forward]
Balance, beginning of period	$ 39,360,000	$ 93,687,000	$ 49,461,000
Charge-offs	(30,968,000)	(128,424,000)	(91,250,000)
Recoveries	6,873,000	6,735,000	2,721,000
Net charge-offs	(24,095,000)	(121,689,000)	(88,529,000)
Balance, end of period	29,314,000	39,360,000	93,687,000
Annualized net charge-offs during the period to average loans held for investment	1.94%	10.75%	5.92%
Annualized net charge-offs during the period to ALL	82.20%	309.17%	94.49%
Allowance for loan losses to loans held for investment	2.49%	3.23%	7.18%
Continuing operations [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Provision for losses	14,049,000	67,362,000	132,755,000
Discontinued operations [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Provision for losses	$ 0	$ 0