Loans and Allowance for Loan Losses (Allowance for Loan Losses) (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2014		Jun. 30, 2013	Dec. 31, 2013
Allowance for Loan and Lease Losses [Roll Forward]
Balance, beginning of period	$ 26,039	$ 29,641	$ 26,785	[1]	$ 29,314
Provision for (recovery of) loan losses	(1,685)	(1,057)	(2,369)		(947)
Charge-offs	(2,033)	(6,102)	(4,010)		(9,113)
Recoveries	1,654	2,603	3,569		5,831
Net charge-offs	(379)	(3,499)	(441)		(3,282)
Balance, end of period	23,975	25,085	23,975		25,085
Annualized net charge-offs during the period to average loans held for investment	0.12%	1.26%	0.07%		0.59%
Annualized net charge-offs during the period to ALL	6.34%	55.79%	3.71%		26.17%
Allowance for loan losses to loans held for investment	1.89%	2.11%	1.89%		2.11%	2.21%
Continuing operations [Member]
Allowance for Loan and Lease Losses [Roll Forward]
Provision for (recovery of) loan losses	$ (1,685)	$ (1,057)	$ (2,369)		$ (947)

[1] Derived from audited consolidated financial statements