Loans and Allowance for Loan Losses, Impaired Financing Receivable (Details) (USD $)	12 Months Ended
	Dec. 31, 2013		Dec. 31, 2012		Dec. 31, 2011
Financing Receivable, Impaired [Line Items]
Recorded investment	$ 18,183,000		$ 22,823,000		$ 47,855,000
Unpaid principal balance	19,526,000		35,057,000		58,981,000
Related allowance	1,187,000	[1]	1,764,000	[1]	4,440,000	[1]
Average recorded investment	21,484,000		38,413,000		60,792,000
Interest income recognized	0		0		42,000
Interest income from cash payments received			42,000
Collateral Dependent Impaired Loans [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	11,570,000		15,474,000		28,546,000
Unpaid principal balance	12,136,000		21,404,000		34,699,000
Related allowance	0	[1]	0	[1]	0	[1]
Average recorded investment	13,605,000		21,547,000		35,567,000
Interest income recognized	0		0		42,000
Collateral Dependent Impaired Loans [Member] | Commercial and industrial [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	1,828,000		1,547,000		3,036,000
Unpaid principal balance	1,901,000		1,761,000		3,546,000
Related allowance	0	[1]	0	[1]	0	[1]
Average recorded investment	3,911,000		1,896,000		3,689,000
Interest income recognized	0		0		0
Collateral Dependent Impaired Loans [Member] | Construction and Land Development [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	545,000		1,546,000		6,917,000
Unpaid principal balance	545,000		2,062,000		9,093,000
Related allowance	0	[1]	0	[1]	0	[1]
Average recorded investment	938,000		2,063,000		9,288,000
Interest income recognized	0		0		37,000
Collateral Dependent Impaired Loans [Member] | Consumer Real Estate - Mortgage [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	2,162,000		3,641,000		9,248,000
Unpaid principal balance	2,209,000		6,394,000		9,961,000
Related allowance	0	[1]	0	[1]	0	[1]
Average recorded investment	2,234,000		6,394,000		10,140,000
Interest income recognized	0		0		0
Collateral Dependent Impaired Loans [Member] | Commercial Real Estate - Mortgage [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	7,035,000		8,740,000		9,345,000
Unpaid principal balance	7,481,000		11,187,000		12,099,000
Related allowance	0	[1]	0	[1]	0	[1]
Average recorded investment	6,522,000		11,194,000		12,450,000
Interest income recognized	0		0		5,000
Collateral Dependent Impaired Loans [Member] | Consumer and Other [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	0		0		0
Unpaid principal balance	0		0		0
Related allowance	0	[1]	0	[1]	0	[1]
Average recorded investment	0		0		0
Interest income recognized	0		0		0
Cash Flow Dependent Impaired Loans [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	6,613,000		7,349,000		19,309,000
Unpaid principal balance	7,390,000		13,653,000		24,282,000
Related allowance	1,187,000	[1]	1,764,000	[1]	4,440,000	[1]
Average recorded investment	7,879,000		16,866,000		25,225,000
Interest income recognized	0		0		0
Cash Flow Dependent Impaired Loans [Member] | Commercial and industrial [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	737,000		1,491,000		8,854,000
Unpaid principal balance	1,029,000		2,459,000		11,041,000
Related allowance	218,000	[1]	814,000	[1]	2,767,000	[1]
Average recorded investment	1,216,000		2,528,000		11,497,000
Interest income recognized	0		0		0
Cash Flow Dependent Impaired Loans [Member] | Construction and Land Development [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	525,000		2,963,000		6,048,000
Unpaid principal balance	609,000		4,701,000		6,822,000
Related allowance	33,000	[1]	201,000	[1]	1,264,000	[1]
Average recorded investment	568,000		5,102,000		7,074,000
Interest income recognized	0		0		0
Cash Flow Dependent Impaired Loans [Member] | Consumer Real Estate - Mortgage [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	3,127,000		2,265,000		3,239,000
Unpaid principal balance	3,334,000		4,473,000		4,902,000
Related allowance	722,000	[1]	573,000	[1]	301,000	[1]
Average recorded investment	3,405,000		5,828,000		5,005,000
Interest income recognized	0		0		0
Cash Flow Dependent Impaired Loans [Member] | Commercial Real Estate - Mortgage [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	1,982,000		551,000		617,000
Unpaid principal balance	2,166,000		1,841,000		661,000
Related allowance	142,000	[1]	154,000	[1]	57,000	[1]
Average recorded investment	2,448,000		3,228,000		792,000
Interest income recognized	0		0		0
Cash Flow Dependent Impaired Loans [Member] | Consumer and Other [Member]
Financing Receivable, Impaired [Line Items]
Recorded investment	242,000		79,000		551,000
Unpaid principal balance	252,000		179,000		856,000
Related allowance	72,000	[1]	22,000	[1]	51,000	[1]
Average recorded investment	242,000		180,000		857,000
Interest income recognized	$ 0		$ 0		$ 0

[1] Collateral dependent loans are typically charged-off to their net realizable value pursuant to requirements of our primary regulators and no specific allowance is carried related to those loans.