Loans (Impaired Loans) (Details) (USD $)	3 Months Ended
	Mar. 31, 2014		Mar. 31, 2013	Dec. 31, 2013
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	$ 10,925,000	[1]		$ 3,220,000	[1]
Recorded Investment of Impaired Loans with Related Allowance	20,267,000	[1]		34,318,000	[1]
Total Recorded Investment of Impaired Loans	31,192,000	[1]		37,538,000	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	10,994,000			3,307,000
Unpaid Principal of Impaired Loans with Related Allowance	23,448,000			37,541,000
Total Unpaid Principal of Impaired Loans	34,442,000			40,848,000
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	1,027,000			1,481,000
Average Recorded Investment of Impaired Loans	34,804,000		36,069,000
Interest Income Recognized on Impaired Loans	206,000		194,000
Commercial Mortgages [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	9,084,000	[1]		998,000	[1]
Recorded Investment of Impaired Loans with Related Allowance	16,045,000	[1]		29,335,000	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	9,077,000			998,000
Unpaid Principal of Impaired Loans with Related Allowance	18,610,000			31,731,000
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	292,000			552,000
Average Recorded Investment of Impaired Loans	28,340,000		20,903,000
Interest Income Recognized on Impaired Loans	165,000		100,000
Commercial Construction and Development [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	0	[1]		0	[1]
Recorded Investment of Impaired Loans with Related Allowance	0	[1]		0	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	0			0
Unpaid Principal of Impaired Loans with Related Allowance	0			0
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	0			0
Average Recorded Investment of Impaired Loans	0		0
Interest Income Recognized on Impaired Loans	0		0
Commercial Other [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	1,052,000	[1]		1,055,000	[1]
Recorded Investment of Impaired Loans with Related Allowance	1,142,000	[1]		1,506,000	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	1,045,000			1,050,000
Unpaid Principal of Impaired Loans with Related Allowance	1,457,000			1,945,000
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	297,000			463,000
Average Recorded Investment of Impaired Loans	2,366,000		10,635,000
Interest Income Recognized on Impaired Loans	23,000		64,000
Residential Mortgage [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	789,000	[1]		1,167,000	[1]
Recorded Investment of Impaired Loans with Related Allowance	2,735,000	[1]		3,122,000	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	872,000			1,259,000
Unpaid Principal of Impaired Loans with Related Allowance	3,037,000			3,507,000
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	436,000			463,000
Average Recorded Investment of Impaired Loans	3,744,000		4,000,000
Interest Income Recognized on Impaired Loans	14,000		22,000
Homeowner Construction [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	0	[1]		0	[1]
Recorded Investment of Impaired Loans with Related Allowance	0	[1]		0	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	0			0
Unpaid Principal of Impaired Loans with Related Allowance	0			0
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	0			0
Average Recorded Investment of Impaired Loans	0		0
Interest Income Recognized on Impaired Loans	0		0
Home Equity Lines [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	0	[1]		0	[1]
Recorded Investment of Impaired Loans with Related Allowance	93,000	[1]		173,000	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	0			0
Unpaid Principal of Impaired Loans with Related Allowance	91,000			174,000
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	1,000			1,000
Average Recorded Investment of Impaired Loans	134,000		263,000
Interest Income Recognized on Impaired Loans	1,000		3,000
Home Equity Loans [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	0	[1]		0	[1]
Recorded Investment of Impaired Loans with Related Allowance	135,000	[1]		55,000	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	0			0
Unpaid Principal of Impaired Loans with Related Allowance	135,000			54,000
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	1,000			0
Average Recorded Investment of Impaired Loans	95,000		105,000
Interest Income Recognized on Impaired Loans	1,000		3,000
Other Consumer [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment of Impaired Loans with No Related Allowance	0	[1]		0	[1]
Recorded Investment of Impaired Loans with Related Allowance	117,000	[1]		127,000	[1]
Unpaid Principal of Impaired Loans with No Related Allowance	0			0
Unpaid Principal of Impaired Loans with Related Allowance	118,000			130,000
Impaired Financing Receivable, No Related Allowance	0			0
Related Allowance on Impaired Loans	0			2,000
Average Recorded Investment of Impaired Loans	125,000		163,000
Interest Income Recognized on Impaired Loans	2,000		2,000
Commercial Segment [Member]
Financing Receivable, Impaired [Line Items]
Total Recorded Investment of Impaired Loans	27,323,000	[1]		32,894,000	[1]
Total Unpaid Principal of Impaired Loans	30,189,000			35,724,000
Related Allowance on Impaired Loans	589,000			1,015,000
Residential Segment [Member]
Financing Receivable, Impaired [Line Items]
Total Recorded Investment of Impaired Loans	3,524,000	[1]		4,289,000	[1]
Total Unpaid Principal of Impaired Loans	3,909,000			4,766,000
Related Allowance on Impaired Loans	436,000			463,000
Consumer Segment [Member]
Financing Receivable, Impaired [Line Items]
Total Recorded Investment of Impaired Loans	345,000	[1]		355,000	[1]
Total Unpaid Principal of Impaired Loans	344,000			358,000
Related Allowance on Impaired Loans	$ 2,000			$ 3,000

[1] The recorded investment in impaired loans consists of unpaid principal balance, net of charge-offs, interest payments received applied to principal and unamortized deferred loan origination fees and costs. For impaired accruing loans (troubled debt restructurings for which management has concluded that the collectibility of the loan is not in doubt), the recorded investment also includes accrued interest.