Loans and Allowance for Loan Losses (Activity in Allowance for Loan Losses by Portfolio Segment) (Details) - USD ($)	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Financing Receivable, Allowance for Credit Losses [Line Items]
Reserve for unfunded commitments	$ 22,000	$ 17,000	$ 21,000
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Beginning balance	21,116,000	21,590,000	23,044,000
Loans charged off	(2,616,000)	(3,444,000)	(4,274,000)
Recoveries	728,000	746,000	768,000
Ending balance	21,166,000	21,116,000	21,590,000
Ending Balance: Individually evaluated for impairment	1,946,000	2,239,000	2,981,000
Ending Balance: Collectively evaluated for impairment	19,220,000	18,877,000	18,609,000
Ending Balance: Individually evaluated for impairment	23,182,000	21,179,000	27,947,000
Ending Balance: Collectively evaluated for impairment	2,467,024,000	1,751,431,000	1,552,455,000
Total loan balances	2,490,206,000	1,772,610,000	1,580,402,000
Provision for Loan and Lease Losses	1,938,000	2,224,000	2,052,000
Residential real estate loans
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Beginning balance	4,899,000	5,603,000	6,996,000
Loans charged off	(801,000)	(785,000)	(1,059,000)
Recoveries	55,000	165,000	35,000
Ending balance	4,545,000	4,899,000	5,603,000
Ending Balance: Individually evaluated for impairment	818,000	1,220,000	1,750,000
Ending Balance: Collectively evaluated for impairment	3,727,000	3,679,000	3,853,000
Ending Balance: Individually evaluated for impairment	10,567,000	9,656,000	14,435,000
Ending Balance: Collectively evaluated for impairment	810,050,000	575,812,000	555,384,000
Total loan balances	820,617,000	585,468,000	569,819,000
Provision for Loan and Lease Losses	392,000	(84,000)	(369,000)
Commercial real estate loans
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Beginning balance	4,482,000	4,374,000	4,549,000
Loans charged off	(481,000)	(361,000)	(952,000)
Recoveries	74,000	135,000	121,000
Ending balance	6,192,000	4,482,000	4,374,000
Ending Balance: Individually evaluated for impairment	710,000	251,000	526,000
Ending Balance: Collectively evaluated for impairment	5,482,000	4,231,000	3,848,000
Ending Balance: Individually evaluated for impairment	5,744,000	7,658,000	8,864,000
Ending Balance: Collectively evaluated for impairment	922,207,000	633,003,000	532,235,000
Total loan balances	927,951,000	640,661,000	541,099,000
Provision for Loan and Lease Losses	2,117,000	334,000	656,000
Commercial loans
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Beginning balance	6,823,000	6,220,000	5,933,000
Loans charged off	(655,000)	(1,544,000)	(1,426,000)
Recoveries	389,000	395,000	495,000
Ending balance	7,481,000	6,823,000	6,220,000
Ending Balance: Individually evaluated for impairment	166,000	168,000	132,000
Ending Balance: Collectively evaluated for impairment	7,315,000	6,655,000	6,088,000
Ending Balance: Individually evaluated for impairment	4,820,000	1,853,000	2,635,000
Ending Balance: Collectively evaluated for impairment	292,901,000	255,662,000	176,568,000
Total loan balances	297,721,000	257,515,000	179,203,000
Provision for Loan and Lease Losses	924,000	1,752,000	1,218,000
Home equity loans
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Beginning balance	2,247,000	2,403,000	2,520,000
Loans charged off	(525,000)	(611,000)	(647,000)
Recoveries	188,000	19,000	56,000
Ending balance	2,731,000	2,247,000	2,403,000
Ending Balance: Individually evaluated for impairment	245,000	496,000	433,000
Ending Balance: Collectively evaluated for impairment	2,486,000	1,751,000	1,970,000
Ending Balance: Individually evaluated for impairment	1,933,000	1,741,000	1,571,000
Ending Balance: Collectively evaluated for impairment	346,701,000	269,968,000	271,059,000
Total loan balances	348,634,000	271,709,000	272,630,000
Provision for Loan and Lease Losses	821,000	436,000	474,000
Consumer loans
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Beginning balance	281,000	319,000	184,000
Loans charged off	(154,000)	(143,000)	(190,000)
Recoveries	22,000	32,000	61,000
Ending balance	193,000	281,000	319,000
Ending Balance: Individually evaluated for impairment	7,000	104,000	140,000
Ending Balance: Collectively evaluated for impairment	186,000	177,000	179,000
Ending Balance: Individually evaluated for impairment	118,000	271,000	442,000
Ending Balance: Collectively evaluated for impairment	17,835,000	16,986,000	17,209,000
Total loan balances	17,953,000	17,257,000	17,651,000
Provision for Loan and Lease Losses	44,000	73,000	264,000
HPFC Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Beginning balance	0	0
Ending balance	24,000	0	0
Ending Balance: Collectively evaluated for impairment	24,000
Ending Balance: Collectively evaluated for impairment	77,330,000
Total loan balances	77,330,000
Provision for Loan and Lease Losses	24,000
Unallocated
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Beginning balance	2,384,000	2,671,000	2,862,000
Ending balance	0	2,384,000	2,671,000
Ending Balance: Collectively evaluated for impairment		2,384,000	2,671,000
Provision for Loan and Lease Losses	$ (2,384,000)	$ (287,000)	$ (191,000)