Loans and Credit Quality - ALLL by Impairment Methodology (Details 2) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010	Dec. 31, 2009
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	$ 21,383	$ 24,083
Allowance: individually evaluated for impairment	6,368	18,717
Total Allowance	27,751	42,800	64,566	110,422
Loans: collectively evaluated for impairment	1,216,146	1,170,259
Loans: individually evaluated for impairment	123,965	177,365
Total loans	1,340,111	1,347,624
Consumer Portfolio Segment [Member]
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	15,823	13,867
Allowance: individually evaluated for impairment	2,213	1,427
Total Allowance	18,036	15,294	16,472
Loans: collectively evaluated for impairment	732,564	593,261
Loans: individually evaluated for impairment	78,047	62,609
Total loans	810,611	655,870
Consumer Portfolio Segment [Member] | Residential Mortgage [Member]
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	11,212	9,756
Allowance: individually evaluated for impairment	2,176	915
Total Allowance	13,388	10,671	11,977
Loans: collectively evaluated for impairment	599,538	437,264
Loans: individually evaluated for impairment	74,327	59,670
Total loans	673,865	496,934
Consumer Portfolio Segment [Member] | Home Equity Line of Credit [Member]
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	4,611	4,111
Allowance: individually evaluated for impairment	37	512
Total Allowance	4,648	4,623	4,495
Loans: collectively evaluated for impairment	133,026	155,997
Loans: individually evaluated for impairment	3,720	2,939
Total loans	136,746	158,936
Commercial Portfolio Segment [Member]
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	5,560	10,216
Allowance: individually evaluated for impairment	4,155	17,290
Total Allowance	9,715	27,506	48,094
Loans: collectively evaluated for impairment	483,582	576,998
Loans: individually evaluated for impairment	45,918	114,756
Total loans	529,500	691,754
Commercial Portfolio Segment [Member] | Commercial Real Estate [Member]
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	3,682	4,051
Allowance: individually evaluated for impairment	1,630	270
Total Allowance	5,312	4,321	10,060
Loans: collectively evaluated for impairment	334,406	366,914
Loans: individually evaluated for impairment	27,473	35,225
Total loans	361,879	402,139
Commercial Portfolio Segment [Member] | Multifamily Residential [Member]
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	106	320
Allowance: individually evaluated for impairment	516	15
Total Allowance	622	335	1,795
Loans: collectively evaluated for impairment	13,791	47,933
Loans: individually evaluated for impairment	3,221	8,446
Total loans	17,012	56,379
Commercial Portfolio Segment [Member] | Commercial Real Estate Construction Financing Receivable [Member]
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	1,092	4,668
Allowance: individually evaluated for impairment	488	16,569
Total Allowance	1,580	21,237	33,478
Loans: collectively evaluated for impairment	58,129	103,462
Loans: individually evaluated for impairment	12,904	69,943
Total loans	71,033	173,405
Commercial Portfolio Segment [Member] | Commercial Business [Member]
Allowance for credit losses and recorded investment in loans by impairment methodology
Allowance: collectively evaluated for impairment	680	1,177
Allowance: individually evaluated for impairment	1,521	436
Total Allowance	2,201	1,613	2,761
Loans: collectively evaluated for impairment	77,256	58,689
Loans: individually evaluated for impairment	2,320	1,142
Total loans	$ 79,576	$ 59,831