Loans and Credit Quality (Details 5) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2012	Jun. 30, 2012	Dec. 31, 2011
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	$ 1,299,306		$ 1,347,624
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	10,587		18,567
60-89 days past due	11,763		9,052
90 days or more past due	73,395		112,241
Total past due	95,745		139,860
Current	1,203,561		1,207,764
90-days or more past due and still accruing	35,148		35,757
Consumer Portfolio Segment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	743,507	743,507	655,870
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	10,587		8,651
60-89 days past due	11,763		9,052
90 days or more past due	49,072		50,325
Total past due	71,422		68,028
Current	672,085		587,842
90-days or more past due and still accruing	35,148		35,757
Commercial Portfolio Segment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	555,799	555,799	691,754
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	0		9,916
60-89 days past due	0		0
90 days or more past due	24,323		61,916
Total past due	24,323		71,832
Current	531,476		619,922
90-days or more past due and still accruing	0		0
Residential Mortgage [Member] | Consumer Portfolio Segment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	602,164	602,164	496,934
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	9,658		7,694
60-89 days past due	10,374		8,552
90 days or more past due	48,048		47,861
Total past due	68,080		64,107
Current	534,084		432,827
90-days or more past due and still accruing	35,148		35,757
Home Equity Line of Credit [Member] | Consumer Portfolio Segment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	141,343	141,343	158,936
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	929		957
60-89 days past due	1,389		500
90 days or more past due	1,024		2,464
Total past due	3,342		3,921
Current	138,001		155,015
90-days or more past due and still accruing	0		0
Commercial Real Estate [Member] | Commercial Portfolio Segment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	360,919	360,919	402,139
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	0		0
60-89 days past due	0		0
90 days or more past due	16,186		10,184
Total past due	16,186		10,184
Current	344,733		391,955
90-days or more past due and still accruing	0		0
Multifamily Residential [Member] | Commercial Portfolio Segment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	36,912	36,912	56,379
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	0		0
60-89 days past due	0		0
90 days or more past due	0		2,394
Total past due	0		2,394
Current	36,912		53,985
90-days or more past due and still accruing	0		0
Commercial Real Estate Construction Financing Receivable [Member] | Commercial Portfolio Segment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	77,912	77,912	173,405
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	0		9,916
60-89 days past due	0		0
90 days or more past due	5,848		48,387
Total past due	5,848		58,303
Current	72,064		115,102
90-days or more past due and still accruing	0		0
Commercial Business [Member] | Commercial Portfolio Segment [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans and Leases Receivable, Gross	80,056	80,056	59,831
Financing Receivable, Recorded Investment, Past Due [Abstract]
30-59 days past due	0		0
60-89 days past due	0		0
90 days or more past due	2,289		951
Total past due	2,289		951
Current	77,767		58,880
90-days or more past due and still accruing	$ 0		$ 0