Loans and Allowance for Credit Losses (Details 6) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	$ 705,042	$ 711,919
Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	67,366	64,591
Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	276,441	274,857
Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	297,847	304,605
Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	54,207	57,195
Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	9,181	10,671
Pass [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	619,580	592,085
Pass [Member] | Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	45,937	39,268
Pass [Member] | Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	247,438	235,054
Pass [Member] | Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	266,039	255,280
Pass [Member] | Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	51,126	52,032
Pass [Member] | Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	9,040	10,451
Special Mention [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	49,387	72,366
Special Mention [Member] | Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	9,668	15,884
Special Mention [Member] | Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	16,476	22,638
Special Mention [Member] | Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	20,775	30,105
Special Mention [Member] | Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	2,450	3,691
Special Mention [Member] | Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	18	48
Substandard [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	35,606	46,907
Substandard [Member] | Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	11,761	9,439
Substandard [Member] | Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	12,437	17,114
Substandard [Member] | Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	11,033	19,210
Substandard [Member] | Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	252	972
Substandard [Member] | Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	123	172
Doubtful [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	469	561
Doubtful [Member] | Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	0	0
Doubtful [Member] | Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	90	51
Doubtful [Member] | Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	0	10
Doubtful [Member] | Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	379	500
Doubtful [Member] | Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Loan Risk Rating	$ 0	$ 0