Loans and Allowance for Credit Losses (Details 2) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended	12 Months Ended
	Sep. 30, 2014	Dec. 31, 2013	Sep. 30, 2014	Dec. 31, 2013
Impaired Nonaccrual Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	$ 20,099	$ 21,554	$ 20,099	$ 21,554
Recorded investment with no allowance	12,123	12,422	12,123	12,422
Recorded investment with an allowance	596	2,204	596	2,204
Related allowance	593	716	593	716
Average recorded investment	13,741	15,363	16,988	26,006
Impaired Nonaccrual Loans [Member] | Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	10,542	6,787	10,542	6,787
Recorded investment with no allowance	6,801	3,709	6,801	3,709
Recorded investment with an allowance	200	240	200	240
Related allowance	200	203	200	203
Average recorded investment	7,492	5,563	7,918	7,270
Impaired Nonaccrual Loans [Member] | Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	3,191	7,692	3,191	7,692
Recorded investment with no allowance	2,300	3,862	2,300	3,862
Recorded investment with an allowance	73	1,304	73	1,304
Related allowance	75	225	75	225
Average recorded investment	2,604	5,094	4,014	10,240
Impaired Nonaccrual Loans [Member] | Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	4,557	5,218	4,557	5,218
Recorded investment with no allowance	2,756	4,261	2,756	4,261
Recorded investment with an allowance	0	410	0	410
Related allowance	0	38	0	38
Average recorded investment	3,132	3,917	4,443	7,829
Impaired Nonaccrual Loans [Member] | Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	1,680	1,801	1,680	1,801
Recorded investment with no allowance	167	547	167	547
Recorded investment with an allowance	298	245	298	245
Related allowance	293	245	293	245
Average recorded investment	389	740	558	619
Impaired Nonaccrual Loans [Member] | Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	129	56	129	56
Recorded investment with no allowance	99	43	99	43
Recorded investment with an allowance	25	5	25	5
Related allowance	25	5	25	5
Average recorded investment	124	49	55	48
Impaired Accruing TDRs [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	25,247	26,088	25,247	26,088
Recorded investment with no allowance	20,980	23,805	20,980	23,805
Recorded investment with an allowance	4,267	2,283	4,267	2,283
Related allowance	175	67	175	67
Average recorded investment	25,107	27,445	25,320	38,919
Impaired Accruing TDRs [Member] | Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	3,403	1,620	3,403	1,620
Recorded investment with no allowance	3,316	1,527	3,316	1,527
Recorded investment with an allowance	87	93	87	93
Related allowance	1	1	1	1
Average recorded investment	3,404	1,759	2,301	14,405
Impaired Accruing TDRs [Member] | Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	16,226	14,582	16,226	14,582
Recorded investment with no allowance	12,813	13,177	12,813	13,177
Recorded investment with an allowance	3,413	1,405	3,413	1,405
Related allowance	168	60	168	60
Average recorded investment	16,190	15,387	16,131	11,101
Impaired Accruing TDRs [Member] | Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	5,566	9,791	5,566	9,791
Recorded investment with no allowance	4,799	9,006	4,799	9,006
Recorded investment with an allowance	767	785	767	785
Related allowance	6	6	6	6
Average recorded investment	5,459	10,201	6,826	13,308
Impaired Accruing TDRs [Member] | Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	52	95	52	95
Recorded investment with no allowance	52	95	52	95
Recorded investment with an allowance	0	0	0	0
Related allowance	0	0	0	0
Average recorded investment	54	98	62	105
Impaired Accruing TDRs [Member] | Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	0	0	0	0
Recorded investment with no allowance	0	0	0	0
Recorded investment with an allowance	0	0	0	0
Related allowance	0	0	0	0
Average recorded investment	0	0	0	0
Total Impired Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	45,346	47,642	45,346	47,642
Recorded investment with no allowance	33,103	36,227	33,103	36,227
Recorded investment with an allowance	4,863	4,487	4,863	4,487
Related allowance	768	783	768	783
Average recorded investment	38,848	42,808	42,308	64,925
Total Impired Loans [Member] | Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	13,945	8,407	13,945	8,407
Recorded investment with no allowance	10,117	5,236	10,117	5,236
Recorded investment with an allowance	287	333	287	333
Related allowance	201	204	201	204
Average recorded investment	10,896	7,322	10,219	21,675
Total Impired Loans [Member] | Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	19,417	22,274	19,417	22,274
Recorded investment with no allowance	15,113	17,039	15,113	17,039
Recorded investment with an allowance	3,486	2,709	3,486	2,709
Related allowance	243	285	243	285
Average recorded investment	18,794	20,481	20,145	21,341
Total Impired Loans [Member] | Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	10,123	15,009	10,123	15,009
Recorded investment with no allowance	7,555	13,267	7,555	13,267
Recorded investment with an allowance	767	1,195	767	1,195
Related allowance	6	44	6	44
Average recorded investment	8,591	14,118	11,269	21,137
Total Impired Loans [Member] | Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	1,732	1,896	1,732	1,896
Recorded investment with no allowance	219	642	219	642
Recorded investment with an allowance	298	245	298	245
Related allowance	293	245	293	245
Average recorded investment	443	838	620	724
Total Impired Loans [Member] | Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Unpaid principal balance	129	56	129	56
Recorded investment with no allowance	99	43	99	43
Recorded investment with an allowance	25	5	25	5
Related allowance	25	5	25	5
Average recorded investment	$ 124	$ 49	$ 55	$ 48