Loans and Allowance for Credit Losses (Details 7) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Financing Receivable, Allowance for Credit Losses [Line Items]
Current	$ 686,216	$ 691,164
30-59 days past due	3,897	3,757
60-89 days past due	2,210	2,102
90 days or more past due	0	270
Total past due	6,107	6,129
Non-accrual	12,719	14,626
Total loans	705,042	711,919
Percent of total loans, Current	97.30%	97.10%
Percent of total loans, 30-59 days past due	0.60%	0.50%
Percent of total loans, 60-89 days past due	0.30%	0.30%
Percent of total loans, 90 days or more past due	0.00%	0.00%
Percent of total loans, Total past due	0.90%	0.80%
Percent of total loans, Non accrual	1.80%	2.10%
Construction Loans [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Current	59,106	60,642
30-59 days past due	1,259	0
60-89 days past due	0	0
90 days or more past due	0	0
Total past due	1,259	0
Non-accrual	7,001	3,949
Total loans	67,366	64,591
Residential Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Current	270,851	265,182
30-59 days past due	2,142	2,765
60-89 days past due	1,074	1,724
90 days or more past due	0	20
Total past due	3,216	4,509
Non-accrual	2,374	5,166
Total loans	276,441	274,857
Commercial Real Estate [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Current	293,827	299,295
30-59 days past due	243	639
60-89 days past due	1,021	0
90 days or more past due	0	0
Total past due	1,264	639
Non-accrual	2,756	4,671
Total loans	297,847	304,605
Commercial Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Current	53,434	55,576
30-59 days past due	196	330
60-89 days past due	112	247
90 days or more past due	0	250
Total past due	308	827
Non-accrual	465	792
Total loans	54,207	57,195
Consumer Loan [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Current	8,998	10,469
30-59 days past due	57	23
60-89 days past due	3	131
90 days or more past due	0	0
Total past due	60	154
Non-accrual	123	48
Total loans	$ 9,181	$ 10,671