Loans, Net Recorded investment in nonaccrual loans and loans past due and still accruing by class of loans (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	$ 19,752	$ 21,664
Past due 90 days or more and still accruing	808	1,044
Real Estate Loans Construction [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	2,368	2,861
Past due 90 days or more and still accruing	268	780
Real Estate Loans Secured by 1 - 4 Family Residential [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	9,458	8,761
Past due 90 days or more and still accruing	539	228
Other Real Estate Loans [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	6,045	7,866
Past due 90 days or more and still accruing	0	0
Commercial Loans [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	1,844	2,146
Past due 90 days or more and still accruing	0	34
Consumer Loans [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	37	30
Past due 90 days or more and still accruing	$ 1	$ 2