Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	6 Months Ended		12 Months Ended
	Jun. 30, 2014		Dec. 31, 2013
Allowance for loan losses [Roll Forward]
Beginning balance	$ 13,320		$ 14,311
Financing receivable, adjustment for the sale of majority interest in consolidated subsidiary	(95)
Charge-offs	(3,422)		(1,381)
Recoveries	745		281
Provision	960		109
Ending balance	11,508		13,320
Ending allowance balance attributable to loans:
Individually evaluated for impairment	2,644		4,655
Collectively evaluated for impairment	8,864		8,665
Total ending allowance balance	11,508		13,320
Loans:
Individually evaluated for impairment	15,184		24,696
Collectively evaluated for impairment	711,922		703,784
Total Loans	727,106	[1]	728,480	[1]
Real Estate Construction [Member]
Allowance for loan losses [Roll Forward]
Beginning balance	847		1,258
Financing receivable, adjustment for the sale of majority interest in consolidated subsidiary	0
Charge-offs	(845)		(394)
Recoveries	168		68
Provision	438		(85)
Ending balance	608		847
Ending allowance balance attributable to loans:
Individually evaluated for impairment	111		486
Collectively evaluated for impairment	497		361
Total ending allowance balance	608		847
Loans:
Individually evaluated for impairment	2,126		2,636
Collectively evaluated for impairment	27,252		33,389
Total Loans	29,378		36,025
Real Estate Loans Secured by Farmland [Member]
Allowance for loan losses [Roll Forward]
Beginning balance	166		135
Financing receivable, adjustment for the sale of majority interest in consolidated subsidiary	0
Charge-offs	0		0
Recoveries	0		0
Provision	16		31
Ending balance	182		166
Ending allowance balance attributable to loans:
Individually evaluated for impairment	0		0
Collectively evaluated for impairment	182		166
Total ending allowance balance	182		166
Loans:
Individually evaluated for impairment	0		0
Collectively evaluated for impairment	17,414		16,578
Total Loans	17,414		16,578
Real Estate Loans Secured by 1 - 4 Family Residential [Member]
Allowance for loan losses [Roll Forward]
Beginning balance	6,734		6,276
Financing receivable, adjustment for the sale of majority interest in consolidated subsidiary	(95)
Charge-offs	(1,186)		(785)
Recoveries	305		140
Provision	(837)		1,103
Ending balance	4,921		6,734
Ending allowance balance attributable to loans:
Individually evaluated for impairment	1,993		3,045
Collectively evaluated for impairment	2,928		3,689
Total ending allowance balance	4,921		6,734
Loans:
Individually evaluated for impairment	5,899		10,411
Collectively evaluated for impairment	265,836		262,973
Total Loans	271,735		273,384
Other Real Estate Loans [Member]
Allowance for loan losses [Roll Forward]
Beginning balance	3,506		4,348
Financing receivable, adjustment for the sale of majority interest in consolidated subsidiary	0
Charge-offs	(748)		(97)
Recoveries	106		37
Provision	679		(782)
Ending balance	3,543		3,506
Ending allowance balance attributable to loans:
Individually evaluated for impairment	312		812
Collectively evaluated for impairment	3,231		2,694
Total ending allowance balance	3,543		3,506
Loans:
Individually evaluated for impairment	4,645		9,142
Collectively evaluated for impairment	260,288		251,191
Total Loans	264,933		260,333
Commercial [Member]
Allowance for loan losses [Roll Forward]
Beginning balance	1,890		2,098
Financing receivable, adjustment for the sale of majority interest in consolidated subsidiary	0
Charge-offs	(626)		(75)
Recoveries	96		9
Provision	702		(142)
Ending balance	2,062		1,890
Ending allowance balance attributable to loans:
Individually evaluated for impairment	217		275
Collectively evaluated for impairment	1,845		1,615
Total ending allowance balance	2,062		1,890
Loans:
Individually evaluated for impairment	2,503		2,470
Collectively evaluated for impairment	124,728		127,084
Total Loans	127,231		129,554
Consumer [Member]
Allowance for loan losses [Roll Forward]
Beginning balance	177		196
Financing receivable, adjustment for the sale of majority interest in consolidated subsidiary	0
Charge-offs	(17)		(30)
Recoveries	70		27
Provision	(38)		(16)
Ending balance	192		177
Ending allowance balance attributable to loans:
Individually evaluated for impairment	11		37
Collectively evaluated for impairment	181		140
Total ending allowance balance	192		177
Loans:
Individually evaluated for impairment	11		37
Collectively evaluated for impairment	16,404		12,569
Total Loans	$ 16,415		$ 12,606

[1] Gross loan balances at June 30, 2014 and December 31, 2013 are net of deferred loan costs of $2.2 million and $2.4 million, respectively.