Loans and Allowance for Credit Losses (Details 8) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended
	Sep. 30, 2014	Sep. 30, 2013	Sep. 30, 2014	Sep. 30, 2013
Allowance for credit losses:
Beginning balance	$ 9,076	$ 15,723	$ 10,725	$ 15,991
Charge-offs	(1,515)	(27,019)	(5,440)	(32,649)
Recoveries	270	137	621	649
Net charge-offs	(1,245)	(26,882)	(4,819)	(32,000)
Provision	775	22,460	2,700	27,310
Ending balance	8,606	11,301	8,606	11,301
Construction Loans [Member]
Allowance for credit losses:
Beginning balance	2,248	4,346	1,960	4,387
Charge-offs	(213)	(18,539)	(454)	(20,048)
Recoveries	1	3	12	5
Net charge-offs	(212)	(18,536)	(442)	(20,043)
Provision	(206)	16,180	312	17,646
Ending balance	1,830	1,990	1,830	1,990
Residential Real Estate [Member]
Allowance for credit losses:
Beginning balance	2,354	4,259	3,854	5,194
Charge-offs	(242)	(4,225)	(1,229)	(6,114)
Recoveries	229	51	335	349
Net charge-offs	(13)	(4,174)	(894)	(5,765)
Provision	47	3,645	(572)	4,301
Ending balance	2,388	3,730	2,388	3,730
Commercial Real Estate [Member]
Allowance for credit losses:
Beginning balance	2,652	5,514	3,029	4,134
Charge-offs	(35)	(4,056)	(1,648)	(6,003)
Recoveries	9	20	22	113
Net charge-offs	(26)	(4,036)	(1,626)	(5,890)
Provision	115	2,090	1,338	5,324
Ending balance	2,741	3,568	2,741	3,568
Commercial Loan [Member]
Allowance for credit losses:
Beginning balance	858	1,216	1,266	1,682
Charge-offs	(1,019)	(196)	(1,956)	(419)
Recoveries	24	47	231	149
Net charge-offs	(995)	(149)	(1,725)	(270)
Provision	935	205	1,257	(140)
Ending balance	798	1,272	798	1,272
Consumer Loan [Member]
Allowance for credit losses:
Beginning balance	306	301	243	407
Charge-offs	(6)	(3)	(153)	(65)
Recoveries	7	16	21	33
Net charge-offs	1	13	(132)	(32)
Provision	(39)	(44)	157	(105)
Ending balance	268	270	268	270
Unallocated Financing Receivables [Member]
Allowance for credit losses:
Beginning balance	658	87	373	187
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Net charge-offs	0	0	0	0
Provision	(77)	384	208	284
Ending balance	$ 581	$ 471	$ 581	$ 471