Derivatives and Financial Instruments (Details) (USD $)	12 Months Ended						3 Months Ended				12 Months Ended		12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2013 Designated as hedges [Member] Interest rate swaps [Member] FHLB advance [Member] Other Income [Member]	Dec. 31, 2012 Designated as hedges [Member] Interest rate swaps [Member] FHLB advance [Member] Other Income [Member]	Dec. 31, 2011 Designated as hedges [Member] Interest rate swaps [Member] FHLB advance [Member] Other Income [Member]	Dec. 31, 2011 CommunityOne [Member] FHLB advance [Member]	Sep. 30, 2011 CommunityOne [Member] FHLB advance [Member]	Dec. 31, 2011 CommunityOne [Member] Designated as hedges [Member] Fair value hedge [Member] Interest rate swaps [Member] FHLB advance [Member]	Sep. 30, 2011 CommunityOne [Member] Designated as hedges [Member] Fair value hedge [Member] Interest rate swaps [Member] FHLB advance [Member]	Dec. 31, 2011 CommunityOne [Member] Designated as hedges [Member] Fair value hedge [Member] Interest rate swaps [Member] FHLB advance [Member]	Mar. 31, 2010 CommunityOne [Member] Designated as hedges [Member] Fair value hedge [Member] Interest rate swaps [Member] FHLB advance [Member] swap	Dec. 31, 2013 Discontinued operations [Member] Not designated as hedges [Member]	Dec. 31, 2012 Discontinued operations [Member] Not designated as hedges [Member]	Dec. 31, 2011 Discontinued operations [Member] Not designated as hedges [Member]	Dec. 31, 2013 Discontinued operations [Member] Not designated as hedges [Member] Interest Rate Lock Commitments [Member]		Dec. 31, 2012 Discontinued operations [Member] Not designated as hedges [Member] Interest Rate Lock Commitments [Member]		Dec. 31, 2011 Discontinued operations [Member] Not designated as hedges [Member] Interest Rate Lock Commitments [Member]		Dec. 31, 2013 Discontinued operations [Member] Not designated as hedges [Member] Forward Contracts [Member]		Dec. 31, 2012 Discontinued operations [Member] Not designated as hedges [Member] Forward Contracts [Member]		Dec. 31, 2011 Discontinued operations [Member] Not designated as hedges [Member] Forward Contracts [Member]		Dec. 31, 2013 Continuing operations [Member] Not designated as hedges [Member]	Dec. 31, 2012 Continuing operations [Member] Not designated as hedges [Member]	Dec. 31, 2011 Continuing operations [Member] Not designated as hedges [Member]	Dec. 31, 2013 Continuing operations [Member] Not designated as hedges [Member] Interest Rate Lock Commitments [Member]	Dec. 31, 2012 Continuing operations [Member] Not designated as hedges [Member] Interest Rate Lock Commitments [Member]	Dec. 31, 2011 Continuing operations [Member] Not designated as hedges [Member] Interest Rate Lock Commitments [Member]	Dec. 31, 2013 Continuing operations [Member] Not designated as hedges [Member] Forward Contracts [Member]	Dec. 31, 2012 Continuing operations [Member] Not designated as hedges [Member] Forward Contracts [Member]	Dec. 31, 2011 Continuing operations [Member] Not designated as hedges [Member] Forward Contracts [Member]
Derivative [Line Items]
Number of interest rate derivatives												4
Derivative notional amount												$ 45,000,000
Derivative terminated									30,000,000	15,000,000
Gain on derivatives terminated									800,000	900,000
Loss on hedged FHLB advances terminated	0	0	(1,625,000)				1,300,000	2,000,000
Net gains (losses) recognized in income				$ 0	$ 0	$ 819,000					$ (1,600,000)		$ 0	$ 0	$ (44,000)	$ 0	[1]	$ 0	[1]	$ 0	[1]	$ 0	[1]	$ 0	[1]	$ (44,000)	[1]	$ (214,000)	$ 204,000	$ 11,000	$ 4,000	$ 152,000	$ 55,000	$ (218,000)	$ 52,000	$ (44,000)

[1] Recognized in “Net loss from discontinued operations” in the Company’s Consolidated Statements of Operations.