Earnings Per Common Share (Details) (USD $) In Thousands, except Per Share data, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2014	Jun. 30, 2013
Income [Abstract]
Net income	$ 877	$ 5,960	$ 1,697	$ 6,882
Less preferred stock dividends	(118)	(119)	(236)	(246)
Net income applicable to common shareholders	759	5,841	1,461	6,636
Effect of Series D preferred stock		119		246
Net income applicable to common shareholders, diluted		$ 5,960		$ 6,882
Shares [Abstract]
Weighted average shares outstanding (in shares)	20,816		20,944
Weighted average shares outstanding, basic (in shares)		21,268		21,225
Effect of dilutive stock options (in shares)				38
Effect of Series D preferred stock (in shares)		1,629		1,629
Weighted average shares outstanding, diluted (in shares)		22,897		22,892
Per Share Amount [Abstract]
Net income applicable to common shareholders (in dollars per share)	$ 0.04		$ 0.07
Net income applicable to common shareholders, basic (in dollars per share)	$ 0.04	$ 0.27	$ 0.07	$ 0.31
Net income applicable to common shareholders, diluted (in dollars per share)	$ 0.04	$ 0.26	$ 0.07	$ 0.30