Parent Company Only Financial Information (Statement of Cash Flow) (Details) (USD $)	12 Months Ended
	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010	Dec. 31, 2012 Parent Company [Member]	Dec. 31, 2011 Parent Company [Member]	Dec. 31, 2010 Parent Company [Member]
Condensed Financial Statements, Captions [Line Items]
Cash and cash equivalents at beginning of period					$ 4,082,000	$ 26,166,000
Operating activities:
Net income	20,385,000	12,555,000	5,581,000	20,385,000	12,555,000	5,581,000
Adjustments to reconcile net income to net cash provided by operating activities:
Equity In (Excess Dividends From) Undistributed Earnings of Subsidiaries				(11,276,000)	10,584,000	1,724,000
Gain (Loss) on Sale of Securities, Net	(3,548,000)	(473,000)	(6,852,000)	(273,000)	0	(16,000)
Gain (loss) on debt extinguishment	4,144,000	0	0	1,033,000	0	0
Other Operating Activities, Cash Flow Statement				(663,000)	2,534,000	447,000
Net cash provided by operating activities	41,254,000	43,384,000	45,117,000	9,206,000	25,673,000	7,736,000
Investing activities
Payments for (Proceeds from) Investments				273,000	25,000	171,000
Investment in subsidiaries				(9,815,000)	0	0
Change in Receivable from Subsidiary				3,814,000	(3,451,000)	(15,000)
Net cash provided by (used in) investing activities	(69,567,000)	(8,879,000)	141,459,000	(5,728,000)	(3,426,000)	156,000
Financing activities
Proceeds from long-term borrowings	24,000,000	0	5,000,000	24,000,000	0	0
Repurchase of preferred shares and common stock warrant	39,000,000			0	(39,000,000)	0
Redemption of Junior Subordinated Note				(23,668,000)	0	0
Payments of Ordinary Dividends, Preferred Stock and Preference Stock	0	(1,232,000)	(1,950,000)	0	(1,232,000)	(1,950,000)
Treasury Stock, Value, Acquired, Cost Method	156,000	187,000	181,000	(1,357,000)	(187,000)	(181,000)
Proceeds from issuance of common shares	6,000	10,000	447,000	6,000	10,000	447,000
Payments of Ordinary Dividends, Common Stock	(4,457,000)	(3,922,000)	(3,822,000)	(4,457,000)	(3,922,000)	(3,822,000)
Excess tax benefit from share-based payments	16,000	0	4,000	709,000	0	4,000
Net cash provided by (used in) financing activities	51,905,000	(70,199,000)	(153,705,000)	(4,767,000)	(44,331,000)	(5,502,000)
Net increase (decrease) in cash and cash equivalents	23,592,000	(35,694,000)	32,871,000	(1,289,000)	(22,084,000)	2,390,000
Cash and cash equivalents at beginning of period	38,950,000	74,644,000	41,773,000	4,082,000	26,166,000
Cash and cash equivalents at end of period	62,542,000	38,950,000	74,644,000	2,793,000	4,082,000	26,166,000
Supplemental cash flow information:
Interest paid	$ 15,570,000	$ 21,386,000	$ 30,109,000	$ 2,246,000	$ 1,981,000	$ 1,980,000