Investment Securities (Unrealized Gains) (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	$ 319,147	$ 482,440
Investment Securities Available-for-Sale: Unrealized Gains	6,960	16,316
Investment Securities Available-for-Sale: Unrealized Losses	(3,037)	(1,941)
Investment Securities Available-for-Sale: Fair Value	323,070	496,815
Investment Securities Held-to-Maturity: Amortized Cost	215,286	58,064
Investment Securities Held-to-Maturity: Unrealized Gains	1,516	4,372
Investment Securities Held-to-Maturity: Unrealized Losses	(5,844)	(5)
Investment Securities Held-to-Maturity: Fair Value	210,958	62,431
Total investment securities, amortized cost	534,433	540,504
Total investment securities, gross unrealized gains	8,476	20,688
Total investment securities, gross unrealized losses	(8,881)	(1,946)
Total investment securities, fair value	534,028	559,246
U.S. Treasury and agency securities [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	14,344	11,870
Investment Securities Available-for-Sale: Unrealized Gains	0	62
Investment Securities Available-for-Sale: Unrealized Losses	(825)	(23)
Investment Securities Available-for-Sale: Fair Value	13,519	11,909
Investment Securities Held-to-Maturity: Amortized Cost	28,056
Investment Securities Held-to-Maturity: Unrealized Gains	0
Investment Securities Held-to-Maturity: Unrealized Losses	(1,019)
Investment Securities Held-to-Maturity: Fair Value	27,037
Federal agency obligations [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	20,567	20,207
Investment Securities Available-for-Sale: Unrealized Gains	29	333
Investment Securities Available-for-Sale: Unrealized Losses	(655)	(5)
Investment Securities Available-for-Sale: Fair Value	19,941	20,535
Investment Securities Held-to-Maturity: Amortized Cost	15,249	4,178
Investment Securities Held-to-Maturity: Unrealized Gains	23	79
Investment Securities Held-to-Maturity: Unrealized Losses	(389)	0
Investment Securities Held-to-Maturity: Fair Value	14,883	4,257
Residential mortgage-backed securities [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	48,312	52,400
Investment Securities Available-for-Sale: Unrealized Gains	791	1,385
Investment Securities Available-for-Sale: Unrealized Losses	(229)	(1)
Investment Securities Available-for-Sale: Fair Value	48,874	53,784
Investment Securities Held-to-Maturity: Amortized Cost	2,246
Investment Securities Held-to-Maturity: Unrealized Gains	0
Investment Securities Held-to-Maturity: Unrealized Losses	(64)
Investment Securities Held-to-Maturity: Fair Value	2,182
Commercial mortgage-backed securities [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	7,145	9,725
Investment Securities Available-for-Sale: Unrealized Gains	3	244
Investment Securities Available-for-Sale: Unrealized Losses	(157)	0
Investment Securities Available-for-Sale: Fair Value	6,991	9,969
Investment Securities Held-to-Maturity: Amortized Cost	4,417	5,501
Investment Securities Held-to-Maturity: Unrealized Gains	41	154
Investment Securities Held-to-Maturity: Unrealized Losses	(62)	(5)
Investment Securities Held-to-Maturity: Fair Value	4,396	5,650
Obligations of U.S. states and political subdivisions [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	30,804	103,193
Investment Securities Available-for-Sale: Unrealized Gains	711	4,653
Investment Securities Available-for-Sale: Unrealized Losses	(55)	(132)
Investment Securities Available-for-Sale: Fair Value	31,460	107,714
Investment Securities Held-to-Maturity: Amortized Cost	127,418	48,385
Investment Securities Held-to-Maturity: Unrealized Gains	1,303	4,139
Investment Securities Held-to-Maturity: Unrealized Losses	(3,688)	0
Investment Securities Held-to-Maturity: Fair Value	125,033	52,524
Trust preferred securities [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	19,763	22,279
Investment Securities Available-for-Sale: Unrealized Gains	150	144
Investment Securities Available-for-Sale: Unrealized Losses	(510)	(1,174)
Investment Securities Available-for-Sale: Fair Value	19,403	21,249
Corporate bonds and notes [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	154,182	228,681
Investment Securities Available-for-Sale: Unrealized Gains	4,930	9,095
Investment Securities Available-for-Sale: Unrealized Losses	(482)	(371)
Investment Securities Available-for-Sale: Fair Value	158,630	237,405
Investment Securities Held-to-Maturity: Amortized Cost	37,900
Investment Securities Held-to-Maturity: Unrealized Gains	149
Investment Securities Held-to-Maturity: Unrealized Losses	(622)
Investment Securities Held-to-Maturity: Fair Value	37,427
Asset-backed securities [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	15,733	19,431
Investment Securities Available-for-Sale: Unrealized Gains	246	311
Investment Securities Available-for-Sale: Unrealized Losses	0	0
Investment Securities Available-for-Sale: Fair Value	15,979	19,742
Collateralized mortgage obligations [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost		2,120
Investment Securities Available-for-Sale: Unrealized Gains		0
Investment Securities Available-for-Sale: Unrealized Losses		0
Investment Securities Available-for-Sale: Fair Value		2,120
Certificates of Deposit [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	2,250	2,854
Investment Securities Available-for-Sale: Unrealized Gains	32	21
Investment Securities Available-for-Sale: Unrealized Losses	(20)	(10)
Investment Securities Available-for-Sale: Fair Value	2,262	2,865
Equity securities [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	376	535
Investment Securities Available-for-Sale: Unrealized Gains	0	0
Investment Securities Available-for-Sale: Unrealized Losses	(89)	(210)
Investment Securities Available-for-Sale: Fair Value	287	325
Other securities [Member]
Schedule of Investments [Line Items]
Investment Securities Available-for-Sale: Amortized cost	5,671	9,145
Investment Securities Available-for-Sale: Unrealized Gains	68	68
Investment Securities Available-for-Sale: Unrealized Losses	(15)	(15)
Investment Securities Available-for-Sale: Fair Value	$ 5,724	$ 9,198