Investment Securities (Details) - Unrealized gains on investment securities (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Dec. 31, 2013
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	$ 258,198	$ 319,147
Investment Securities Available-for-Sale, Gross Unrealized Gains	9,542	6,960
Investment Securities Available-for-Sale, Gross Unrealized Losses	(781)	(3,037)
Investment Securities Available-for-Sale, Fair Value	266,959	323,070
Investment Securities Held-to-Maturity, Amortized Cost	218,159	215,286
Investment Securities Held-to-Maturity, Gross Unrealized Gains	4,791	1,516
Investment Securities Held-to-Maturity, Gross Unrealized Losses	(447)	(5,844)
Investment Securities Held-to-Maturity, Fair Value	222,503	210,958
Total, Amortized Cost	476,357	534,433
Total, Gross Unrealized Gains	14,333	8,476
Total, Gross Unrealized Losses	(1,228)	(8,881)
Total, Fair Value	489,462	534,028
US Treasury Securities [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	9,608	14,344
Investment Securities Available-for-Sale, Gross Unrealized Losses	(136)	(825)
Investment Securities Available-for-Sale, Fair Value	9,472	13,519
Investment Securities Held-to-Maturity, Amortized Cost	28,159	28,056
Investment Securities Held-to-Maturity, Gross Unrealized Gains	257
Investment Securities Held-to-Maturity, Gross Unrealized Losses		(1,019)
Investment Securities Held-to-Maturity, Fair Value	28,416	27,037
Federal Agency Obligations [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	22,643	20,567
Investment Securities Available-for-Sale, Gross Unrealized Gains	116	29
Investment Securities Available-for-Sale, Gross Unrealized Losses	(111)	(655)
Investment Securities Available-for-Sale, Fair Value	22,648	19,941
Investment Securities Held-to-Maturity, Amortized Cost	22,039	15,249
Investment Securities Held-to-Maturity, Gross Unrealized Gains	166	23
Investment Securities Held-to-Maturity, Gross Unrealized Losses	(19)	(389)
Investment Securities Held-to-Maturity, Fair Value	22,186	14,883
Residential Mortgage Backed Securities [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	44,369	48,312
Investment Securities Available-for-Sale, Gross Unrealized Gains	1,563	791
Investment Securities Available-for-Sale, Gross Unrealized Losses	(13)	(229)
Investment Securities Available-for-Sale, Fair Value	45,919	48,874
Investment Securities Held-to-Maturity, Amortized Cost	2,049	2,246
Investment Securities Held-to-Maturity, Gross Unrealized Gains	14
Investment Securities Held-to-Maturity, Gross Unrealized Losses		(64)
Investment Securities Held-to-Maturity, Fair Value	2,063	2,182
Commercial Mortgage Backed Securities [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	3,072	7,145
Investment Securities Available-for-Sale, Gross Unrealized Gains		3
Investment Securities Available-for-Sale, Gross Unrealized Losses	(51)	(157)
Investment Securities Available-for-Sale, Fair Value	3,021	6,991
Investment Securities Held-to-Maturity, Amortized Cost	4,341	4,417
Investment Securities Held-to-Maturity, Gross Unrealized Gains	77	41
Investment Securities Held-to-Maturity, Gross Unrealized Losses	(18)	(62)
Investment Securities Held-to-Maturity, Fair Value	4,400	4,396
US States and Political Subdivisions Debt Securities [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	6,303	30,804
Investment Securities Available-for-Sale, Gross Unrealized Gains	200	711
Investment Securities Available-for-Sale, Gross Unrealized Losses		(55)
Investment Securities Available-for-Sale, Fair Value	6,503	31,460
Investment Securities Held-to-Maturity, Amortized Cost	123,646	127,418
Investment Securities Held-to-Maturity, Gross Unrealized Gains	3,327	1,303
Investment Securities Held-to-Maturity, Gross Unrealized Losses	(410)	(3,688)
Investment Securities Held-to-Maturity, Fair Value	126,563	125,033
Trust Preferred Securities [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	16,085	19,763
Investment Securities Available-for-Sale, Gross Unrealized Gains	490	150
Investment Securities Available-for-Sale, Gross Unrealized Losses	(239)	(510)
Investment Securities Available-for-Sale, Fair Value	16,336	19,403
Corporate Bonds and Notes [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	132,401	154,182
Investment Securities Available-for-Sale, Gross Unrealized Gains	6,969	4,930
Investment Securities Available-for-Sale, Gross Unrealized Losses	(43)	(482)
Investment Securities Available-for-Sale, Fair Value	139,327	158,630
Investment Securities Held-to-Maturity, Amortized Cost	37,925	37,900
Investment Securities Held-to-Maturity, Gross Unrealized Gains	950	149
Investment Securities Held-to-Maturity, Gross Unrealized Losses		(622)
Investment Securities Held-to-Maturity, Fair Value	38,875	37,427
Asset-backed Securities [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	15,010	15,733
Investment Securities Available-for-Sale, Gross Unrealized Gains	166	246
Investment Securities Available-for-Sale, Fair Value	15,176	15,979
Certificates of Deposit [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	2,099	2,250
Investment Securities Available-for-Sale, Gross Unrealized Gains	38	32
Investment Securities Available-for-Sale, Gross Unrealized Losses	(5)	(20)
Investment Securities Available-for-Sale, Fair Value	2,132	2,262
Equity Securities [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	376	376
Investment Securities Available-for-Sale, Gross Unrealized Losses	(83)	(89)
Investment Securities Available-for-Sale, Fair Value	293	287
Money Market Funds [Member]
Investment Securities (Details) - Unrealized gains on investment securities [Line Items]
Investment Securities Available-for-Sale, Amortized Cost	6,232	5,671
Investment Securities Available-for-Sale, Gross Unrealized Gains		68
Investment Securities Available-for-Sale, Gross Unrealized Losses	(100)	(15)
Investment Securities Available-for-Sale, Fair Value	$ 6,132	$ 5,724