Investment Securities Investment Securities - Continuous Unrealized Loss Position (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Dec. 31, 2013
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	$ 18,334	$ 141,755
Less than 12 Months, Unrealized Losses	65	4,428
12 Months or More, Fair Value	117,193	26,955
12 Months or More, Unrealized Losses	2,534	1,716
Investment Securities Held-to-Maturity:
Less than 12 Months, Fair Value	5,022	5,289
Less than 12 Months, Unrealized Losses	215	286
12 Months or More, Fair Value	0	0
12 Months or More, Unrealized Losses	0	0
U.S. Treasury Notes [Member]
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	9,185	12,894
Less than 12 Months, Unrealized Losses	1	290
12 Months or More, Fair Value	8,743	0
12 Months or More, Unrealized Losses	161	0
US Agency Notes [Member]
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	0	89,080
Less than 12 Months, Unrealized Losses	0	2,880
12 Months or More, Fair Value	73,891	9,636
12 Months or More, Unrealized Losses	1,525	834
US Agency Mortgage-Backed Securities [Member]
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	12	17,557
Less than 12 Months, Unrealized Losses	0	575
12 Months or More, Fair Value	12,076	5,130
12 Months or More, Unrealized Losses	369	273
Non-Taxable [Member]
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	6,771	15,641
Less than 12 Months, Unrealized Losses	35	398
12 Months or More, Fair Value	16,805	10,751
12 Months or More, Unrealized Losses	339	570
Investment Securities Held-to-Maturity:
Less than 12 Months, Fair Value	5,022	4,890
Less than 12 Months, Unrealized Losses	215	285
12 Months or More, Fair Value	0	0
12 Months or More, Unrealized Losses	0	0
Taxable [Member]
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	2,162	4,903
Less than 12 Months, Unrealized Losses	17	202
12 Months or More, Fair Value	4,301	1,252
12 Months or More, Unrealized Losses	109	12
Investment Securities Held-to-Maturity:
Less than 12 Months, Fair Value	0	399
Less than 12 Months, Unrealized Losses	0	1
12 Months or More, Fair Value	0	0
12 Months or More, Unrealized Losses	0	0
Mutual Funds [Member]
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	0	1,380
Less than 12 Months, Unrealized Losses	0	39
12 Months or More, Fair Value	1,160	0
12 Months or More, Unrealized Losses	17	0
Trust Preferred Securities [Member]
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	49	0
Less than 12 Months, Unrealized Losses	1	0
12 Months or More, Fair Value	0	93
12 Months or More, Unrealized Losses	0	6
Equity Securities [Member]
Investment Securities Available-for-Sale:
Less than 12 Months, Fair Value	155	300
Less than 12 Months, Unrealized Losses	11	44
12 Months or More, Fair Value	217	93
12 Months or More, Unrealized Losses	$ 14	$ 21