Investment Securities (Unrealized Gain/Loss Positions) (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Available-for-sale Securities [Abstract]
Amortized cost	$ 438,057	$ 558,818
Gross unrealized gains	3,048	7,451
Gross unrealized losses	26,491	1,419
Estimated fair value	414,614	564,850
Held-to-maturity Securities [Abstract]
Amortized cost	151,795
Gross unrealized gains	0
Gross unrealized losses	10,670
Estimated fair value	141,125
Amortized cost, Total	589,852
Gross unrealized gains, Total	3,048
Gross unrealized losses, Total	37,161
Estimated fair value, Total	555,739
Obligations of U.S. Treasury and government agencies [Member]
Available-for-sale Securities [Abstract]
Amortized cost		6,646
Gross unrealized gains		335
Gross unrealized losses		0
Estimated fair value		6,981
Obligations of U.S. government sponsored enterprises [Member]
Available-for-sale Securities [Abstract]
Amortized cost	2,051	22,118
Gross unrealized gains	26	55
Gross unrealized losses	0	0
Estimated fair value	2,077	22,173
Obligations of states and political subdivisions [Member]
Available-for-sale Securities [Abstract]
Amortized cost		5,918
Gross unrealized gains		120
Gross unrealized losses		0
Estimated fair value		6,038
Residential mortgage-backed securities - GSE [Member]
Available-for-sale Securities [Abstract]
Amortized cost	364,513	436,344
Gross unrealized gains	974	5,678
Gross unrealized losses	24,340	948
Estimated fair value	341,147	441,074
Held-to-maturity Securities [Abstract]
Amortized cost	141,724
Gross unrealized gains	0
Gross unrealized losses	9,907
Estimated fair value	131,817
Residential mortgage-backed securities - Private [Member]
Available-for-sale Securities [Abstract]
Amortized cost	19,770	22,649
Gross unrealized gains	982	750
Gross unrealized losses	0	454
Estimated fair value	20,752	22,945
Commercial mortgage-backed securities - GSE [Member]
Available-for-sale Securities [Abstract]
Amortized cost	22,767	23,150
Gross unrealized gains	0	209
Gross unrealized losses	1,328	0
Estimated fair value	21,439	23,359
Commercial mortgage-backed securities - Private [Member]
Available-for-sale Securities [Abstract]
Amortized cost	10,408	5,283
Gross unrealized gains	0	34
Gross unrealized losses	823	0
Estimated fair value	9,585	5,317
Held-to-maturity Securities [Abstract]
Amortized cost	10,071
Gross unrealized gains	0
Gross unrealized losses	763
Estimated fair value	9,308
Business Development Company investment [Member]
Available-for-sale Securities [Abstract]
Amortized cost	1,753
Gross unrealized gains	984
Gross unrealized losses	0
Estimated fair value	2,737
Corporate notes [Member]
Available-for-sale Securities [Abstract]
Amortized cost	16,795	36,710
Gross unrealized gains	82	270
Gross unrealized losses	0	17
Estimated fair value	$ 16,877	$ 36,963