Fair Values of Assets and Liabilities (Measured on Recurring Basis) (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	$ 414,614	$ 564,850
Mortgage servicing rights	1,600	700
U.S, Treasury and government agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		6,981
U.S. government sponsored agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	2,077	22,173
States and political subdivisions debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		6,038
Residential mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	341,147	441,074
Residential mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	20,752	22,945
Commercial mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	21,439	23,359
Commercial mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	9,585	5,317
Business Development Company investment [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	2,737
Corporate notes [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	16,877	36,963
Continuing operations [Member] | Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	2,737	0
Continuing operations [Member] | Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	411,877	564,850
Continuing operations [Member] | Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Total [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	414,614	564,850
Mortgage servicing rights	1,552	726
Total assets at fair value	416,166	565,576
Continuing operations [Member] | Recurring [Member] | Total [Member] | U.S, Treasury and government agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		6,981
Continuing operations [Member] | Recurring [Member] | Total [Member] | U.S. government sponsored agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	2,077	22,173
Continuing operations [Member] | Recurring [Member] | Total [Member] | States and political subdivisions debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		6,038
Continuing operations [Member] | Recurring [Member] | Total [Member] | Residential mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	341,147	441,074
Continuing operations [Member] | Recurring [Member] | Total [Member] | Residential mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	20,752	22,945
Continuing operations [Member] | Recurring [Member] | Total [Member] | Commercial mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	21,439	23,359
Continuing operations [Member] | Recurring [Member] | Total [Member] | Commercial mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	9,585	5,317
Continuing operations [Member] | Recurring [Member] | Total [Member] | Business Development Company investment [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	2,737
Continuing operations [Member] | Recurring [Member] | Total [Member] | Corporate notes [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	16,877	36,963
Continuing operations [Member] | Recurring [Member] | Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	2,737	0
Mortgage servicing rights	0	0
Total assets at fair value	2,737	0
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | U.S, Treasury and government agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		0
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | U.S. government sponsored agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | States and political subdivisions debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		0
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Residential mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Residential mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Commercial mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		0
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Commercial mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Business Development Company investment [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	2,737
Continuing operations [Member] | Recurring [Member] | Level 1 [Member] | Corporate notes [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	411,877	564,850
Mortgage servicing rights	0	0
Total assets at fair value	411,877	564,850
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | U.S, Treasury and government agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		6,981
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | U.S. government sponsored agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	2,077	22,173
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | States and political subdivisions debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		6,038
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Residential mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	341,147	441,074
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Residential mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	20,752	22,945
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Commercial mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	21,439	23,359
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Commercial mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	9,585	5,317
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Business Development Company investment [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0
Continuing operations [Member] | Recurring [Member] | Level 2 [Member] | Corporate notes [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	16,877	36,963
Continuing operations [Member] | Recurring [Member] | Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Mortgage servicing rights	1,552	726
Total assets at fair value	1,552	726
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | U.S, Treasury and government agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		0
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | U.S. government sponsored agencies debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | States and political subdivisions debt securities [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		0
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Residential mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Residential mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Commercial mortgage-backed securities - GSE [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities		0
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Commercial mortgage-backed securities - Private [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0	0
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Business Development Company investment [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	0
Continuing operations [Member] | Recurring [Member] | Level 3 [Member] | Corporate notes [Member]
Fair Value, Assets and Liabilities Measured on Recurring Basis [Line Items]
Available-for-sale investment securities	$ 0	$ 0