Investment Securities (Details) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2015 USD ($) security item	Jun. 30, 2014 USD ($)	Jun. 30, 2015 USD ($) security item	Jun. 30, 2014 USD ($)	Dec. 31, 2014 USD ($) item
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 210,121		$ 210,121		$ 248,096
Gross unrealized gains	3,684		3,684		4,334
Gross unrealized losses	(1,783)		(1,783)		(2,062)
Available-for-sale Securities, Total	212,022		212,022		250,368
Amortized cost [Abstract]
After 1 but within 5 years	12,234		12,234
After 5 but within 10 years	25,303		25,303
After 10 years	9,112		9,112
Total available for sale debt securities	207,897		207,897
Available-for-sale Equity Securities, Amortized Cost Basis	2,224		2,224
Total available for sale securities	210,121		210,121		248,096
Fair value [Abstract]
After 1 but within 5 years	12,184		12,184
After 5 but within 10 years	25,057		25,057
After 10 years	8,866		8,866
Total available for sale debt securities	208,990		208,990
No contractual maturity	3,032		3,032
Fair value	212,022		212,022		250,368
Proceeds from sales of AFS investment securities	5,800	$ 36,000	24,506	$ 35,970
Gross realized gains and losses on the sale of securities recognized in earnings [Abstract]
Gross realized gains	385	697	572	697
Gross realized losses		(605)		(605)
Net realized gains	385	$ 92	572	$ 92
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	42,656		42,656		47,882
12 months or longer, Fair value	58,519		58,519		77,070
Total, Fair value	101,175		101,175		124,952
Less than 12 months, Gross unrealized losses	(332)		(332)		(250)
12 months or longer, Gross unrealized losses	(1,451)		(1,451)		(1,812)
Total, Gross unrealized losses	$ (1,783)		$ (1,783)		$ (2,062)
Less than 12 months, number of positions | item	21		21		20
12 months or longer, number of positions | item	21		21		28
Total , number of positions | item	42		42		48
Fair value	$ 212,022		$ 212,022		$ 250,368
Number of securities in an unrealized loss position for less than twelve months | item	21		21		20
Number of securities in an unrealized loss position for more than twelve months | item	21		21		28
U.S. Government Agencies [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 26,125		$ 26,125		$ 26,123
Gross unrealized losses	(641)		(641)		(834)
Available-for-sale Securities, Total	25,484		25,484		25,289
Amortized cost [Abstract]
Total available for sale securities	26,125		26,125		26,123
Fair value [Abstract]
Fair value	25,484		25,484		25,289
Available for sale securities, continuous unrealized loss position [Abstract]
12 months or longer, Fair value	25,484		25,484		25,289
Total, Fair value	25,484		25,484		25,289
12 months or longer, Gross unrealized losses	(641)		(641)		(834)
Total, Gross unrealized losses	$ (641)		$ (641)		$ (834)
12 months or longer, number of positions	8		8		8
Total , number of positions | item	8		8		8
Fair value	$ 25,484		$ 25,484		$ 25,289
Number of investment securities | security	8		8
Number of securities in an unrealized loss position for more than twelve months	8		8		8
Mortgage-backed Securities-residential [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 14,692		$ 14,692		$ 22,073
Gross unrealized gains	114		114		375
Gross unrealized losses	(115)		(115)		(61)
Available-for-sale Securities, Total	14,691		14,691		22,387
Amortized cost [Abstract]
Available for sale securities Debt maturities, amortized cost basis	14,692		14,692
Total available for sale securities	14,692		14,692		22,073
Fair value [Abstract]
Available-for-sale Securities, Debt Maturities, without Single Maturity Date, Fair Value	14,691		14,691
Fair value	14,691		14,691		22,387
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	8,367		8,367
12 months or longer, Fair value	2,748		2,748		8,913
Total, Fair value	11,115		11,115		8,913
Less than 12 months, Gross unrealized losses	(72)		(72)
12 months or longer, Gross unrealized losses	(43)		(43)		(61)
Total, Gross unrealized losses	$ (115)		$ (115)		$ (61)
Less than 12 months, number of positions | item	3		3
12 months or longer, number of positions | item	1		1		3
Total , number of positions | item	4		4		3
Fair value	$ 14,691		$ 14,691		$ 22,387
Number of securities in an unrealized loss position for less than twelve months | item	3		3
Number of securities in an unrealized loss position for more than twelve months | item	1		1		3
Collateralized Mortgage Obligations, Issued or Guaranteed by U.S. Government Agencies [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 143,463		$ 143,463		$ 167,711
Gross unrealized gains	2,582		2,582		2,350
Gross unrealized losses	(919)		(919)		(1,084)
Available-for-sale Securities, Total	145,126		145,126		168,977
Amortized cost [Abstract]
Available for sale securities Debt maturities, amortized cost basis	143,463		143,463
Total available for sale securities	143,463		143,463		167,711
Fair value [Abstract]
Available-for-sale Securities, Debt Maturities, without Single Maturity Date, Fair Value	145,126		145,126
Fair value	145,126		145,126		168,977
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	27,728		27,728		36,757
12 months or longer, Fair value	27,300		27,300		38,798
Total, Fair value	55,028		55,028		75,555
Less than 12 months, Gross unrealized losses	(171)		(171)		(204)
12 months or longer, Gross unrealized losses	(748)		(748)		(880)
Total, Gross unrealized losses	$ (919)		$ (919)		$ (1,084)
Less than 12 months, number of positions | item	10		10		12
12 months or longer, number of positions	9		9		12
Total , number of positions | item	19		19		24
Fair value	$ 145,126		$ 145,126		$ 168,977
Number of securities in an unrealized loss position for less than twelve months | item	10		10		12
Number of securities in an unrealized loss position for more than twelve months	9		9		12
Mortgage-backed Securities, Issued by Private Enterprises [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 3,093		$ 3,093		$ 3,738
Gross unrealized gains	3		3		7
Gross unrealized losses	(30)		(30)		(14)
Available-for-sale Securities, Total	3,066		3,066		3,731
Amortized cost [Abstract]
Available for sale securities Debt maturities, amortized cost basis	3,093		3,093
Total available for sale securities	3,093		3,093		3,738
Fair value [Abstract]
Available-for-sale Securities, Debt Maturities, without Single Maturity Date, Fair Value	3,066		3,066
Fair value	3,066		3,066		3,731
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	1,221		1,221		1,432
Total, Fair value	1,221		1,221		1,432
Less than 12 months, Gross unrealized losses	(30)		(30)		(14)
Total, Gross unrealized losses	$ (30)		$ (30)		$ (14)
Less than 12 months, number of positions | item	1		1		1
Total , number of positions | item	1		1		1
Fair value	$ 3,066		$ 3,066		$ 3,731
Number of securities in an unrealized loss position for less than twelve months | item	1		1		1
Corporate Bonds [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 10,583		$ 10,583		$ 15,617
Gross unrealized gains	76		76		144
Gross unrealized losses	(19)		(19)		(34)
Available-for-sale Securities, Total	10,640		10,640		15,727
Amortized cost [Abstract]
Total available for sale securities	10,583		10,583		15,617
Fair value [Abstract]
Fair value	10,640		10,640		15,727
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	997		997		8,054
12 months or longer, Fair value	1,984		1,984		991
Total, Fair value	2,981		2,981		9,045
Less than 12 months, Gross unrealized losses	(3)		(3)		(25)
12 months or longer, Gross unrealized losses	(16)		(16)		(9)
Total, Gross unrealized losses	$ (19)		$ (19)		$ (34)
Less than 12 months, number of positions	1		1		5
12 months or longer, number of positions	2		2		1
Total , number of positions | item	3		3		6
Fair value	$ 10,640		$ 10,640		$ 15,727
Number of investment securities | security	3		3
Number of securities in an unrealized loss position for less than twelve months	1		1		5
Number of securities in an unrealized loss position for more than twelve months	2		2		1
Number of securities considered not to be other than temporarily impaired | security	3		3
Municipal Bonds [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 9,941		$ 9,941		$ 10,117
Gross unrealized gains	77		77		91
Gross unrealized losses	(35)		(35)		(35)
Available-for-sale Securities, Total	9,983		9,983		10,173
Amortized cost [Abstract]
Total available for sale securities	9,941		9,941		10,117
Fair value [Abstract]
Fair value	9,983		9,983		10,173
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	4,108		4,108		1,639
12 months or longer, Fair value	1,003		1,003		3,079
Total, Fair value	5,111		5,111		4,718
Less than 12 months, Gross unrealized losses	(32)		(32)		(7)
12 months or longer, Gross unrealized losses	(3)		(3)		(28)
Total, Gross unrealized losses	$ (35)		$ (35)		$ (35)
Less than 12 months, number of positions	5		5		2
12 months or longer, number of positions	1		1		4
Total , number of positions | item	6		6		6
Fair value	$ 9,983		$ 9,983		$ 10,173
Number of securities in an unrealized loss position for less than twelve months	5		5		2
Number of securities in an unrealized loss position for more than twelve months	1		1		4
Private Equity Funds [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 2,198		$ 2,198		$ 2,684
Gross unrealized gains	832		832		1,350
Gross unrealized losses	(24)		(24)
Available-for-sale Securities, Total	3,006		3,006		4,034
Amortized cost [Abstract]
Total available for sale securities	2,198		2,198		2,684
Fair value [Abstract]
Fair value	3,006		3,006		4,034
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	235		235
Total, Fair value	235		235
Less than 12 months, Gross unrealized losses	(24)		(24)
Total, Gross unrealized losses	$ (24)		$ (24)
Less than 12 months, number of positions | item	1		1
Total , number of positions | item	1		1
Fair value	$ 3,006		$ 3,006		4,034
Number of securities in an unrealized loss position for less than twelve months | item	1		1
Number of securities invested in real estate funds | security	5		5
Number of securities recording an impairment charge | security	1		1
Common Stock [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 26		$ 26		33
Gross unrealized gains					17
Available-for-sale Securities, Total	26		26		50
Amortized cost [Abstract]
Total available for sale securities	26		26		33
Fair value [Abstract]
Fair value	26		26		50
Available for sale securities, continuous unrealized loss position [Abstract]
Fair value	$ 26		$ 26		$ 50