Investment Securities (Details) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2015 USD ($) item	Sep. 30, 2014 USD ($)	Sep. 30, 2015 USD ($) item	Sep. 30, 2014 USD ($)	Dec. 31, 2014 USD ($) item
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 226,981		$ 226,981		$ 248,096
Gross unrealized gains	4,424		4,424		4,334
Gross unrealized losses	(793)		(793)		(2,062)
Available-for-sale Securities, Total	230,612		230,612		250,368
Amortized cost [Abstract]
After 1 but within 5 years	8,085		8,085
After 5 but within 10 years	20,354		20,354
After 10 years	9,113		9,113
Total available for sale debt securities	224,757		224,757
Available-for-sale Equity Securities, Amortized Cost Basis	2,224		2,224
Total available for sale securities	226,981		226,981		248,096
Fair value [Abstract]
After 1 but within 5 years	8,080		8,080
After 5 but within 10 years	20,382		20,382
After 10 years	9,037		9,037
Total available for sale debt securities	227,589		227,589
No contractual maturity	3,023		3,023
Fair value	230,612		230,612		250,368
Proceeds from sales of AFS investment securities	9,200	$ 19,300	33,653	$ 55,290
Gross realized gains and losses on the sale of securities recognized in earnings [Abstract]
Gross realized gains	104	446	676	1,143
Gross realized losses	(24)	(208)	(24)	(813)
Net realized gains	80	$ 238	652	$ 330
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	20,229		20,229		47,882
12 months or longer, Fair value	48,544		48,544		77,070
Total, Fair value	68,773		68,773		124,952
Less than 12 months, Gross unrealized losses	(64)		(64)		(250)
12 months or longer, Gross unrealized losses	(729)		(729)		(1,812)
Total, Gross unrealized losses	$ (793)		$ (793)		$ (2,062)
Less than 12 months, number of positions | item	11		11		20
12 months or longer, number of positions | item	16		16		28
Total , number of positions | item	27		27		48
Fair value	$ 230,612		$ 230,612		$ 250,368
Number of securities in an unrealized loss position for less than twelve months | item	11		11		20
Number of securities in an unrealized loss position for more than twelve months | item	16		16		28
U.S. Government Agencies [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 26,126		$ 26,126		$ 26,123
Gross unrealized gains	20		20
Gross unrealized losses	(239)		(239)		(834)
Available-for-sale Securities, Total	25,907		25,907		25,289
Amortized cost [Abstract]
Total available for sale securities	26,126		26,126		26,123
Fair value [Abstract]
Fair value	25,907		25,907		25,289
Available for sale securities, continuous unrealized loss position [Abstract]
12 months or longer, Fair value	19,149		19,149		25,289
Total, Fair value	19,149		19,149		25,289
12 months or longer, Gross unrealized losses	(239)		(239)		(834)
Total, Gross unrealized losses	$ (239)		$ (239)		$ (834)
12 months or longer, number of positions | item	6		6		8
Total , number of positions | item	6		6		8
Fair value	$ 25,907		$ 25,907		$ 25,289
Number of securities in an unrealized loss position for more than twelve months | item	6		6		8
Mortgage-backed Securities-residential [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 14,184		$ 14,184		$ 22,073
Gross unrealized gains	249		249		375
Gross unrealized losses	(15)		(15)		(61)
Available-for-sale Securities, Total	14,418		14,418		22,387
Amortized cost [Abstract]
Available for sale securities Debt maturities, amortized cost basis	14,184		14,184
Total available for sale securities	14,184		14,184		22,073
Fair value [Abstract]
Available-for-sale Securities, Debt Maturities, without Single Maturity Date, Fair Value	14,418		14,418
Fair value	14,418		14,418		22,387
Available for sale securities, continuous unrealized loss position [Abstract]
12 months or longer, Fair value	2,691		2,691		8,913
Total, Fair value	2,691		2,691		8,913
12 months or longer, Gross unrealized losses	(15)		(15)		(61)
Total, Gross unrealized losses	$ (15)		$ (15)		$ (61)
12 months or longer, number of positions | item	1		1		3
Total , number of positions | item	1		1		3
Fair value	$ 14,418		$ 14,418		$ 22,387
Number of securities in an unrealized loss position for more than twelve months | item	1		1		3
Collateralized Mortgage Obligations, Issued or Guaranteed by U.S. Government Agencies [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 170,111		$ 170,111		$ 167,711
Gross unrealized gains	3,122		3,122		2,350
Gross unrealized losses	(488)		(488)		(1,084)
Available-for-sale Securities, Total	172,745		172,745		168,977
Amortized cost [Abstract]
Available for sale securities Debt maturities, amortized cost basis	170,111		170,111
Total available for sale securities	170,111		170,111		167,711
Fair value [Abstract]
Available-for-sale Securities, Debt Maturities, without Single Maturity Date, Fair Value	172,745		172,745
Fair value	172,745		172,745		168,977
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	15,253		15,253		36,757
12 months or longer, Fair value	26,704		26,704		38,798
Total, Fair value	41,957		41,957		75,555
Less than 12 months, Gross unrealized losses	(13)		(13)		(204)
12 months or longer, Gross unrealized losses	(475)		(475)		(880)
Total, Gross unrealized losses	$ (488)		$ (488)		$ (1,084)
Less than 12 months, number of positions | item	5		5		12
12 months or longer, number of positions | item	9		9		12
Total , number of positions | item	14		14		24
Fair value	$ 172,745		$ 172,745		$ 168,977
Number of securities in an unrealized loss position for less than twelve months | item	5		5		12
Number of securities in an unrealized loss position for more than twelve months | item	9		9		12
Mortgage-backed Securities, Issued by Private Enterprises [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 2,910		$ 2,910		$ 3,738
Gross unrealized gains	25		25		7
Gross unrealized losses	(8)		(8)		(14)
Available-for-sale Securities, Total	2,927		2,927		3,731
Amortized cost [Abstract]
Available for sale securities Debt maturities, amortized cost basis	2,910		2,910
Total available for sale securities	2,910		2,910		3,738
Fair value [Abstract]
Available-for-sale Securities, Debt Maturities, without Single Maturity Date, Fair Value	2,927		2,927
Fair value	2,927		2,927		3,731
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	1,184		1,184		1,432
Total, Fair value	1,184		1,184		1,432
Less than 12 months, Gross unrealized losses	(8)		(8)		(14)
Total, Gross unrealized losses	$ (8)		$ (8)		$ (14)
Less than 12 months, number of positions | item	1		1		1
Total , number of positions | item	1		1		1
Fair value	$ 2,927		$ 2,927		$ 3,731
Number of securities in an unrealized loss position for less than twelve months | item	1		1		1
Corporate Bonds [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 1,500		$ 1,500		$ 15,617
Gross unrealized gains	20		20		144
Gross unrealized losses					(34)
Available-for-sale Securities, Total	1,520		1,520		15,727
Amortized cost [Abstract]
Total available for sale securities	1,500		1,500		15,617
Fair value [Abstract]
Fair value	1,520		1,520		15,727
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value					8,054
12 months or longer, Fair value					991
Total, Fair value					9,045
Less than 12 months, Gross unrealized losses					(25)
12 months or longer, Gross unrealized losses					(9)
Total, Gross unrealized losses					$ (34)
Less than 12 months, number of positions | item					5
12 months or longer, number of positions | item					1
Total , number of positions | item					6
Fair value	1,520		1,520		$ 15,727
Number of securities in an unrealized loss position for less than twelve months | item					5
Number of securities in an unrealized loss position for more than twelve months | item					1
Municipal Bonds [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	9,926		9,926		$ 10,117
Gross unrealized gains	165		165		91
Gross unrealized losses	(19)		(19)		(35)
Available-for-sale Securities, Total	10,072		10,072		10,173
Amortized cost [Abstract]
Total available for sale securities	9,926		9,926		10,117
Fair value [Abstract]
Fair value	10,072		10,072		10,173
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	3,557		3,557		1,639
12 months or longer, Fair value					3,079
Total, Fair value	3,557		3,557		4,718
Less than 12 months, Gross unrealized losses	(19)		(19)		(7)
12 months or longer, Gross unrealized losses					(28)
Total, Gross unrealized losses	$ (19)		$ (19)		$ (35)
Less than 12 months, number of positions | item	4		4		2
12 months or longer, number of positions | item					4
Total , number of positions | item	4		4		6
Fair value	$ 10,072		$ 10,072		$ 10,173
Number of securities in an unrealized loss position for less than twelve months | item	4		4		2
Number of securities in an unrealized loss position for more than twelve months | item					4
Private Equity Funds [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 2,198		$ 2,198		$ 2,684
Gross unrealized gains	823		823		1,350
Gross unrealized losses	(24)		(24)
Available-for-sale Securities, Total	2,997		2,997		4,034
Amortized cost [Abstract]
Total available for sale securities	2,198		2,198		2,684
Fair value [Abstract]
Fair value	2,997		2,997		4,034
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	235		235
Total, Fair value	235		235
Less than 12 months, Gross unrealized losses	(24)		(24)
Total, Gross unrealized losses	$ (24)		$ (24)
Less than 12 months, number of positions | item	1		1
Total , number of positions | item	1		1
Fair value	$ 2,997		$ 2,997		4,034
Number of securities in an unrealized loss position for less than twelve months | item	1		1
Common Stock [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Total available for sale securities	$ 26		$ 26		33
Gross unrealized gains					17
Available-for-sale Securities, Total	26		26		50
Amortized cost [Abstract]
Total available for sale securities	26		26		33
Fair value [Abstract]
Fair value	26		26		50
Available for sale securities, continuous unrealized loss position [Abstract]
Fair value	$ 26		$ 26		$ 50