Allowance for Loan Losses and Reserve for Unfunded Loan Commitments (Activity in the Allowance for Loan Losses by Portfolio Segment) (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2015	Sep. 30, 2014	Sep. 30, 2015	Sep. 30, 2014
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning Balance	$ 12,404	$ 12,858	$ 12,551	$ 13,141
Charge-offs	(198)	(716)	(1,205)	(2,208)
Recoveries	15	226	675	285
Net (charge-offs) recoveries	(183)	(490)	(530)	(1,923)
Provision for loan losses charged to expense	200	550	400	1,700
Ending Balance	12,421	12,918	12,421	12,918
Small Business Administration Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning Balance	1,998	2,505	1,883	2,587
Charge-offs	(86)	(232)	(220)	(485)
Recoveries	10	111	49	129
Net (charge-offs) recoveries	(76)	(121)	(171)	(356)
Provision for loan losses charged to expense	(11)	(102)	199	51
Ending Balance	1,911	2,282	1,911	2,282
Small Business Administration, 504 Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning Balance	879	929	1,337	957
Charge-offs			(589)	(92)
Net (charge-offs) recoveries			(589)	(92)
Provision for loan losses charged to expense	(89)	(69)	42	(5)
Ending Balance	790	860	790	860
Commercial Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning Balance	6,059	6,282	6,270	6,840
Charge-offs	(10)	(72)	(257)	(660)
Recoveries	5	95	576	135
Net (charge-offs) recoveries	(5)	23	319	(525)
Provision for loan losses charged to expense	146	148	(389)	138
Ending Balance	6,200	6,453	6,200	6,453
Residential Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning Balance	2,545	2,171	2,289	2,132
Charge-offs	(50)	(201)	(50)	(378)
Recoveries		20	49	20
Net (charge-offs) recoveries	(50)	(181)	(1)	(358)
Provision for loan losses charged to expense	186	371	393	587
Ending Balance	2,681	2,361	2,681	2,361
Consumer Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning Balance	756	741	667	573
Charge-offs	(52)	(211)	(89)	(593)
Recoveries			1	1
Net (charge-offs) recoveries	(52)	(211)	(88)	(592)
Provision for loan losses charged to expense	84	287	209	836
Ending Balance	788	817	788	817
Unallocated Financing Receivables [Member]
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning Balance	167	230	105	52
Provision for loan losses charged to expense	(116)	(85)	(54)	93
Ending Balance	$ 51	$ 145	$ 51	$ 145