Income Taxes (Details) - Schedule of Deferred Tax Assets and Liabilities - USD ($) $ in Thousands	Dec. 31, 2017	Dec. 31, 2016
Deferred tax assets:
Allowance for loan losses	$ 8,848	$ 10,374
Purchase accounting	2,310	4,881
Pension actuarial losses	1,647	2,439
New Jersey net operating loss	1,310	1,004
Deferred compensation	1,184	2,277
Unrealized losses on securities and swaps	483
Deferred loan costs, net of fees	474	613
Accrued rent	459	617
Capital lease	211	139
Nonaccrual interest	158	470
Other	7	14
Total deferred tax assets	17,091	22,828
Deferred tax liabilities:
Employee benefit plans	(1,501)	(2,275)
Depreciation	(434)	(1,039)
Prepaid expenses	(174)	(345)
Market discount accretion	(60)	(235)
Unrealized gains on securities and swaps	(224)	(449)
Other	(28)	(33)
Total deferred tax liabilities	(2,421)	(4,376)
Net deferred tax assets	$ 14,670	$ 18,452