Income Taxes (Details) - Schedule of Deferred Tax Assets and Liabilities - USD ($) $ in Thousands	Dec. 31, 2020	Dec. 31, 2019
Deferred tax assets
Allowance for loan losses	$ 23,399	$ 11,333
Purchase accounting		4,543
Pension actuarial losses	1,385
New Jersey net operating loss	4,370	3,424
Deferred compensation	1,835	1,440
Unrealized losses on securities and swaps		1,509
Deferred loan costs, net of fees	357	20
Capital lease	225	230
Nonaccrual interest	51	69
Other	4,519	2,240
Total deferred tax assets	36,141	24,808
Deferred tax liabilities
Employee benefit plans	(2,161)	(2,131)
Purchase accounting	(1,821)
Pension actuarial gains		(1,062)
Depreciation	(187)	(1,146)
Prepaid expenses	(201)	(173)
Market discount accretion	(428)	(32)
Unrealized gains on securities and swaps	(2,171)
Total deferred tax liabilities	(6,969)	(4,544)
Net deferred tax assets	$ 29,172	$ 20,264