Consolidated Statements of Income - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2018
Interest income:
Loans (including fee income)	$ 169,411	$ 158,228	$ 144,380
Mortgage-backed securities, CMOs and other asset-backed securities	9,329	16,182	16,591
U.S. GSE securities	365	465	837
State and municipal obligations	1,843	2,234	2,812
Corporate bonds	1,070	1,200	1,422
Deposits with banks	673	1,697	1,076
Other interest and dividend income	1,541	1,535	1,866
Total interest income	184,232	181,541	168,984
Interest expense:
Savings, NOW and money market deposits	10,435	23,687	15,928
Certificates of deposit of $100,000 or more	3,346	4,270	3,007
Other time deposits	1,198	1,502	1,801
Federal funds purchased and repurchase agreements	79	767	1,200
FHLB advances	3,992	4,573	5,729
Subordinated debentures	4,401	4,539	4,539
Total interest expense	23,451	39,338	32,204
Net interest income	160,781	142,203	136,780
Provision for credit losses	11,500	5,700	1,800
Net interest income after provision for credit losses	149,281	136,503	134,980
Non-interest income:
Service charges and other fees	8,955	10,059	9,853
Net securities gains (losses)	3,525	201	(7,921)
Loss on termination of swaps	(3,403)
Change in fair value of loans held for sale	(2,877)
Title fees	2,337	1,720	1,797
Gain on sale of Small Business Administration ("SBA") loans	3,940	1,984	2,078
Bank owned life insurance	2,186	2,230	2,219
Loan swap fees	3,742	7,460	716
Other	1,298	1,733	2,826
Total non-interest income	19,703	25,387	11,568
Non-interest expense:
Salaries and employee benefits	67,159	56,244	50,458
Occupancy and equipment	14,287	14,372	13,245
Technology and communications	9,712	7,905	6,465
Marketing and advertising	3,287	4,740	4,597
Professional services	4,988	3,797	4,004
FDIC assessments	1,950	608	1,665
Net fraud loss			8,900
Office relocation costs			750
Restructuring Costs	4,452
Amortization of other intangible assets	656	787	917
Other	6,766	7,686	7,179
Total non-interest expense	113,257	96,139	98,180
Income before income taxes	55,727	65,751	48,368
Income tax expense	13,685	14,060	9,141
Net income	$ 42,042	$ 51,691	$ 39,227
Basic earnings per share (in dollars per share)	$ 2.11	$ 2.59	$ 1.97
Diluted earnings per share (in dollars per share)	$ 2.11	$ 2.59	$ 1.97