Net Income Per Common Share (Details) - USD ($) $ / shares in Units, $ in Thousands	3 Months Ended
	Mar. 31, 2020	Mar. 31, 2019
Numerator for basic earnings per share:
Net income	$ 1,048	$ 3,192
Less: Dividends on preferred stock	114	121
Net income available to common shareholders - basic	934	3,071
Numerator for diluted earnings per share:
Net income available to common shareholders - basic	934	3,071
Add: Dividends on convertible preferred stock	0	121
Add: Interest on subordinated debt (tax effected)	0	184
Net income available to common shareholders - diluted	$ 934	$ 3,376
Denominator:
Total average shares outstanding (in shares)	11,942,767	11,607,543
Effect of dilutive convertible preferred stock (in shares)	0	489,625
Effect of dilutive convertible subordinated debt (in shares)	0	837,500
Effect of dilutive stock options and restricted stock units (in shares)	355,325	242,613
Total diluted average shares outstanding (in shares)	12,298,092	13,177,281
Earnings per share - basic (in dollars per share)	$ 0.08	$ 0.26
Earnings per share - diluted (in dollars per share)	$ 0.08	$ 0.26
Stock option
Antidilutive Securities Excluded from Computation of Earnings Per Share [Line Items]
Antidilutive securities excluded form computation of earnings per share (in shares)	366,000	385,000
Restricted Stock Units (RSUs)
Antidilutive Securities Excluded from Computation of Earnings Per Share [Line Items]
Antidilutive securities excluded form computation of earnings per share (in shares)	77,000	43,000