Consolidated Statements of Cash Flows - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2017	Dec. 31, 2016	Dec. 31, 2015
Cash flows from operating activities:
Net (loss) earnings	$ (11,761)	$ 9,439	$ 11,017
Adjustments to reconcile net (loss) earnings to net cash provided by operating activities:
Depreciation	5,660	5,920	6,168
Accretion of purchase accounting adjustments	(287)	(750)	(1,235)
Provision for loan losses	30,200	10,600	13,900
Deferred tax benefit	(879)
Deferred tax benefit	(4,474)	(1,582)	(1,785)
Amortization of premiums on securities, net	2,826	2,963	2,815
Accretion of other investments	0	0	(1)
Net (gain) loss on sale of other real estate	(18)	57	1
Net write down of other real estate owned	422	130	111
Net loss (gain) on sale/disposal of premises and equipment	550	(35)	(24)
Write down of assets held for sale	1,359	0	0
Loss on Transfer of Loans To Held For Sale	6,030	0	0
Income recognized from death benefit on bank owned life insurance	0	0	160
Stock-based compensation expense	163	210	355
Net excess tax benefit from stock-based compensation	397	281	607
ESOP compensation expense	62	(106)	0
Net gain on sale of investment securities	347	20	1,243
Change in accrued interest receivable	(707)	(982)	41
Change in accrued interest payable	(31)	(9)	(114)
Change in other assets and liabilities, net	(7,538)	1,008	(661)
Net cash provided by operating activities	26,101	27,124	29,792
Cash flows from investing activities:
Proceeds from maturities and calls of securities available-for-sale	56,452	68,696	70,934
Proceeds from maturities and calls of securities held-to-maturity	15,417	17,589	23,288
Proceeds from sale of securities available-for-sale	16,979	6,803	40,277
Proceeds from sale of security held-to-maturity	887	0	0
Purchases of securities available-for-sale	(43,223)	(104,491)	(156,449)
Proceeds from redemption of other investments	57	600	2,180
Purchases of other investments	(916)	(767)	(3,377)
Proceeds from bank owned life insurance death benefit	0	0	498
Net change in loans	50,544	(25,698)	14,480
Purchases of premises and equipment	(3,756)	(5,823)	(5,374)
Proceeds from sale of premises and equipment	2,075	89	83
Proceeds from sale of other real estate owned	1,763	3,170	1,514
Purchase of other real estate owned	0	0	(351)
Net cash provided by (used in) investing activities	96,279	(39,832)	(12,297)
Cash flows from financing activities:
Change in deposits	(99,741)	28,615	(34,285)
Change in securities sold under agreements to repurchase	(27,328)	8,504	23,859
Borrowings on Federal Home Loan Bank advances	90,000	25,000	150,000
Repayments of Federal Home Loan Bank advances	(65,046)	(50,068)	(150,064)
Proceeds from exercise of stock options	266	0	99
Proceeds from issuance of common stock	57,834	0	0
Stock offering expenses	(683)	0	0
Payment of dividends on preferred stock	(3,242)	(2,221)	(689)
Payment of dividends on common stock	(3,704)	(4,095)	(4,086)
Net cash (used in) provided by financing activities	(51,644)	5,735	(15,166)
Net increase (decrease) in cash and cash equivalents	70,736	(6,973)	2,329
Cash and cash equivalents, beginning of year	82,228	89,201	86,872
Cash and cash equivalents, end of year	152,964	82,228	89,201
Supplemental cash flow information:
Interest paid	6,057	5,700	5,695
Income taxes paid	2,500	4,473	6,641
Noncash investing and financing activities:
Change in accrued common stock dividends	(858)	0	(10)
Change in accrued preferred stock dividends	(1)	640	(3)
Net change in loan to ESOP	296	(140)	(843)
Change in unrealized gains/losses on securities available-for-sale, net of tax	(552)	(2,162)	(2,348)
Change in unrealized gains on derivative instruments, net of tax	58	642	0
Transfer of loans to other real estate	1,993	1,345	1,228
Transfer of loans to held for sale	$ 15,737	$ 0	$ 0