Loans and Leases - Risk Ratings for Each Loan Portfolio Segment (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016	Jun. 30, 2016
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	$ 605,693	$ 602,009	$ 547,087
Commercial real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	258,662	261,561	239,776
Construction and land development
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	84,910	83,369	65,385
Commercial and industrial
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	116,200	108,146	97,270
Multi-family
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	29,030	23,389	21,010
Residential real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	56,363	56,899	50,104
Leases
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	56,258	61,838	66,898
Tax certificates
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	1,378	3,705	4,390
Consumer
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	2,892	3,102	$ 2,254
Pass
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	454,209	461,208
Pass | Commercial real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	223,724	221,862
Pass | Construction and land development
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	8,032	9,643
Pass | Commercial and industrial
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	90,332	92,174
Pass | Multi-family
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	18,736	16,974
Pass | Residential real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	55,736	56,225
Pass | Leases
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	53,955	59,641
Pass | Tax certificates
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	876	1,798
Pass | Consumer
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	2,818	2,891
Pass Watch
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	145,015	132,782
Pass Watch | Commercial real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	34,131	38,814
Pass Watch | Construction and land development
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	76,750	73,582
Pass Watch | Commercial and industrial
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	23,417	13,308
Pass Watch | Multi-family
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	10,294	6,415
Pass Watch | Residential real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	20	104
Pass Watch | Leases
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	329	348
Pass Watch | Consumer
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	74	211
Special Mention
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	264	320
Special Mention | Commercial and industrial
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income		320
Special Mention | Leases
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	264
Substandard
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	1,791	1,692
Substandard | Commercial real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	16
Substandard | Commercial and industrial
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	1,693	1,692
Substandard | Residential real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	82
Nonperforming Financing Receivable
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	4,414	6,007
Nonperforming Financing Receivable | Commercial real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	791	885
Nonperforming Financing Receivable | Construction and land development
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	128	144
Nonperforming Financing Receivable | Commercial and industrial
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	758	652
Nonperforming Financing Receivable | Residential real estate
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	525	570
Nonperforming Financing Receivable | Leases
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	1,710	1,849
Nonperforming Financing Receivable | Tax certificates
Risk Ratings for Each Loan Portfolio Segment [Abstract]
Total LHFI, net of unearned income	$ 502	$ 1,907