Premises and Equipment - Depreciation (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Property, Plant and Equipment [Line Items]
Depreciation, Depletion and Amortization, Nonproduction	$ 4,426	$ 3,614	$ 3,051
Equipment [Member]
Property, Plant and Equipment [Line Items]
Depreciation	1,942	1,620	1,713
Building and Building Improvements [Member]
Property, Plant and Equipment [Line Items]
Depreciation	1,757	1,140	1,003
Software Development [Member]
Property, Plant and Equipment [Line Items]
Depreciation	275	337	335
SBM Financial, Inc. [Member] | Property, Plant and Equipment [Member]
Property, Plant and Equipment [Line Items]
Depreciation	$ 452	$ 517	$ 0