Fair Value of Financial Instruments - Fair Value Hierarchy (Details) - USD ($) $ in Thousands	Jun. 30, 2018	Dec. 31, 2017
Total available-for-sale securities	$ 460,822	$ 473,275
Loans held-for-sale (mandatory pricing agreements)	20,672	23,571
Derivative, fair value	(1,521)	(354)
IRLCs
Derivative, fair value	724	551
Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	20,672	23,571
Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	2,932
Loans held-for-sale (mandatory pricing agreements)		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | IRLCs
Derivative, fair value	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	0	0
Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	460,822	470,343
Loans held-for-sale (mandatory pricing agreements)		27,836
Significant Other Observable Inputs (Level 2) | IRLCs
Derivative, fair value	0	0
Significant Other Observable Inputs (Level 2) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	20,672	23,571
Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Loans held-for-sale (mandatory pricing agreements)		0
Significant Unobservable Inputs (Level 3) | IRLCs
Derivative, fair value	724	551
Significant Unobservable Inputs (Level 3) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	0	0
U.S. Government-sponsored agencies
Total available-for-sale securities	120,232	133,190
U.S. Government-sponsored agencies | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
U.S. Government-sponsored agencies | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	120,232	133,190
U.S. Government-sponsored agencies | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Municipal securities
Total available-for-sale securities	92,824	96,377
Municipal securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Municipal securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	92,824	96,377
Municipal securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Mortgage-backed securities
Total available-for-sale securities	215,383	209,720
Mortgage-backed securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Mortgage-backed securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities		209,720
Mortgage-backed securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Asset-backed securities
Total available-for-sale securities	4,983	5,009
Asset-backed securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Asset-backed securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities		5,009
Asset-backed securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Corporate securities
Total available-for-sale securities	27,400	26,047
Corporate securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Corporate securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	27,400	26,047
Corporate securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Other securities
Total available-for-sale securities		2,932
Other securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities		2,932
Other securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities		0
Other securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities		0
Interest rate swaps | Interest rate swaps
Derivative asset, fair value	4,548
Derivative liability, fair value	(1,360)	(271)
Interest rate swaps | Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate swaps
Derivative asset, fair value	0
Derivative liability, fair value	0	0
Interest rate swaps | Significant Other Observable Inputs (Level 2) | Interest rate swaps
Derivative asset, fair value	4,548
Derivative liability, fair value	(1,360)	(271)
Interest rate swaps | Significant Unobservable Inputs (Level 3) | Interest rate swaps
Derivative asset, fair value	0
Derivative liability, fair value	0	0
Forward contracts | Forward contracts
Derivative, fair value	(161)	(80)
Forward contracts | Quoted Prices in Active Markets for Identical Assets (Level 1) | Forward contracts
Derivative, fair value	(161)	(80)
Forward contracts | Significant Other Observable Inputs (Level 2) | Forward contracts
Derivative, fair value	0	0
Forward contracts | Significant Unobservable Inputs (Level 3) | Forward contracts
Derivative, fair value	$ 0	$ 0