Investment Securities - By Contractual Maturity (Details) - USD ($) $ in Thousands	Sep. 30, 2016	Dec. 31, 2015
Amortized Cost
One Year or Less	$ 1,023
More than One Year to Five Years	29,030
More than Five Years to Ten Years	76,094
More than Ten Years	213,638
Total	319,785
Fair Value
One Year or Less	1,024
More than One Year to Five Years	29,338
More than Five Years to Ten Years	77,161
More than Ten Years	214,681
Total	322,204
Amortized Cost
One Year or Less	1,023
More than One Year to Five Years	29,030
More than Five Years to Ten Years	76,094
More than Ten Years	204,738
Total	310,885	$ 279,711
Fair Value
One Year or Less	1,024
More than One Year to Five Years	29,338
More than Five Years to Ten Years	77,161
More than Ten Years	205,677
Total	313,200	280,273
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	8,900
Amortized Cost	8,900	9,642
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	9,004
Total	9,004	9,572
Corporate
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	17,255
More than Ten Years	6,000
Total	23,255
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	17,330
More than Ten Years	6,000
Total	23,330
Municipal bonds
Amortized Cost
One Year or Less	1,023
More than One Year to Five Years	29,030
More than Five Years to Ten Years	37,980
More than Ten Years	46,921
Total	114,954	128,546
Fair Value
One Year or Less	1,024
More than One Year to Five Years	29,338
More than Five Years to Ten Years	38,870
More than Ten Years	47,606
Total	116,838	130,245
Collateralized mortgage obligation
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	1,493
More than Ten Years	32,151
Total	33,644	24,722
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	1,497
More than Ten Years	32,369
Total	33,866	24,543
Mortgage-backed securities
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	19,366
More than Ten Years	119,666
Total	139,032	126,443
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	19,464
More than Ten Years	119,702
Total	139,166	125,485
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	7,697
Amortized Cost	7,697	8,400
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	7,801
Total	7,801	$ 8,330
Other
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	1,203
Amortized Cost	1,203
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	1,203
Total	$ 1,203