Investment Securities - By Contractual Maturity (Details) - USD ($) $ in Thousands	Mar. 31, 2017	Dec. 31, 2016
Amortized Cost
One Year or Less	$ 1,841
More than One Year to Five Years	28,985
More than Five Years to Ten Years	127,771
More than Ten Years	288,055
Total	446,652
Fair Value
One Year or Less	1,841
More than One Year to Five Years	29,057
More than Five Years to Ten Years	127,907
More than Ten Years	284,750
Total	443,555
Amortized Cost
One Year or Less	1,841
More than One Year to Five Years	28,985
More than Five Years to Ten Years	127,771
More than Ten Years	279,783
Total	438,380	$ 385,662
Fair Value
One Year or Less	1,841
More than One Year to Five Years	29,057
More than Five Years to Ten Years	127,907
More than Ten Years	276,603
Total	435,408	380,963
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	8,272
Amortized Cost	8,272	8,565
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	8,147
Total	8,147	8,461
Corporate
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	45,523
More than Ten Years	8,000
Total	53,523	37,475
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	46,188
More than Ten Years	8,000
Total	54,188	37,642
Municipal bonds
Amortized Cost
One Year or Less	1,841
More than One Year to Five Years	26,585
More than Five Years to Ten Years	48,823
More than Ten Years	52,117
Total	129,366	120,155
Fair Value
One Year or Less	1,841
More than One Year to Five Years	26,672
More than Five Years to Ten Years	48,411
More than Ten Years	51,858
Total	128,782	118,803
Collateralized mortgage obligation: residential
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	1,308
More than Ten Years	28,837
Total	30,145	31,536
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	1,310
More than Ten Years	28,693
Total	30,003	31,388
Mortgage-backed securities
Amortized Cost
One Year or Less	0
More than One Year to Five Years	2,400
More than Five Years to Ten Years	32,117
More than Ten Years	190,829
Total	225,346	196,496
Fair Value
One Year or Less	0
More than One Year to Five Years	2,385
More than Five Years to Ten Years	31,998
More than Ten Years	188,052
Total	222,435	193,130
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	7,095
Amortized Cost	7,095	7,375
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	6,970
Total	6,970	$ 7,271
Other
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	1,177
Amortized Cost	1,177
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	1,177
Total	$ 1,177