Investment Securities - By Contractual Maturity (Details) - USD ($) $ in Thousands	Jun. 30, 2016	Dec. 31, 2015
Amortized Cost
One Year or Less	$ 1,415
More than One Year to Five Years	28,380
More than Five Years to Ten Years	58,579
More than Ten Years	162,755
Total	251,129
Fair Value
One Year or Less	1,416
More than One Year to Five Years	28,806
More than Five Years to Ten Years	60,099
More than Ten Years	164,540
Total	254,861
Amortized Cost
One Year or Less	1,415
More than One Year to Five Years	28,380
More than Five Years to Ten Years	58,579
More than Ten Years	153,463
Total	241,837	$ 279,711
Fair Value
One Year or Less	1,416
More than One Year to Five Years	28,806
More than Five Years to Ten Years	60,099
More than Ten Years	155,150
Total	245,471	280,273
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	9,292
Amortized Cost	9,292	9,642
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	9,390
Total	9,390	9,572
Municipal bonds
Amortized Cost
One Year or Less	1,415
More than One Year to Five Years	28,380
More than Five Years to Ten Years	37,618
More than Ten Years	48,342
Total	115,755	128,546
Fair Value
One Year or Less	1,416
More than One Year to Five Years	28,806
More than Five Years to Ten Years	38,956
More than Ten Years	49,621
Total	118,799	130,245
Collateralized mortgage obligation
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	22,570
Total	22,570	24,722
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	22,844
Total	22,844	24,543
Mortgage-backed securities
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	20,961
More than Ten Years	82,551
Total	103,512	126,443
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	21,143
More than Ten Years	82,685
Total	103,828	125,485
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	8,076
Amortized Cost	8,076	8,400
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	8,174
Total	8,174	$ 8,330
Other
Amortized Cost
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	1,216
Amortized Cost	1,216
Fair Value
One Year or Less	0
More than One Year to Five Years	0
More than Five Years to Ten Years	0
More than Ten Years	1,216
Total	$ 1,216