Investment Securities - Summary of Unrealized Losses of Available-for-Sale Securities (Details) - USD ($) $ in Thousands	Mar. 31, 2016	Dec. 31, 2015
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	$ 69,805	$ 165,890
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	299	1,471
Available-for-sale, Securities with losses over 12 months, Fair Value	29,286	32,975
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	522	1,134
Available-for-sale, Total, Fair Value	99,091	198,865
Available-for-sale, Total, Gross Unrealized Loss	821	2,605
Obligations of state and political subdivisions
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	597	1,192
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	4	27
Available-for-sale, Securities with losses over 12 months, Fair Value	610	0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	6	0
Available-for-sale, Total, Fair Value	1,207	1,192
Available-for-sale, Total, Gross Unrealized Loss	10	27
GSE mortgage-backed securities
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	11,054	21,607
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	24	229
Available-for-sale, Securities with losses over 12 months, Fair Value	0	0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	0	0
Available-for-sale, Total, Fair Value	11,054	21,607
Available-for-sale, Total, Gross Unrealized Loss	24	229
Collateralized mortgage obligations: residential
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	56,918	140,999
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	269	1,207
Available-for-sale, Securities with losses over 12 months, Fair Value	26,003	30,029
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	475	1,069
Available-for-sale, Total, Fair Value	82,921	171,028
Available-for-sale, Total, Gross Unrealized Loss	744	2,276
Collateralized mortgage obligations: commercial
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	1,236	0
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	2	0
Available-for-sale, Securities with losses over 12 months, Fair Value	2,673	2,946
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	41	65
Available-for-sale, Total, Fair Value	3,909	2,946
Available-for-sale, Total, Gross Unrealized Loss	$ 43	65
Other asset-backed securities
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value		2,092
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss		8
Available-for-sale, Securities with losses over 12 months, Fair Value		0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss		0
Available-for-sale, Total, Fair Value		2,092
Available-for-sale, Total, Gross Unrealized Loss		$ 8