Investment Securities - Summary of Unrealized Losses of Available-for-Sale Securities (Details) - USD ($) $ in Thousands	Jun. 30, 2016	Dec. 31, 2015
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	$ 24,386	$ 165,890
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	70	1,471
Available-for-sale, Securities with losses over 12 months, Fair Value	15,439	32,975
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	180	1,134
Available-for-sale, Total, Fair Value	39,825	198,865
Available-for-sale, Total, Gross Unrealized Loss	250	2,605
Obligations of state and political subdivisions
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	762	1,192
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	1	27
Available-for-sale, Securities with losses over 12 months, Fair Value	0	0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	0	0
Available-for-sale, Total, Fair Value	762	1,192
Available-for-sale, Total, Gross Unrealized Loss	1	27
GSE mortgage-backed securities
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value		21,607
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss		229
Available-for-sale, Securities with losses over 12 months, Fair Value		0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss		0
Available-for-sale, Total, Fair Value		21,607
Available-for-sale, Total, Gross Unrealized Loss		229
Collateralized mortgage obligations: residential
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	22,419	140,999
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	65	1,207
Available-for-sale, Securities with losses over 12 months, Fair Value	12,815	30,029
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	155	1,069
Available-for-sale, Total, Fair Value	35,234	171,028
Available-for-sale, Total, Gross Unrealized Loss	220	2,276
Collateralized mortgage obligations: commercial
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	1,205	0
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	4	0
Available-for-sale, Securities with losses over 12 months, Fair Value	2,624	2,946
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	25	65
Available-for-sale, Total, Fair Value	3,829	2,946
Available-for-sale, Total, Gross Unrealized Loss	$ 29	65
Other asset-backed securities
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value		2,092
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss		8
Available-for-sale, Securities with losses over 12 months, Fair Value		0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss		0
Available-for-sale, Total, Fair Value		2,092
Available-for-sale, Total, Gross Unrealized Loss		$ 8