Investment Securities - Schedule of Amortized Cost and Fair Value by Contractual Maturity of Available-For-Sale Securities (Details) - USD ($) $ in Thousands	Sep. 30, 2017	Dec. 31, 2016
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	$ 270,070	$ 331,812
U.S. Treasury and government sponsored entities
Schedule of Available-for-sale Securities [Line Items]
Within 1 year, amortized cost	103,060
1-5 years, amortized cost	106,685
Amortized Cost	209,745	264,267
Within 1 year, fair value	102,929
1-5 years, fair value	106,171
Fair Value	$ 209,100
Within 1 year, weighted average yield	1.03%
1-5 years, weighted average yield	1.33%
Weighted Average Yield	1.18%
Corporate bonds
Schedule of Available-for-sale Securities [Line Items]
Within 1 year, amortized cost	$ 4,501
1-5 years, amortized cost	21,704
5-10 years, amortized cost	8,433
Amortized Cost	34,638	44,437
Within 1 year, fair value	4,513
1-5 years, fair value	21,957
5-10 years, fair value	8,612
Fair Value	$ 35,082
Within 1 year, weighted average yield	1.84%
1-5 years, weighted average yield	1.89%
5-10 years, weighted average yield	2.32%
Weighted Average Yield	1.99%
Collateralized loan obligations
Schedule of Available-for-sale Securities [Line Items]
Over 10 years, amortized cost	$ 3,000
Amortized Cost	3,000
Over 10 years, fair value	3,002
Fair Value	$ 3,002
Over 10 years, weighted average yield	3.04%
Weighted Average Yield	3.04%
Preferred stock
Schedule of Available-for-sale Securities [Line Items]
Over 10 years, amortized cost	$ 5,421
Amortized Cost	5,421	$ 4,922
Over 10 years, fair value	5,801
Fair Value	$ 5,801
Over 10 years, weighted average yield	6.37%
Weighted Average Yield	6.37%