Securities - Schedule of Contractual Maturity of Securities Available for Sale, Excluding Equity Securities (Details) - USD ($) $ in Thousands	Sep. 30, 2019	Dec. 31, 2018
Amortized Cost
1 year or less	$ 71,463
1 year – 5 years	108,190
5 years – 10 years	68,636
After 10 years	5,744
Total, Amortized Cost	254,033
Total debt securities	518,104	$ 521,337
Fair Value
1 year or less	71,468
1 year – 5 years	110,168
5 years – 10 years	73,242
After 10 years	5,957
Total, Fair Value	260,835
Total debt securities	529,867	516,863
Residential and multi-family mortgage
Amortized Cost
Mortgage & asset backed securities, Amortized Cost	236,241
Fair Value
Mortgage & asset backed securities, Fair Value	240,966
Pooled SBA
Amortized Cost
Mortgage & asset backed securities, Amortized Cost	26,810
Total debt securities	26,810	30,163
Fair Value
Mortgage & asset backed securities, Fair Value	27,101
Total debt securities	27,101	29,374
Other
Amortized Cost
Mortgage & asset backed securities, Amortized Cost	1,020
Total debt securities	1,020	1,020
Fair Value
Mortgage & asset backed securities, Fair Value	965
Total debt securities	$ 965	$ 934