Parent Company Condensed Financial Information - Condensed Balance Sheets (Details) - USD ($) $ in Thousands	Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Assets
Other assets	$ 47,053	$ 26,474
Total assets	3,040,837	2,635,545
Liabilities and Stockholders' Equity
Junior subordinated debentures	25,773	57,734
Senior notes	44,375	44,270
Other liabilities	36,156	25,062
Stockholders' equity	307,087	277,864	$ 229,081	$ 200,350
Total liabilities and stockholders' equity	3,040,837	2,635,545
Parent Company [Member]
Assets
Noninterest bearing deposit with bank subsidiary	47,601	26,562
Investment in subsidiaries	353,722	352,703
Other assets	3,270	3,981
Total assets	404,593	383,246
Liabilities and Stockholders' Equity
Junior subordinated debentures	25,773	57,734
Senior notes	44,375	44,270
Notes Payable	17,000
Other liabilities	10,358	3,378
Stockholders' equity	307,087	277,864
Total liabilities and stockholders' equity	$ 404,593	$ 383,246