Salary Deferral Plans (Details)	12 Months Ended
	Dec. 31, 2016 USD ($) Participant	Dec. 31, 2015 USD ($)	Dec. 31, 2014 USD ($)
Salary Deferral Plan [Abstract]
Employees contributions	50.00%
Employer matching contribution to first 4%	100.00%
Percentage of employee self-directed contributions matched by employer	4.00%
Deferred Compensation Arrangement with Individual, Excluding Share-based Payments and Postretirement Benefits [Line Items]
Compensation expense	$ 3,985,000	$ 2,655,000	$ 2,381,000
Other liabilities	90,267,267	63,930,339
Cavalry ESOP [Member]
Deferred Compensation Arrangement with Individual, Excluding Share-based Payments and Postretirement Benefits [Line Items]
Compensation expense	$ 50,000	83,000	99,000
Period to distribute accumulated gains to participant	15 years
Number of participant accepting the settlement | Participant	11
Number of remaining participant in agreements | Participant	2
Other liabilities	$ 1,237,000	$ 1,312,000	$ 1,352,000
Discount rate of fair value of future obligation owed to remaining participants	5.00%	5.00%	5.00%
Supplemental Retirement Plan [Member]
Deferred Compensation Arrangement with Individual, Excluding Share-based Payments and Postretirement Benefits [Line Items]
Other liabilities	$ 14,200,000	$ 6,300,000
CapitalMark Supplemental Retirement Plan [Member]
Deferred Compensation Arrangement with Individual, Excluding Share-based Payments and Postretirement Benefits [Line Items]
Period to distribute accumulated gains to participant	23 years
Other liabilities	$ 5,000,000
Avenue Supplemental Employee Retirement Plan [Member]
Deferred Compensation Arrangement with Individual, Excluding Share-based Payments and Postretirement Benefits [Line Items]
Period to distribute accumulated gains to participant	26 years
Other liabilities	$ 7,900,000