Fair Value by Balance Sheet grouping (Details) - USD ($)	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Cash and Cash Equivalents, Fair Value Disclosure	$ 159,956,000	$ 167,214,000
Investment Owned, at Fair Value	1,209,701,000	1,354,843,000
Mortgages Held-for-sale, Fair Value Disclosure	12,278,000	4,158,000
Derivative Asset	221,000	87,000
Impaired loans carried at fair value	2,090,000	6,399,000
Other Assets, Fair Value Disclosure	6,426,869,000	5,570,136,000
Loans Receivable, Fair Value Disclosure	6,441,458,000	5,580,780,000
Time Deposits, Fair Value	1,145,537,000	1,044,620,000
Other Liabilities, Fair Value Disclosure	1,273,000	1,267,000
Deposits, Fair Value Disclosure	1,146,810,000	1,045,887,000
Short-term Debt, Fair Value	230,657,000	221,966,000
Long-term Debt, Fair Value	200,726,000	400,203,000
Subordinated Debt Obligations, Fair Value Disclosure	14,372,000	12,959,000
Unrealized Gain (Loss) on Cash Flow Hedging Instruments	575,000
Equity securities
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Investment Owned, at Fair Value	1,993,000	1,649,000
Loans
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Swaps, fair value	1,870,000
Swap [Member]
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Swaps, fair value	226,000	226,000
Level 1
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Cash and Cash Equivalents, Fair Value Disclosure	159,956,000	167,214,000
Derivative Asset	0	0
Loans Receivable, Fair Value Disclosure	0	0
Other Liabilities, Fair Value Disclosure	1,273,000	1,267,000
Deposits, Fair Value Disclosure	1,273,000	1,267,000
Level 1 | Equity securities
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Investment Owned, at Fair Value	1,537,000	1,225,000
Level 1 | Loans
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Derivative Asset	0
Level 2
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Investment Owned, at Fair Value	1,209,701,000	1,354,843,000
Mortgages Held-for-sale, Fair Value Disclosure	12,278,000	4,158,000
Derivative Asset	221,000	87,000
Loans Receivable, Fair Value Disclosure	12,499,000	4,245,000
Time Deposits, Fair Value	1,145,537,000	1,044,620,000
Deposits, Fair Value Disclosure	1,145,537,000	1,044,620,000
Short-term Debt, Fair Value	230,657,000	221,966,000
Long-term Debt, Fair Value	200,726,000	400,203,000
Subordinated Debt Obligations, Fair Value Disclosure	14,372,000	12,959,000
Level 2 | Loans
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Derivative Asset	1,870,000
Swaps, fair value	1,870,000
Level 2 | Swap [Member]
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Unrealized Gain (Loss) on Cash Flow Hedging Instruments	575,000
Fair Value, Inputs, Level 3 [Member]
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Derivative Asset	0	0
Impaired loans carried at fair value	2,090,000	6,399,000
Other Assets, Fair Value Disclosure	6,426,869,000	5,570,136,000
Loans Receivable, Fair Value Disclosure	6,428,959,000	5,576,535,000
Deposits, Fair Value Disclosure	0	0
Fair Value, Inputs, Level 3 [Member] | Equity securities
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Investment Owned, at Fair Value	456,000	424,000
Fair Value, Inputs, Level 3 [Member] | Loans
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Derivative Asset	0
Fair Value, Inputs, Level 3 [Member] | Swap [Member]
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Swaps, fair value	226,000	226,000
Unrealized Gain (Loss) on Cash Flow Hedging Instruments	0
Estimate of Fair Value Measurement [Member] | Loans
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Derivative Asset	1,870,000
Reported Value Measurement [Member]
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Cash and Cash Equivalents, Fair Value Disclosure	159,956,000	167,214,000
Investment Owned, at Fair Value	1,209,701,000	1,355,229,000
Mortgages Held-for-sale, Fair Value Disclosure	12,278,000	4,158,000
Derivative Asset	221,000	87,000
Impaired loans carried at fair value	2,090,000	6,399,000
Other Assets, Fair Value Disclosure	6,430,136,000	5,629,976,000
Loans Receivable, Fair Value Disclosure	6,444,725,000	5,640,620,000
Time Deposits, Fair Value	1,139,131,000	1,043,177,000
Other Liabilities, Fair Value Disclosure	1,273,000	1,267,000
Deposits, Fair Value Disclosure	1,140,404,000	1,044,444,000
Short-term Debt, Fair Value	230,657,000	221,966,000
Long-term Debt, Fair Value	192,500,000	400,000,000
Subordinated Debt Obligations, Fair Value Disclosure	15,000,000	15,000,000
Reported Value Measurement [Member] | Equity securities
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Investment Owned, at Fair Value	1,993,000	1,649,000
Reported Value Measurement [Member] | Loans
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Derivative Asset	1,870,000
Swaps, fair value	1,870,000
Reported Value Measurement [Member] | Swap [Member]
Fair Value, Balance Sheet Grouping, Financial Statement Captions [Line Items]
Swaps, fair value	$ 226,000	$ 226,000