Loans - Recorded Investment in Residential, Consumer and Credit Card Loans Based on Payment Activity (Details) - USD ($) $ in Thousands	Sep. 30, 2019	Dec. 31, 2018
Residential real estate
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	$ 802,331	$ 771,309
Consumer
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	121,598	86,035
Credit cards
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	7,393	7,623
Performing | Residential real estate
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	797,490	765,823
Performing | Consumer
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	120,861	85,322
Performing | Credit cards
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	7,348	7,618
Nonperforming | Residential real estate
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	4,841	5,486
Nonperforming | Consumer
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	737	713
Nonperforming | Credit cards
Financing Receivable, Credit Quality Indicator [Line Items]
Financing receivable, net	$ 45	$ 5