Mortgage Servicing (Schedule of Mortgage Servicing) (Details) - USD ($)		12 Months Ended
		Dec. 31, 2016		Dec. 31, 2015		Dec. 31, 2014
Servicing Asset at Amortized Cost, Balance [Roll Forward]
Balance at beginning of year		$ 2,161,000		$ 493,000		$ 726,000
Capitalized servicing right fees upon sale(1)	[1]	9,000		294,000		15,000
Amortization charged against mortgage servicing fee income(1)	[1]	(734,000)		(231,000)		(262,000)
Valuation adjustment		(226,000)		3,000		(14,000)
Balance at end of year		1,210,000		2,161,000		493,000
Valuation Allowance:
Balance at beginning of year		(4,000)		(1,000)		(15,000)
(Increase) decrease in impairment reserve(1)	[1]	(226,000)		(3,000)
Reduction of impairment reserve	[1]					(14,000)
Balance at end of year		(230,000)		(4,000)		(1,000)
Fair value, beginning of year	[3]	2,947,000	[2]	1,447,000		1,494,000
Fair value, end of year	[3]	1,701,000	[2]	2,947,000	[2]	1,447,000
SBM Financial, Inc. [Member]
Servicing Asset at Amortized Cost, Balance [Roll Forward]
Capitalized servicing right fees upon sale(1)		$ 0		$ 1,608,000		$ 0

[1] Reported within mortgage banking income, net on the Company's consolidated statements of income.

[2] Reported fair value represents all MSRs currently being serviced by the Company at December 31, 2015.

[3] Reported fair value represents all MSRs currently being serviced by the Company.