Loans and Credit Quality (Loans by loan grade) (Details) - USD ($) $ in Thousands		Jun. 30, 2016	Dec. 31, 2015
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		$ 3,730,836	$ 3,224,235
Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		3,543,789	3,033,197
Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		126,240	139,930
Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		34,495	31,779
Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		26,312	19,329
Residential Mortgage [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans	[1]	1,218,216	1,203,180
Residential Mortgage [Member] | Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans	[1]	1,185,120	1,165,990
Residential Mortgage [Member] | Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		4,098	7,933
Residential Mortgage [Member] | Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		16,317	16,439
Residential Mortgage [Member] | Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		12,681	12,818
Home Equity Line of Credit [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		309,204	256,373
Home Equity Line of Credit [Member] | Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		306,934	253,912
Home Equity Line of Credit [Member] | Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		100	381
Home Equity Line of Credit [Member] | Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		507	478
Home Equity Line of Credit [Member] | Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		1,663	1,602
Consumer Portfolio Segment [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		1,527,420	1,459,553
Consumer Portfolio Segment [Member] | Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		1,492,054	1,419,902
Consumer Portfolio Segment [Member] | Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		4,198	8,314
Consumer Portfolio Segment [Member] | Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		16,824	16,917
Consumer Portfolio Segment [Member] | Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		14,344	14,420
Commercial Real Estate [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		762,170	600,703
Commercial Real Estate [Member] | Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		696,170	535,903
Commercial Real Estate [Member] | Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		58,959	55,058
Commercial Real Estate [Member] | Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		3,147	7,067
Commercial Real Estate [Member] | Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		3,894	2,675
Multifamily Residential [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		562,728	426,557
Multifamily Residential [Member] | Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		544,157	403,604
Multifamily Residential [Member] | Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		17,122	20,738
Multifamily Residential [Member] | Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		903	1,657
Multifamily Residential [Member] | Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		546	558
Construction Loans [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		639,441	583,160
Construction Loans [Member] | Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		618,551	552,819
Construction Loans [Member] | Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		8,908	25,520
Construction Loans [Member] | Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		10,510	4,407
Construction Loans [Member] | Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		1,472	414
Commercial Loan [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		239,077	154,262
Commercial Loan [Member] | Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		192,857	120,969
Commercial Loan [Member] | Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		37,053	30,300
Commercial Loan [Member] | Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		3,111	1,731
Commercial Loan [Member] | Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		6,056	1,262
Commercial Portfolio Segment [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		2,203,416	1,764,682
Commercial Portfolio Segment [Member] | Pass [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		2,051,735	1,613,295
Commercial Portfolio Segment [Member] | Watch [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		122,042	131,616
Commercial Portfolio Segment [Member] | Special Mention [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		17,671	14,862
Commercial Portfolio Segment [Member] | Substandard [Member]
Designated Loan Grades by Loan Portfolio Segment and Loan Class [Abstract]
Total loans		$ 11,968	$ 4,909

[1] Includes $22.4 million and $21.5 million at June 30, 2016 and December 31, 2015, respectively, of loans where a fair value option election was made at the time of origination and, therefore, are carried at fair value with changes recognized in the consolidated statements of operations.