Income Taxes (Reconciliation of Income Tax Expense) (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Effective Income Tax Rate, Continuing Operations, Tax Rate Reconciliation [Abstract]
Federal statutory tax rate	35.00%	35.00%	35.00%
Amount of tax computed using federal statutory tax rate of 35% in all years	$ 4,913	$ 2,788	$ (55)
Non-taxable income	(39)	(54)	(88)
State income taxes, net of federal benefit	2,897	349	9,508
Valuation allowance on deferred tax assets	(1,300)	(146,743)	(34,578)
Bank-owned life insurance	(408)	(403)	(375)
Reduction of deferred tax assets at Granite	0	0	28,293
Nondeductible merger costs	351	0	0
Other	710	1,571	(1,379)
Total income tax (benefit) expense	$ 7,124	$ (142,492)	$ 1,326