Parent Company Only Financial Information (Condensed Balance Sheet) (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Assets
Cash and due from banks	$ 36,016	$ 47,256
Receivable from subsidiary bank	828	482
Total available-for-sale securities	606,108	639,185
Other assets	34,613	25,749
Total assets	2,059,108	1,918,050
Liabilities
Accrued expenses and other liabilities	21,381	27,427
Long-term borrowings	121,826	128,823
Total liabilities	1,837,555	1,696,322
Common stockholders' equity	221,553	221,728	206,657	230,681
Total liabilities and stockholders' equity	2,059,108	1,918,050
Bank
Assets
Investments in and Advance to Affiliates, Subsidiaries, Associates, and Joint Ventures	205,167	214,385
Non-Bank
Assets
Investments in and Advance to Affiliates, Subsidiaries, Associates, and Joint Ventures	30,527	29,893
Holding Company
Assets
Cash and due from banks	50	50
Interest-bearing deposits in subsidiary bank	5,541	2,743
Total available-for-sale securities	4,548	4,106
Other assets	854	866
Total assets	247,515	252,525
Liabilities
Accrued expenses and other liabilities	6,815	6,878
Long-term borrowings	19,147	23,919
Total liabilities	25,962	30,797
Common stockholders' equity	221,553	221,728
Total liabilities and stockholders' equity	$ 247,515	$ 252,525