Parent Corporation Only Financial Statements (Schedule of Condensed Cash Flow Statement) (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Cash flows from operating activities:
Net income	$ 19,925	$ 17,507	$ 13,926
Adjustments to reconcile net income to net cash provided by operating activities:
Change in deferred tax asset	1,739	1,912	3,406
Increase (Decrease) in Other Operating Assets	397	2,538	402
(Decrease) increase in other liabilities	(1,792)	980	(585)
Stock based compensation	59	39	35
Net cash provided by operating activities	23,153	21,066	18,084
Cash flows from investing activities:
Net cash used in investing activities	(77,554)	(108,320)	(152,580)
Cash flows from financing activities:
Net decrease in borrowings	(71,761)	(83,478)	(49,223)
Cash dividends on common stock	(4,254)	(2,778)	(1,955)
Cash dividends on preferred stock	(141)	(363)	(417)
Proceeds from Issuance of Preferred Stock and Preference Stock	0	0	11,250
Proceeds from exercise of stock options	21	141	328
Net cash provided by financing activities	30,955	82,291	208,100
Decrease in cash and cash equivalents	(23,446)	(4,963)	73,604
Cash and cash equivalents at beginning of period	106,138	111,101	37,497
Cash and cash equivalents at end of period	82,692	106,138	111,101
Parent Company [Member]
Cash flows from operating activities:
Net income	19,925	17,507	13,926
Adjustments to reconcile net income to net cash provided by operating activities:
Net gains on available for sale securities	(22)	(26)	0
Equity in undistributed earnings of subsidiary	(15,916)	(15,709)	(13,455)
Change in deferred tax asset	0	0	3
Increase (Decrease) in Other Operating Assets	(167)	563	(298)
(Decrease) increase in other liabilities	(276)	(772)	220
Stock based compensation	59	39	35
Net cash provided by operating activities	3,603	1,602	431
Cash flows from investing activities:
Proceeds from sales of available-for-sale securities	181	375	0
Purchase of available-for-sale securities	0	(410)	0
Investments in subsidiaries	0	0	(1,250)
Net cash used in investing activities	181	(35)	(1,250)
Cash flows from financing activities:
Net decrease in borrowings	0	0	(310)
Cash dividends on common stock	(4,254)	(2,778)	(1,955)
Cash dividends on preferred stock	(141)	(363)	(417)
Warrant repurchased	0	0	(245)
Issuance of restricted stock award	243	0	0
Issuance cost of stock	(13)	(8)	(5)
Proceeds from exercise of stock options	21	141	328
Tax expense from stock based compensation	16	28	0
Net cash provided by financing activities	(4,128)	(2,980)	(1,438)
Decrease in cash and cash equivalents	(344)	(1,413)	(2,257)
Cash and cash equivalents at beginning of period	629	2,042	4,299
Cash and cash equivalents at end of period	285	629	2,042
Series A Preferred Stock [Member] | Parent Company [Member]
Cash flows from financing activities:
Redemption of Series A preferred stock	0	0	(10,000)
Series B Preferred Stock [Member] | Parent Company [Member]
Cash flows from financing activities:
Proceeds from Issuance of Preferred Stock and Preference Stock	0	0	11,250
Issuance cost of stock	$ 0	$ 0	$ (84)