Income Taxes (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended								12 Months Ended
	Dec. 31, 2012	Sep. 30, 2012	Jun. 30, 2012	Mar. 31, 2012	Dec. 31, 2011	Sep. 30, 2011	Jun. 30, 2011	Mar. 31, 2011	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Current:
Federal									$ 4,346	$ (966)	$ (538)
State									935		(587)
Total									5,281	(966)	(1,125)
Deferred:
Federal									(5,649)	(4,043)	118
State									(777)
Total									(6,426)	(4,043)	118
Income tax provision (benefit)	5,809	(1,914)	(5,243)	203	2,743	(1,313)	(7,216)	777	(1,145)	(5,009)	(1,007)
Statutory Federal income tax rate (as a percent)									35.00%
Reconciliation of the income tax provision (benefit) and the amount that would be computed by applying the statutory federal income tax rate to loss before income taxes
Computed tax at federal statutory rate									(2,185)	(4,039)	(544)
Tax effect of:
Life insurance									(18)
Tax-exempt income, net									(151)
State income taxes									103		(587)
Nondeductible expenses									352	(970)	124
Nondeductible transaction costs									1,151
Minority interest									(174)
Prior year return to provision adjustment									(150)
Other									(73)
Income tax provision (benefit)	5,809	(1,914)	(5,243)	203	2,743	(1,313)	(7,216)	777	(1,145)	(5,009)	(1,007)
Deferred tax assets:
Net operating loss carryforwards	16,377				19,598				16,377	19,598
Purchase accounting adjustment - loans	50,752								50,752
Allowance for loan losses	1,235								1,235
Compensation and benefits	15,246								15,246
Indemnification agreements	8,242								8,242
Losses and LAE discounting	505				482				505	482
Unearned premiums	5,682				5,424				5,682	5,424
Non-accrual loan interest	1,497								1,497
Partnership investments	1,050								1,050
Foreclosed property	3,701								3,701
AMT credit carryforwards	769				769				769	769
Other	3,413				1,095				3,413	1,095
Deferred tax assets	108,469				27,368				108,469	27,368
Deferred tax liabilities:
Premises and equipment	10,109								10,109
Intangible assets	30,068				3,684				30,068	3,684
Derivatives	12,213								12,213
Net other comprehensive income	4,337								4,337
Deferred policy acquisition costs	6,934				6,714				6,934	6,714
Securities	8,665				8,616				8,665	8,616
Other	3,110								3,110
Total	75,436				19,014				75,436	19,014
Net deferred tax asset	$ 33,033				$ 8,354				$ 33,033	$ 8,354