LOANS AND ALLOWANCE FOR LOAN LOSSES (Details 3) (USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2013	Mar. 31, 2012	Dec. 31, 2012
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	$ 105,824		$ 111,922
With No Related Allowance Recorded: Unpaid Principal Balance	160,734		185,115
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	108,471	134,810
With No Related Allowance Recorded: Interest Income Recognized	567	2,248
With A Related Allowance Recorded: Recorded Investment	122,999		126,867
With A Related Allowance Recorded: Unpaid Principal Balance	160,148		157,590
With A Related Allowance Recorded: Related Allowance for Loan Losses	17,079		17,952
With A Related Allowance Recorded: Average Recorded Investment	125,338	148,645
With A Related Allowance Recorded: Interest Income Recognized	479	2,175
Recorded Investment, Total	228,823		238,789
Unpaid Principal Balance, Total	320,882		342,705
Related Allowance for Loan Losses, Total	17,079		17,952
Average Recorded Investment, Total	233,809	283,455
Interest Income Recognized, Total	1,046	4,423
Commercial financial and agricultural [Member]
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	5,080		6,451
With No Related Allowance Recorded: Unpaid Principal Balance	8,498		24,287
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	5,657	12,369
With No Related Allowance Recorded: Interest Income Recognized	0	215
With A Related Allowance Recorded: Recorded Investment	10,443		12,599
With A Related Allowance Recorded: Unpaid Principal Balance	26,644		19,255
With A Related Allowance Recorded: Related Allowance for Loan Losses	368		676
With A Related Allowance Recorded: Average Recorded Investment	11,630	24,157
With A Related Allowance Recorded: Interest Income Recognized	0	0
Recorded Investment, Total	15,523		19,050
Unpaid Principal Balance, Total	35,142		43,542
Related Allowance for Loan Losses, Total	368		676
Average Recorded Investment, Total	17,287	36,526
Interest Income Recognized, Total	0	215
Real estate construction and development [Member]
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	37,023		39,706
With No Related Allowance Recorded: Unpaid Principal Balance	69,313		74,044
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	37,974	59,094
With No Related Allowance Recorded: Interest Income Recognized	138	561
With A Related Allowance Recorded: Recorded Investment	3,099		2,477
With A Related Allowance Recorded: Unpaid Principal Balance	7,411		10,221
With A Related Allowance Recorded: Related Allowance for Loan Losses	1,149		1,452
With A Related Allowance Recorded: Average Recorded Investment	3,179	3,687
With A Related Allowance Recorded: Interest Income Recognized	0	114
Recorded Investment, Total	40,122		42,183
Unpaid Principal Balance, Total	76,724		84,265
Related Allowance for Loan Losses, Total	1,149		1,452
Average Recorded Investment, Total	41,153	62,781
Interest Income Recognized, Total	138	675
Bank Portfolio [Member]
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	1,611		1,611
With No Related Allowance Recorded: Unpaid Principal Balance	1,690		1,690
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	1,655	2,166
With No Related Allowance Recorded: Interest Income Recognized	13	32
With A Related Allowance Recorded: Recorded Investment	6,470		6,910
With A Related Allowance Recorded: Unpaid Principal Balance	8,174		8,655
With A Related Allowance Recorded: Related Allowance for Loan Losses	209		284
With A Related Allowance Recorded: Average Recorded Investment	6,646	9,288
With A Related Allowance Recorded: Interest Income Recognized	0	0
Recorded Investment, Total	8,081		8,521
Unpaid Principal Balance, Total	9,864		10,345
Related Allowance for Loan Losses, Total	209		284
Average Recorded Investment, Total	8,301	11,454
Interest Income Recognized, Total	13	32
Mortgage Division Portfolio [Member]
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	9,686		10,255
With No Related Allowance Recorded: Unpaid Principal Balance	20,859		22,102
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	9,663	10,308
With No Related Allowance Recorded: Interest Income Recognized	0	0
With A Related Allowance Recorded: Recorded Investment	88,861		87,819
With A Related Allowance Recorded: Unpaid Principal Balance	98,202		96,931
With A Related Allowance Recorded: Related Allowance for Loan Losses	12,444		11,574
With A Related Allowance Recorded: Average Recorded Investment	88,648	88,277
With A Related Allowance Recorded: Interest Income Recognized	479	2,050
Recorded Investment, Total	98,547		98,074
Unpaid Principal Balance, Total	119,061		119,033
Related Allowance for Loan Losses, Total	12,444		11,574
Average Recorded Investment, Total	98,311	98,585
Interest Income Recognized, Total	479	2,050
Home Equity [Member]
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	1,382		1,382
With No Related Allowance Recorded: Unpaid Principal Balance	1,507		1,507
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	1,576	1,232
With No Related Allowance Recorded: Interest Income Recognized	0	0
With A Related Allowance Recorded: Recorded Investment	5,386		7,289
With A Related Allowance Recorded: Unpaid Principal Balance	6,256		8,188
With A Related Allowance Recorded: Related Allowance for Loan Losses	1,354		1,784
With A Related Allowance Recorded: Average Recorded Investment	6,144	6,500
With A Related Allowance Recorded: Interest Income Recognized	0	0
Recorded Investment, Total	6,768		8,671
Unpaid Principal Balance, Total	7,763		9,695
Related Allowance for Loan Losses, Total	1,354		1,784
Average Recorded Investment, Total	7,720	7,732
Interest Income Recognized, Total	0	0
Multi-family residential [Member]
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	33,050		33,709
With No Related Allowance Recorded: Unpaid Principal Balance	35,015		37,206
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	33,014	13,682
With No Related Allowance Recorded: Interest Income Recognized	295	280
With A Related Allowance Recorded: Recorded Investment	2,028		1,292
With A Related Allowance Recorded: Unpaid Principal Balance	3,764		1,403
With A Related Allowance Recorded: Related Allowance for Loan Losses	947		1,138
With A Related Allowance Recorded: Average Recorded Investment	2,026	524
With A Related Allowance Recorded: Interest Income Recognized	0	0
Recorded Investment, Total	35,078		35,001
Unpaid Principal Balance, Total	38,779		38,609
Related Allowance for Loan Losses, Total	947		1,138
Average Recorded Investment, Total	35,040	14,206
Interest Income Recognized, Total	295	280
Commercial real estate [Member]
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	17,992		18,808
With No Related Allowance Recorded: Unpaid Principal Balance	23,852		24,279
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	18,932	35,959
With No Related Allowance Recorded: Interest Income Recognized	121	1,160
With A Related Allowance Recorded: Recorded Investment	6,690		8,453
With A Related Allowance Recorded: Unpaid Principal Balance	9,675		12,909
With A Related Allowance Recorded: Related Allowance for Loan Losses	607		1,043
With A Related Allowance Recorded: Average Recorded Investment	7,040	16,161
With A Related Allowance Recorded: Interest Income Recognized	0	11
Recorded Investment, Total	24,682		27,261
Unpaid Principal Balance, Total	33,527		37,188
Related Allowance for Loan Losses, Total	607		1,043
Average Recorded Investment, Total	25,972	52,120
Interest Income Recognized, Total	121	1,171
Consumer and Installment [Member]
Loan and Lease Receivables, Impaired [Abstract]
With No Related Allowance Recorded: Recorded Investment	0		0
With No Related Allowance Recorded: Unpaid Principal Balance	0		0
With No Related Allowance Recorded: Related Allowance for Loan Losses	0		0
With No Related Allowance Recorded: Average Recorded Investment	0	0
With No Related Allowance Recorded: Interest Income Recognized	0	0
With A Related Allowance Recorded: Recorded Investment	22		28
With A Related Allowance Recorded: Unpaid Principal Balance	22		28
With A Related Allowance Recorded: Related Allowance for Loan Losses	1		1
With A Related Allowance Recorded: Average Recorded Investment	25	51
With A Related Allowance Recorded: Interest Income Recognized	0	0
Recorded Investment, Total	22		28
Unpaid Principal Balance, Total	22		28
Related Allowance for Loan Losses, Total	1		1
Average Recorded Investment, Total	25	51
Interest Income Recognized, Total	$ 0	$ 0