ALLOWANCE FOR LOAN AND LEASE LOSSES - Changes in Allowance for Loan and Lease Losses (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	$ 16,380	$ 21,129	$ 30,331
Charge-offs	(6,271)	(13,211)	(31,714)
Recoveries	1,155	734	1,300
Provision	5,997	7,728	22,140
Reduction due to Asian sale			(928)
Ending balance	17,261	16,380	21,129
Ending balance: related to loans individually evaluated for impairment	2,026	138	1,907
Ending balance: related to loans collectively evaluated for impairment	15,235	16,242	19,222
LHFI [Abstract]
Ending balance	344,682	414,866	497,405
Ending balance: individually evaluated for impairment	28,828	46,077	42,425
Ending balance: collectively evaluated for impairment	315,854	368,789	454,980
Commercial Real Estate [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	7,744	9,534	10,039
Charge-offs	(1,313)	(1,685)	(7,352)
Recoveries	3	357	684
Provision	2,316	(462)	6,796
Reduction due to Asian sale			(633)
Ending balance	8,750	7,744	9,534
Ending balance: related to loans individually evaluated for impairment	835	0	1,363
Ending balance: related to loans collectively evaluated for impairment	7,915	7,744	8,171
LHFI [Abstract]
Ending balance	167,115	182,579	194,203
Ending balance: individually evaluated for impairment	10,958	17,311	10,060
Ending balance: collectively evaluated for impairment	156,157	165,268	184,143
Construction and Land Development [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	2,523	3,976	7,895
Charge-offs	(2,452)	(5,755)	(13,413)
Recoveries	816	196	116
Provision	2,100	4,106	9,508
Reduction due to Asian sale			(130)
Ending balance	2,987	2,523	3,976
Ending balance: related to loans individually evaluated for impairment	820	0	0
Ending balance: related to loans collectively evaluated for impairment	2,167	2,523	3,976
LHFI [Abstract]
Ending balance	37,215	54,120	79,638
Ending balance: individually evaluated for impairment	5,943	17,368	19,758
Ending balance: collectively evaluated for impairment	31,272	36,752	59,880
Commercial and Industrial [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	2,331	3,797	6,542
Charge-offs	(586)	(2,901)	(5,930)
Recoveries	67	22	81
Provision	112	1,413	3,223
Reduction due to Asian sale			(119)
Ending balance	1,924	2,331	3,797
Ending balance: related to loans individually evaluated for impairment	255	0	0
Ending balance: related to loans collectively evaluated for impairment	1,669	2,331	3,797
LHFI [Abstract]
Ending balance	40,560	54,136	74,027
Ending balance: individually evaluated for impairment	10,251	7,267	5,858
Ending balance: collectively evaluated for impairment	30,309	46,869	68,169
Multi Family [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	531	652	0
Charge-offs	(542)	(328)	(787)
Recoveries	0	0	18
Provision	665	207	1,421
Reduction due to Asian sale			0
Ending balance	654	531	652
Ending balance: related to loans individually evaluated for impairment	0	0	245
Ending balance: related to loans collectively evaluated for impairment	654	531	407
LHFI [Abstract]
Ending balance	11,756	11,622	10,277
Ending balance: individually evaluated for impairment	0	1,703	2,453
Ending balance: collectively evaluated for impairment	11,756	9,919	7,824
Residential Portfolio Segment [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	1,188	1,106	3,762
Charge-offs	(111)	(635)	(3,211)
Recoveries	208	153	313
Provision	(187)	564	285
Reduction due to Asian sale			(43)
Ending balance	1,098	1,188	1,106
Ending balance: related to loans individually evaluated for impairment	14	24	74
Ending balance: related to loans collectively evaluated for impairment	1,084	1,164	1,032
LHFI [Abstract]
Ending balance	24,981	26,637	29,299
Ending balance: individually evaluated for impairment	994	1,139	2,159
Ending balance: collectively evaluated for impairment	23,987	25,498	27,140
Consumer Portfolio Segment [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	20	12	25
Charge-offs	0	0	0
Recoveries	0	0	37
Provision	9	8	(47)
Reduction due to Asian sale			(3)
Ending balance	29	20	12
Ending balance: related to loans individually evaluated for impairment	0	0	0
Ending balance: related to loans collectively evaluated for impairment	29	20	12
LHFI [Abstract]
Ending balance	1,139	949	793
Ending balance: individually evaluated for impairment	0	0	0
Ending balance: collectively evaluated for impairment	1,139	949	793
Leases [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	1,311	1,670	1,757
Charge-offs	(465)	(868)	(972)
Recoveries	32	6	51
Provision	230	503	834
Reduction due to Asian sale			0
Ending balance	1,108	1,311	1,670
Ending balance: related to loans individually evaluated for impairment	55	114	194
Ending balance: related to loans collectively evaluated for impairment	1,053	1,197	1,476
LHFI [Abstract]
Ending balance	37,347	36,014	38,725
Ending balance: individually evaluated for impairment	81	266	335
Ending balance: collectively evaluated for impairment	37,266	35,748	38,390
Tax Certificates [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	425	380	290
Charge-offs	(802)	(1,039)	(49)
Recoveries	29	0	0
Provision	820	1,084	139
Reduction due to Asian sale			0
Ending balance	472	425	380
Ending balance: related to loans individually evaluated for impairment	47	0	31
Ending balance: related to loans collectively evaluated for impairment	425	425	349
LHFI [Abstract]
Ending balance	24,569	48,809	70,443
Ending balance: individually evaluated for impairment	601	1,023	1,802
Ending balance: collectively evaluated for impairment	23,968	47,786	68,641
Unallocated [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	307	2	21
Charge-offs	0	0	0
Recoveries	0	0	0
Provision	(68)	305	(19)
Reduction due to Asian sale			0
Ending balance	239	307	2
Ending balance: related to loans individually evaluated for impairment	0	0	0
Ending balance: related to loans collectively evaluated for impairment	239	307	2
LHFI [Abstract]
Ending balance	0	0	0
Ending balance: individually evaluated for impairment	0	0	0
Ending balance: collectively evaluated for impairment	$ 0	$ 0	$ 0