BORROWINGS AND SUBORDINATED DEBENTURES (Details) (USD $)	12 Months Ended
	Dec. 31, 2013	Jan. 28, 2014	Jan. 28, 2013	Dec. 31, 2012
Borrowings, subordinated debentures and brokered deposits
Borrowings	$ 113,726,000			$ 12,591,000
Carrying value of securities pledged	208,300,000			157,300,000
Net subordinated debentures	132,645,000			108,250,000
FHLB secured lines of credit
Borrowings, subordinated debentures and brokered deposits
Overnight advances	106,600,000			0
Fixed interest rates (as a percent)	0.06%
Number of FHLB programs	2
Number of FHLB programs collateralized by loans	1
Carrying value of securities pledged	10,900,000
Remaining borrowing capacity	1,200,000,000
Non-recourse notes
Borrowings, subordinated debentures and brokered deposits
Non-recourse debt	7,126,000			12,591,000
Fixed interest rates (as a percent)	6.30%			6.28%
Weighted average remaining maturity of non-recourse debt	2 years
Subordinated debentures
Borrowings, subordinated debentures and brokered deposits
Maturity period of debt from the date of issue	30 years
Amount of trust preferred securities issued	131,000,000
Net subordinated debentures	132,645,000			108,250,000
Gross subordinated debentures	135,055,000			108,250,000
Unamortized discount	(2,410,000)
Prepayment penalties	0
Trust V
Borrowings, subordinated debentures and brokered deposits
Gross subordinated debentures	10,310,000			10,310,000
Current Rate (as a percent)		3.34%	3.41%
Rate Index	3 month LIBOR
Spread on variable rate (as a percent)	3.10%
Trust VI
Borrowings, subordinated debentures and brokered deposits
Gross subordinated debentures	10,310,000			10,310,000
Current Rate (as a percent)		3.29%	3.36%
Rate Index	3 month LIBOR
Spread on variable rate (as a percent)	3.05%
Trust CII
Borrowings, subordinated debentures and brokered deposits
Gross subordinated debentures	5,155,000			5,155,000
Current Rate (as a percent)		3.19%	3.26%
Rate Index	3 month LIBOR
Spread on variable rate (as a percent)	2.95%
Trust VII
Borrowings, subordinated debentures and brokered deposits
Gross subordinated debentures	61,856,000			61,856,000
Current Rate (as a percent)		2.99%	3.05%
Rate Index	3 month LIBOR
Spread on variable rate (as a percent)	2.75%
Trust CIII
Borrowings, subordinated debentures and brokered deposits
Gross subordinated debentures	20,619,000			20,619,000
Current Rate (as a percent)		1.93%	2.00%
Rate Index	3 month LIBOR
Spread on variable rate (as a percent)	1.69%
FCAL | Subordinated debentures
Borrowings, subordinated debentures and brokered deposits
Gross subordinated debentures	26,800,000
FCAL | Trust FCCI
Borrowings, subordinated debentures and brokered deposits
Gross subordinated debentures	16,495,000
Current Rate (as a percent)		1.84%
Rate Index	3 month LIBOR
Spread on variable rate (as a percent)	1.60%
FCAL | Trust FCBI
Borrowings, subordinated debentures and brokered deposits
Gross subordinated debentures	10,310,000
Current Rate (as a percent)		1.79%
Rate Index	3 month LIBOR
Spread on variable rate (as a percent)	1.55%
Bank | Federal Reserve Bank FRBSF
Borrowings, subordinated debentures and brokered deposits
Borrowing capacity	563,600,000
Construction and commercial loans pledged as collateral	702,600,000
Amount outstanding under line of credit	0			0
Bank | Unsecured lines of credit
Borrowings, subordinated debentures and brokered deposits
Borrowing capacity	80,000,000			80,000,000
Un-used commitment fees	0.00%
Amount outstanding under line of credit	$ 0			$ 0