INVESTMENT SECURITIES (Narrative) (Details) (USD $)	12 Months Ended									12 Months Ended					3 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2013 RAI [Member]	Dec. 31, 2012 RAI [Member]	Dec. 31, 2011 RAI [Member]	Dec. 31, 2012 TBBK [Member]	Dec. 31, 2011 TBBK [Member]	Dec. 31, 2013 TBBK [Member] SERP [Member] Chief Executive Officer [Member]	Dec. 31, 2010 TBBK [Member] SERP [Member] Chief Executive Officer [Member]	Dec. 31, 2013 CLO securities [Member] Issuer	Dec. 31, 2012 CLO securities [Member] Issuer	Dec. 31, 2011 CLO securities [Member]	Dec. 31, 2013 CLO securities [Member] Apidos CLO II [Member]	Dec. 31, 2013 Equity securities [Member] TBBK [Member]	Mar. 31, 2013 Equity securities [Member] RREDX [Member]	Dec. 31, 2013 Equity securities [Member] RREDX [Member]
Schedule of Available-for-sale Securities [Line Items]
Number of CLO issuers that represent the retained equity interest										10	5
Minimum investment requirement													$ 2,000,000
Number of shares held (in shares)								0	103,494					18,972		10,000
Purchase of investment			3,213,000	2,597,000	600,000										100,000
Gain (loss) on sale of investments	6,293,000		6,293,000	1,221,000	321,000
Unrealized gains (losses)	(1,054,000)		(1,054,000)	1,272,000	0
Investments									1,100,000
Number of shares sold that were held in trust (in shares)						6,992	96,502
Realized gains						5,000	179,000
Other-than-temporary impairment on investments	$ 214,000	$ 74,000	$ 214,000	$ 74,000	$ 0					$ 214,000	$ 74,000	$ 0