VARIABLE INTEREST ENTITIES INTANGIBLE ASSETS (Details) RSO (USD $)	12 Months Ended			1 Months Ended		12 Months Ended									1 Months Ended	0 Months Ended	12 Months Ended	0 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011	May 31, 2013 RSO [Member]	Oct. 31, 2012 RSO [Member]	Dec. 31, 2013 RSO [Member]	Dec. 31, 2012 RSO [Member]	Dec. 31, 2011 RSO [Member]	Dec. 31, 2013 RSO [Member] Investment in RCAM [Member]	Dec. 31, 2012 RSO [Member] Investment in RCAM [Member]	Dec. 31, 2011 RSO [Member] Investment in RCAM [Member]	Dec. 31, 2013 RSO [Member] Depreciation and Amortization [Member]	Dec. 31, 2013 RSO [Member] Equity Compensation Expense [Member]	Dec. 31, 2013 RSO [Member] General and Administrative Expense [Member]	Oct. 31, 2012 RSO [Member] Whitney CLO I, Ltd. [Member]	Oct. 31, 2013 Wholesale or Correspondent Relationships [Member] RSO [Member] Investment in PCA [Member]	Dec. 31, 2013 Wholesale or Correspondent Relationships [Member] RSO [Member] Investment in PCA [Member]	Oct. 31, 2013 Primary Capital Advisors LC [Member] RSO [Member]
Acquired Finite-Lived Intangible Assets [Line Items]
Preferred equity acquired					66.60%										66.60%
Write-off of unamortized balance of intangible asset					$ 2,600,000
Ownership percentage in VIE				68.30%
Depreciation and amortization	1,936,000	2,084,000	11,675,000			3,855,000	5,885,000	4,619,000				657,000
Intangible asset, estimated useful life																	2 years
Amortization of intangible assets						1,970,000	4,047,000	3,890,000
Expected amortization, 2014						2,100,000
Expected amortization, 2015						2,000,000
Expected amortization, 2016						1,800,000
Expected amortization, 2017						1,800,000
Expected amortization, 2018							1,600,000
Weighted average amortization period (in years)						7 years 8 months	8 years 8 months
Accumulated amortization						12,481,000	10,511,000		9,980,000	8,108,000							42,000
Fee income						6,075,000	7,068,000	7,789,000	5,300,000	7,000,000	7,800,000
Business Combination, Acquisition Related Costs																		333,000
Value of restricted stock awarded						823,000	2,189,000	1,203,000										800,000
Share-based Compensation Arrangement by Share-based Payment Award, Award Vesting Period																		3 years
Allocated Share-based Compensation Expense													48,000	27,000
Business Combination, Recognized Identifiable Assets Acquired and Liabilities Assumed, Net [Abstract]
Cash and cash equivalents																	1,233,000
Loans held for sale																	15,021,000
Loans held for investment																	2,071,000
Wholesale and correspondent relationships						24,303,000	23,703,000		21,213,000	21,213,000							600,000
Other assets							(89,000)										5,828,000
Total assets							25,411,000										24,753,000
Borrowings																	14,584,000
Other liabilities																	2,165,000
Total liabilities							3,750,000										16,749,000
Gain on bargain purchase																	391,000
Total cash purchase price						$ 7,613,000	$ 0	$ 0								$ 7,613,000