Fair Value (Details 3) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2012	Dec. 31, 2011	Jun. 30, 2012 Level 2	Jun. 30, 2012 Total	Jun. 30, 2012 Non-recurring basis Decrease in value	Jun. 30, 2011 Non-recurring basis Decrease in value	Jun. 30, 2012 Non-recurring basis Level 2	Dec. 31, 2011 Non-recurring basis Level 2	Jun. 30, 2012 Non-recurring basis Level 3	Dec. 31, 2011 Non-recurring basis Level 3	Jun. 30, 2012 Non-recurring basis Total	Dec. 31, 2011 Non-recurring basis Total
Assets measured at fair value
Portfolio Assets - loans (1)	$ 68,353	$ 97,090			$ (138)	$ (127)	$ 1,196			$ 1,923	$ 1,196	$ 1,923
Loans receivable - SBA held for investment (1)	20,226	19,151			(210)	(145)	239		133	559	372	559
Real estate held for sale (2)	14,320	26,856			(543)	(295)	1,803	6,297			1,803	6,297
Investments in unconsolidated subsidiaries	103,864	109,393								4,567		4,567
Assets held for sale, net of related liabilities			5,505	5,505				2,011				2,011
Total					$ (891)	$ (567)