Consolidated Statements Of Cash Flows (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 29, 2012
Cash flows from operating activities:
Net loss	$ (7,078)	$ (33,445)	$ (4,729)
Adjustments to reconcile net loss to net cash provided by (used in) operating activities:
Depreciation and amortization	5,394	5,482	5,779
Accretion of discount on long-term debt	4,667	4,026	3,212
Amortization of deferred debt issuance costs	492	492	451
Increase (decrease) in fair value of warrants	3,599	(3,613)	3,674
Amortization of premiums /discounts on loans purchased	12	(84)	(90)
Amortization of premiums /discounts on investment securities	2,484	1,985	934
Amortization of prepayment penalty on advances from FHLB	46	34
Provision for doubtful accounts on receivables from customers	960	960	480
(Recapture) provision of loan loss and write downs on real estate owned ("REO")	(4,893)	(6,061)	3,776
Deferred income tax (benefit) expense	(4,336)	(2,596)	9,023
Allowance for deferred tax asset	4,582	29,998	28
Deferred compensation for deferred compensation plan and restricted stock plans	(2,055)	(980)	547
(Gain) loss on sale of loans	(558)	(2,253)	9
Loss (gain) on fixed assets transactions	196	195	(1)
Gain on sale of available for sale investment securities	(781)	(3,650)	(557)
(Gain) loss on sale of REO and other repossessed assets	(619)	1,007	(25)
Gain on issuer's redemption of investment securities		(20)
Loss (gain) on equity in earnings of unconsolidated ventures	835	(124)	(572)
Dividend received on investments	(19)	(16)	(61)
Gain (loss) on fair value option of loans	(860)	145
Loss (gain) on interest rate swaps	1,093	(145)
Shortfall for taxes on vesting of restricted stock			62
Change in operating assets and liabilities:
Decrease in restricted cash	49
(Increase) decrease in assets segregated for regulatory purposes	(25,503)	11,562	62,026
Net change in broker, dealer and clearing organization accounts	86,538	(89,176)	(23,837)
Net change in client accounts	50,746	(42,485)	(66,845)
(Increase) decrease in securities owned	(25,992)	21,518	(9,564)
(Increase) decrease in securities purchased under agreements to resell	(20,586)	(26,810)	17,463
Decrease (increase) in other assets	1,321	6,815	(7,043)
(Decrease) increase in drafts payable	(1,248)	3,919	1,314
(Decrease) increase in securities sold, not yet purchased	(13,380)	64,580	1,494
(Decrease) increase in other liabilities	(6,956)	(5,763)	1,552
Net cash provided by (used in) operating activities	48,150	(64,503)	(1,500)
Cash flows from investing activities:
Purchase of fixed assets and capitalized improvements on REO	(3,541)	(4,257)	(3,842)
Proceeds from the sale of fixed assets and real estate	10,695	31,333	19,559
Loan originations and purchases	(2,290,374)	(5,566,038)	(4,043,938)
Loan repayments	2,279,746	5,769,538	4,129,802
Purchase of investment securities	(177,085)	(312,716)	(384,730)
Proceeds from the sale of investment securities	68,984	30,352	67,493
Proceeds from the issuer's redemption of investment securities	7,500	41,500
Cash received on investments	54,800	50,650	22,924
Proceeds from the sale of loans held for investment	6,429	19,782	1,751
Proceeds from the sale of FHLB stock	638	744	1,143
Purchases of FHLB stock	(45)	(1,557)
Proceeds from the maturity of available for sale securities	37,635	495
Cash paid to unwind/ terminate interest rate swap positions	(458)
Investment in unconsolidated subsidiaries	(300)	(180)
Investment of proceeds received from Hilltop Holdings, Inc., Oak Hill Capital Partners III, L.P. and Oak Hill Capital Management Partners III, L.P. in restricted fund			(30,000)
Net cash (used in) provided by investing activities	(5,376)	59,646	(219,838)
Cash flows from financing activities:
Payments on short-term borrowings	(2,296,403)	(2,251,350)	(2,534,350)
Cash proceeds from short-term borrowings	2,253,903	2,315,350	2,491,850
Increase (decrease) in deposits	6,420	(68,514)	(44,238)
Advances from the FHLB	5,540	50,009
Payments on advances from the FHLB	(26,020)	(20,953)	(26,071)
Fee payment for FHLB restructuring		(166)
Shortfall for taxes on vesting of restricted stock			(62)
Cash proceeds on securities sold under agreements to repurchase	2,331	9,546	17,152
Cash proceeds received from Hilltop Holdings, Inc., Oak Hill Capital Partners III, L.P and Oak Hill Capital Management Partners III, L.P.			100,000
Proceeds related to deferred compensation plan	317	276	309
Purchase of treasury stock related to deferred compensation plan	(288)	(121)	(329)
Net cash (used in) provided by financing activities	(54,200)	34,077	4,261
Net (decrease) increase in cash and cash equivalents	(11,426)	29,220	(217,077)
Cash and cash equivalents at beginning of period	111,046	81,826	298,903
Cash and cash equivalents at end of period	99,620	111,046	81,826
Supplemental schedule of non-cash investing and financing activities:
Grants of restricted stock	2,071	676	3,628
Foreclosures on loans	5,192	11,688	28,359
Investments sold not settled	23,723
Investments purchased not settled		7,120
Cash paid during the year for:
Interest	40,012	42,479	69,079
Income taxes