SECURITIES - AMORTIZED COST, CARRYING AMOUNT AND FAIR VALUE DISCLOSURES (Details) - USD ($) $ in Thousands	Dec. 31, 2020	Jun. 30, 2020
Debt Securities, Available-for-sale [Line Items]
Securities Trading - Fair Value	$ 362	$ 105
Amortized Cost	207,133	188,059
Unrealized Gains	3,672	1,703
Unrealized Losses	(977)	(2,135)
Fair Value	209,828	187,627
Total RMBS securities
Debt Securities, Available-for-sale [Line Items]
Securities Trading - Fair Value	0	0
Amortized Cost	33,713	34,372
Unrealized Gains	1,373	1,658
Unrealized Losses	(976)	(872)
Fair Value	34,110	35,158
U.S. agencies
Debt Securities, Available-for-sale [Line Items]
Securities Trading - Fair Value	0	0
Amortized Cost	16,424	16,192
Unrealized Gains	552	634
Unrealized Losses	(1)	0
Fair Value	16,975	16,826
Non-agency
Debt Securities, Available-for-sale [Line Items]
Securities Trading - Fair Value	0	0
Amortized Cost	17,289	18,180
Unrealized Gains	821	1,024
Unrealized Losses	(975)	(872)
Fair Value	17,135	18,332
Total Non-RMBS
Debt Securities, Available-for-sale [Line Items]
Securities Trading - Fair Value	362	105
Amortized Cost	173,420	153,687
Unrealized Gains	2,299	45
Unrealized Losses	(1)	(1,263)
Fair Value	175,718	152,469
U.S. agencies
Debt Securities, Available-for-sale [Line Items]
Securities Trading - Fair Value	0	0
Amortized Cost	1,800	1,799
Unrealized Gains	0	0
Unrealized Losses	(1)	0
Fair Value	1,799	1,799
Municipal debt
Debt Securities, Available-for-sale [Line Items]
Securities Trading - Fair Value	362	105
Amortized Cost	3,405	10,550
Unrealized Gains	109	44
Unrealized Losses	0	(194)
Fair Value	3,514	10,400
Asset-backed securities and structured notes
Debt Securities, Available-for-sale [Line Items]
Securities Trading - Fair Value	0	0
Amortized Cost	168,215	141,338
Unrealized Gains	2,190	1
Unrealized Losses	0	(1,069)
Fair Value	$ 170,405	$ 140,270

Amount, before tax, of unrealized gain in accumulated other comprehensive income (AOCI) on investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=121645371&loc=d3e27161-111563

+ Details

Name:	us-gaap_AvailableForSaleDebtSecuritiesAccumulatedGrossUnrealizedGainBeforeTax
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount, before tax, of unrealized loss in accumulated other comprehensive income (AOCI) on investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=121645371&loc=d3e27161-111563

+ Details

Name:	us-gaap_AvailableForSaleDebtSecuritiesAccumulatedGrossUnrealizedLossBeforeTax
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amortized cost of investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=121645371&loc=d3e27161-111563

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=121558606&loc=SL82898722-210454

+ Details

Name:	us-gaap_AvailableForSaleDebtSecuritiesAmortizedCostBasis
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-03(6))
-URI http://asc.fasb.org/extlink&oid=120398452&loc=d3e534808-122878

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=121558606&loc=SL82898722-210454

Reference 3: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 45
-Paragraph 1
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=121553693&loc=d3e26610-111562

Reference 4: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (aa)
-URI http://asc.fasb.org/extlink&oid=121645371&loc=d3e27161-111563

+ Details

Name:	us-gaap_AvailableForSaleSecuritiesDebtSecurities
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Line items represent financial concepts included in a table. These concepts are used to disclose reportable information associated with domain members defined in one or many axes to the table.

+ References

No definition available.

+ Details

Name:	us-gaap_ScheduleOfAvailableForSaleSecuritiesLineItems
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount of investment in debt security measured at fair value with change in fair value recognized in net income (trading) and investment in equity security measured at fair value with change in fair value recognized in net income (FV-NI).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-03.4)
-URI http://asc.fasb.org/extlink&oid=120398452&loc=d3e534808-122878

+ Details

Name:	us-gaap_TradingSecurities
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_ResidentialMortgageBackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=ax_AgencyResidentialMortgageBackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=ax_NonAgencyResidentialMortgageBackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_OtherDebtSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_USGovernmentAgenciesDebtSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_MunicipalBondsMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=ax_NonAgencySecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: