FAIR VALUE - LEVEL 3 ASSETS MEASURED ON RECURRING BASIS (Details) - Recurring - Level 3 - USD ($) $ in Thousands	3 Months Ended
Sep. 30, 2019	Sep. 30, 2018
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Opening Balance	$ 24,055	$ 29,148
Total gains or losses for the period - Included in other comprehensive income	689	442
Purchases, originations, issues, sales and settlements:
Purchases/originations	1,531	753
Sales		(2,058)
Settlements	(582)	(724)
Closing balance	25,491	27,178
Change in unrealized gains or losses for the period included in earnings for assets held at the end of the reporting period	(202)	(383)
Included in earnings—Sale of securities
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Total gains or losses for the period - Included in earnings		(133)
Included in earnings—Mortgage banking income
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Total gains or losses for the period - Included in earnings	(202)	(250)
Non-Agency RMBS
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Opening Balance	13,025	17,443
Total gains or losses for the period - Included in other comprehensive income	689	442
Purchases, originations, issues, sales and settlements:
Purchases/originations	0	0
Sales		(2,058)
Settlements	(582)	(724)
Closing balance	13,132	14,970
Change in unrealized gains or losses for the period included in earnings for assets held at the end of the reporting period	0	(133)
Non-Agency RMBS \| Included in earnings—Sale of securities
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Total gains or losses for the period - Included in earnings		(133)
Non-Agency RMBS \| Included in earnings—Mortgage banking income
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Total gains or losses for the period - Included in earnings	0	0
Mortgage Servicing Rights
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Opening Balance	9,784	10,752
Total gains or losses for the period - Included in other comprehensive income	0	0
Purchases, originations, issues, sales and settlements:
Purchases/originations	1,531	753
Sales		0
Settlements	0	0
Closing balance	10,632	11,216
Change in unrealized gains or losses for the period included in earnings for assets held at the end of the reporting period	(683)	(289)
Mortgage Servicing Rights \| Included in earnings—Sale of securities
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Total gains or losses for the period - Included in earnings		0
Mortgage Servicing Rights \| Included in earnings—Mortgage banking income
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Total gains or losses for the period - Included in earnings	(683)	(289)
Derivative Instruments, net
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Opening Balance	1,246	953
Total gains or losses for the period - Included in other comprehensive income	0	0
Purchases, originations, issues, sales and settlements:
Purchases/originations	0	0
Sales		0
Settlements	0	0
Closing balance	1,727	992
Change in unrealized gains or losses for the period included in earnings for assets held at the end of the reporting period	481	39
Derivative Instruments, net \| Included in earnings—Sale of securities
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Total gains or losses for the period - Included in earnings		0
Derivative Instruments, net \| Included in earnings—Mortgage banking income
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Total gains or losses for the period - Included in earnings	$ 481	$ 39

A roll forward is a reconciliation of a concept from the beginning of a period to the end of a period.

No definition available.

Name:	us-gaap_FairValueAssetsMeasuredOnRecurringBasisUnobservableInputReconciliationCalculationRollForward
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount of gain (loss) recognized in income from asset measured at fair value on recurring basis using unobservable input (level 3).

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 820
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (c)(1)
-URI http://asc.fasb.org/extlink&oid=117815213&loc=d3e19207-110258

+ Details

Name:	us-gaap_FairValueMeasurementWithUnobservableInputsReconciliationRecurringBasisAssetGainLossIncludedInEarnings1
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

Amount of gain (loss) recognized in other comprehensive income (OCI) from asset measured at fair value on recurring basis using unobservable input (level 3).

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 820
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (c)(1a)
-URI http://asc.fasb.org/extlink&oid=117815213&loc=d3e19207-110258

+ Details

Name:	us-gaap_FairValueMeasurementWithUnobservableInputsReconciliationRecurringBasisAssetGainLossIncludedInOtherComprehensiveIncomeLoss
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

Amount of increase (decrease) of financial instrument classified as an asset measured using unobservable inputs that reflect the entity's own assumption about the assumptions market participants would use in pricing.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 820
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=117815213&loc=d3e19207-110258

+ Details

Name:	us-gaap_FairValueMeasurementWithUnobservableInputsReconciliationRecurringBasisAssetPeriodIncreaseDecrease
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount of purchases of financial instrument classified as an asset measured using unobservable inputs that reflect the entity's own assumption about the assumptions market participants would use in pricing.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 820
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (c)(2)
-URI http://asc.fasb.org/extlink&oid=117815213&loc=d3e19207-110258

+ Details

Name:	us-gaap_FairValueMeasurementWithUnobservableInputsReconciliationRecurringBasisAssetPurchases
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- References

No definition available.

+ Details

Name:	us-gaap_FairValueMeasurementWithUnobservableInputsReconciliationRecurringBasisAssetPurchasesSalesIssuancesSettlementsAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount of sale of financial instrument classified as an asset measured using unobservable inputs that reflect the entity's own assumption about the assumptions market participants would use in pricing.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 820
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (c)(2)
-URI http://asc.fasb.org/extlink&oid=117815213&loc=d3e19207-110258

+ Details

Name:	us-gaap_FairValueMeasurementWithUnobservableInputsReconciliationRecurringBasisAssetSales
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

Amount of settlement of financial instrument classified as an asset measured using unobservable inputs that reflect the entity's own assumption about the assumptions market participants would use in pricing.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 820
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (c)(2)
-URI http://asc.fasb.org/extlink&oid=117815213&loc=d3e19207-110258

+ Details

Name:	us-gaap_FairValueMeasurementWithUnobservableInputsReconciliationRecurringBasisAssetSettlements
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

Fair value of financial instrument classified as an asset measured using unobservable inputs that reflect the entity's own assumption about the assumptions market participants would use in pricing.

+ References

+ Details

Name:	us-gaap_FairValueMeasurementWithUnobservableInputsReconciliationRecurringBasisAssetValue
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Details

Name:	us-gaap_FairValueByMeasurementFrequencyAxis=us-gaap_FairValueMeasurementsRecurringMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FairValueByFairValueHierarchyLevelAxis=us-gaap_FairValueInputsLevel3Member
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_IncomeStatementLocationAxis=ax_SaleOfMortgagebackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_IncomeStatementLocationAxis=us-gaap_MortgageBankingMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=ax_NonAgencyResidentialMortgageBackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=ax_MortgageServicingRightsMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_DerivativeFinancialInstrumentsAssetsMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: