DROs call for transparency on ‘Computer-Generated NDIS Plans’

CYDA Media Release.

Share:

LinkedIn
Twitter
Facebook
Email

The Guardian’s recent reporting on proposals to introduce computer-generated NDIS plans appears to signal a substantial change in the way participant budgets may be determined.

Disability Representative Organisations (DROs) emphasise that reforms require the highest standards of scrutiny, transparency and safeguards to ensure they do not undermine the rights and experiences of people with disability.  

Our concerns about the use of automation in New Framework Planning are compounded by changes to review pathways, which appear to narrow the grounds on which decisions can be challenged and limit the scope of the Administrative Review Tribunal (ART), which cannot vary a participant’s plan and can only trigger a reassessment by the original decision-maker. This would significantly limit participants’ ability to correct errors or challenge flawed assumptions. At the same time, there is currently no clear guarantee that written evidence provided by participants will be considered in these processes. We are deeply concerned that these changes, combined with increasing automation, will create significant risks, particularly for people with the highest support needs. 

People with disability, their families, and advocates have long raised concerns about the lack of transparency and accountability in how the NDIS makes decisions. Reference to ‘Computer-generated’ NDIS plans indicates Automated decision-making (ADM) – the use of computer systems to automate all or part of an administrative decision-making process. Artificial intelligence (AI) is a broad term referring to an engineered system that generates predictive outputs such as content, forecasts, recommendations or decisions for a given set of human-defined objectives or parameters without explicit programming.

ADM and AI systems are only as reliable as the information fed into them. If historical data has under-represented people with a psychosocial disability, intellectual disability, neurodevelopmental disability, complex communication needs, people with fluctuating, multiple or complex disabilities, First Nations people, and other intersectional and marginalised communities, ADM will reproduce and amplify those gaps. This is well-established across other sectors: algorithms built from “average” cases consistently fail those whose experiences sit at the margins – including women, First Nations people, culturally and linguistically diverse communities, and people with disability.

Computer-generated decisions also cannot explain how they reached a conclusion, what assumptions were prioritised, or whether the model was designed to minimise cost or standardise prices across vastly different geographic, service contexts and thin markets. People cannot meaningfully challenge a decision if they cannot see or understand how it was made. When this opacity is combined with weaker review rights, participants face the real risk of being unable to contest flawed assumptions. These risks are heightened for the many people who already face significant barriers in navigating the NDIS or the ART, including people with an intellectual disability or those without access to informal supports, advocacy or legal representation. 

This opacity is particularly concerning in Australia, which continues to lack a comprehensive legal framework regulating the use of AI and ADM in public administration. Without regulation, there is no requirement for algorithms to be transparent, reviewable, or accountable. Issues such as privacy, data integrity, system resilience, and the risks associated with commercial AI providers remain unresolved. 

The needs assessment and new planning framework needs to be meaningfully co-designed with the disability community and their representative organisations. This includes commitments to transparency, regular meetings and clarity about timelines and when feedback and ideas can influence legislation, Rule-making and implementation. 

DROs call on the NDIA to:
About our organisations:

This statement was developed by DROs with coordination support from Disability Advocacy Network Australia (DANA) in their role as the National Coordination. DROs are funded by the Department of Social Services (DSS) to represent people with disability. 

The following organisations have contributed to and/or expressed their support for this joint position statement: