CSIRO report maps sovereign capability to build 'foundational' AI tech

Foundation models, the technology underpinning the rise of generative artificial intelligence (AI), could boost Australia’s productivity, bolster our economy and transform industries according to a new report by CSIRO.

Trained on vast amounts of data and able to perform wide-ranging, complex and generalised tasks, foundation models power AI products such as OpenAI’s ChatGPT, Microsoft’s Copilot and Google’s Gemini. At least 125 foundation models have been developed worldwide over the past few years with most coming from the United States (73%), China (15%) and Europe. Most are made by private-sector technology corporations.

CSIRO’s report on AI foundation models provides an accessible overview of the fast-moving global foundation model landscape, outlining opportunities to minimise risks and maximise their benefit for Australians.

Lead author Dr Stefan Hajkowicz said beneath the hype lies the potential to localise this global technology and improve a broad spectrum of Australian industries and services.

“We’ve all been impressed by the way these models can write a wedding speech or a poem. But the speed, power and colossal scale of the data analysis they can achieve has the potential to help us solve our greatest challenges, boost productivity and save lives,” Hajkowicz said. “A foundation model for health care for example could help us untangle complex, hidden relationships in patients’ health records, helping us reduce the more than 140,000 medical misdiagnoses in Australia each year due to human error.”

Professor Elanor Huntington, CSIRO’s Digital, National Facilities & Collections Executive Director, said building Australia’s sovereign capability in this new class of infrastructure requires an integrated approach.

“While there are significant benefits to fine-tuning existing models in terms of cost and the speed of innovation, using foreign models poses security and reliability risks,” Huntington said. “It may also result in tools that aren’t culturally appropriate in an Australian context, or that don’t realise the benefits for our workers that we want to see.”

Opportunities for Australia to maximise the positive impact of foundation models to benefit our citizens could include developing public-sector AI models, democratising access to high-performance computing, sharing datasets and promoting skills uplift, as well as fostering international collaborations.

“Australia needs to be alert to the risks and opportunities presented by this game-changing technology, and we hope this report will help make foundation models more accessible, start conversations and inspire further growth in our nation’s foundation model capabilities,” Huntington said.

The report, ‘Artificial Intelligence foundation models: Industry enablement, productivity growth, policy levers and sovereign capability considerations for Australia’, can be found here.

Image credit: iStock.com/monsitj