5.2 Build and share competence on development and use of large language models

Proposed responsible party: Several measures, with different responsible parties

In collaboration with: Norwegian Directorate of Health, the health and care sector, other relevant environments, such as National Library, Digitalization Directorate, R&D institutions and higher education institutions.

Relevant for: The health and care sector

Problem to be solved: There is a lack of necessary competence to adapt, evaluate, and implement language models in the Norwegian health and care service.

Proposal: The health and care sector works systematically to build and share competence, especially through experiences from practical testing and use.

The work should include:

  1. This report can be used to raise competence and increase awareness of risks and risk-reducing measures, in health services, internally in the Norwegian Directorate of Health, in health authorities, and throughout the sector. Dissemination can be done actively through presentations, webinars, etc.
  2. Further develop cross-agency regulatory guidance service with topics related to the use of large language models in health and care services.
  3. Follow up seminar with general practitioners, related to the use of AI tools in general practice, in collaboration with the Norwegian Association for General Practice.
  4. Work to ensure that ongoing and future research and development projects on AI also include language models adapted to the Norwegian health and care sector.
  5. Follow Nordic and international approaches to development, testing, and use of language models in the health and care sector
  6. Share experiences and competence through, for example, seminars, reports, and guidance materials
  7. Pilot adaptations of large language models to the Norwegian health and care service in collaboration with one or more key actors, for instance the National Library.
  8. Pilot frameworks for testing/quality measurement of language models in real use situations in close collaboration with professional environments that can contribute to adaptations to Norwegian health and care services

For further details, see chapter 4.3 and chapter 4.4