Attention Is All You Need (2017)
Introduced the Transformer architecture, replacing recurrent networks with self-attention and laying the groundwork for all modern LLMs.
Member resources
Curated guidance and influential publications about artificial intelligence.
Resource preview
Research and guidance on AI systems, their capabilities and responsible use, curated for RAIUC members.
Introduced the Transformer architecture, replacing recurrent networks with self-attention and laying the groundwork for all modern LLMs.
The GPT-3 paper by OpenAI demonstrated that massive transformers could perform un-fine-tuned tasks effectively via in-context learning.
The InstructGPT paper popularised reinforcement learning from human feedback (RLHF) for model alignment.
Outlined an efficient fine-tuning approach that freezes base weights and injects trainable rank-decomposition matrices.
Sign in to access the full resources. RAIUC certification and member access are free.
Free membership with certification
RAIUC declaration-based certification and member access are completely free. Once your organisation is certified, create an account to use the full collection of templates, directories, explainers and learning material.
Explore carefully organised directories of language models, image, video, automation and specialist AI tools.
Find free and useful learning opportunities from recognised AI and technology organisations.
Adapt practical policy templates to help your organisation govern everyday AI use.
Use straightforward operational checklists for safer, more accountable AI adoption.
Read curated guidance and authoritative publications on responsible AI.
Share visual explainers, check terminology and build knowledge through interactive learning.
And more: AI books, podcasts, YouTube channels, downloadable infographics, local-AI tools and continually updated resources.