Next Words - Lesson 17 - Ethics, Society, the Future

  • 0 Rating
  • 0 Reviews
  • 1 Students Enrolled

Next Words - Lesson 17 - Ethics, Society, the Future

Bias, memorisation, carbon cost, copyright, the EU AI Act, open weights, AGI claims

  • 0 Rating
  • 0 Reviews
  • 1 Students Enrolled
  • Free
  • Course Includes
  • PDF slides, 43 pages
  • Jupyter notebooks, 1 (zip)
  • Quiz, 5 questions
Tags:
Bias Privacy ethics carbon footprint AI regulation



What you will learn

  • Name the four stages at which bias is introduced and state what a StereoSet score is evidence for.
  • Compute the probability of a verbatim 50-token recall from the per-token loss.
  • Compute the factor between emissions on two grids and the emissions of one request.

Courselet Content

2 components
Next Words - Lesson 17 - Ethics, Society, the Future (pdf)
270.34 K

Requirements

  • Language model basics, arithmetic

General Overview

Description

GPT-3's training run is estimated at about 500 tonnes of CO2 on an average US grid and about 25 tonnes on Norwegian hydropower, a factor of 20. Bias is traced through four stages, data, annotation, amplification and deployment, and a 90/10 corpus sampled at T = 0.7 gives the majority continuation 95.8% of the time. A per-token loss of 0.010 nats gives a probability of 0.607 for 50 verbatim tokens, and the defences are deduplication, DP-SGD, output filters and unlearning. Inference over a year, at ten times the training figure, is 5,000 tonnes against 500 for training. The law is treated through fair use, the four risk tiers of the EU AI Act and open weights. Students price GPT-3's training run across four grid intensities, swap names in four prompts and score sixteen StereoSet-style triples.

Courses that include this CL

blog
Last Updated 20th November 2026
  • 1
  • Free

Recommended for you

blog
Last Updated 10th December 2023
  • 5
blog
Last Updated 2nd August 2023
  • 2
  • Free
blog
Last Updated 30th July 2023
  • 2
blog
Last Updated 16th June 2023
  • 7
blog
Last Updated 17th December 2022
  • 30
blog
Last Updated 16th January 2023
  • 47
  • Free
blog
Last Updated 7th January 2023
  • 8
  • Free
blog
Last Updated 14th March 2025
  • 52
  • Free
blog
Last Updated 7th November 2022
  • 11
  • Free
blog
Last Updated 19th November 2023
  • 7
blog
Last Updated 7th November 2022
  • 16
  • Free
blog
Last Updated 21st March 2025
  • 251
  • Free

Meet the instructors !

instructor
About the Instructor

https://www.joergosterrieder.com/