<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/">
<channel>
 <title>LASTHUMAN Foundation: Research &amp; Insights</title>
 <link>https://lasthuman.today/insights/</link>
 <description>Research, analyses and articles of the LASTHUMAN Foundation on AI safety, responsible AI, technology policy and digital society.</description>
 <language>en</language>
 <lastBuildDate>Thu, 12 Nov 2026 09:00:00 GMT</lastBuildDate>
 <generator>LASTHUMAN build.js</generator>
 <atom:link href="https://lasthuman.today/feed.xml" rel="self" type="application/rss+xml"/>
 <image>
  <url>https://lasthuman.today/assets/icon-512.png</url>
  <title>LASTHUMAN Foundation: Research &amp; Insights</title>
  <link>https://lasthuman.today/insights/</link>
 </image>
 <item>
  <title>The future of AI regulation in Europe</title>
  <link>https://lasthuman.today/insights/future-of-ai-regulation-in-europe.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/future-of-ai-regulation-in-europe.html</guid>
  <pubDate>Tue, 03 Nov 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>Technology Policy</category>
  <description><![CDATA[What comes after the EU AI Act and its 2026 amendment: standards, codes of practice, enforcement, court rulings, and what builders and citizens can expect.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">Europe's AI Act is in force, but how it works in practice will be settled by harmonized standards, codes of practice, supervisory authorities, court rulings and revision, and a 2026 amendment has already moved the high-risk rules to 2027 and 2028.</p>
 <h2 id="a-staggered-start">A staggered start</h2>
 <p>The Act, <a href="https://lasthuman.today/insights/eu-ai-act-next-decade.html">Regulation (EU) 2024/1689</a>, entered into force on 1 August 2024 and applies in stages. Bans on practices such as social scoring and emotion recognition in workplaces and schools have applied since 2 February 2025, and obligations for general-purpose AI models since 2 August 2025. Most high-risk obligations were originally due on 2 August 2026, later for AI in regulated products.</p>
 <p>The dates have since moved. In November 2025 the European Commission proposed amendments, the digital omnibus; the Parliament and the Council adopted them in mid-2026 as Regulation (EU) 2026/1744, in force since 27 July 2026. Obligations for the listed high-risk uses now apply from 2 December 2027, and for AI in regulated products from 2 August 2028. The amendment also added two prohibitions, on AI that generates non-consensual intimate material or child sexual abuse material, which apply from 2 December 2026. The structure itself is unchanged.</p>
 <p>The high-risk list covers uses such as employment, education, essential services, law enforcement and migration. Providers must establish risk management, data governance, documentation and human oversight and complete a conformity assessment, usually a self-assessment. Public bodies, and some private deployers such as those offering public services or credit scoring, must first assess the impact on fundamental rights.</p>
 <h2 id="standards-and-codes-where-the-details-get-written">Standards and codes: where the details get written</h2>
 <p>The Act sets requirements in general terms; what adequate data governance or sufficient human oversight means is worked out largely in harmonized standards, drafted by the standards bodies CEN and CENELEC at the Commission's request. Following a standard published in the Official Journal creates a presumption of conformity; other routes are allowed, but the provider must then show its approach meets the requirements.</p>
 <p>Standardization favors those who can afford to take part, mostly large companies. Drafting takes years, and when standards lag behind legal deadlines, pressure builds to move them: delayed standards were a central argument for the 2026 postponement. The Act allows sensitive personal data to be used for bias detection only where synthetic or anonymized data would not do the job, a permission the 2026 amendment extended beyond high-risk systems; the Foundation's technical report on <a href="https://www.researchgate.net/publication/417632962">bias detection under the EU AI Act</a> examines when such data are enough.</p>
 <p>For general-purpose models there is a faster route: the General-Purpose AI Code of Practice, published in July 2025 under the EU AI Office, covers transparency, copyright, and safety and security for models with systemic risk. Adherence is voluntary but recognized as a way to show compliance until standards exist.</p>
 <h2 id="enforcement-institutions-and-capacity">Enforcement: institutions and capacity</h2>
 <p>The EU AI Office supervises general-purpose AI models directly. National market surveillance authorities supervise AI systems on their territory. Fines can reach 35 million euros or 7 percent of worldwide annual turnover, whichever is higher, for prohibited practices, and 15 million euros or 3 percent for most other breaches.</p>
 <p>The harder question is capacity. Checking whether a recruitment tool was tested for bias requires people who understand both law and machine learning, who are scarce in public administration. Each member state must also run a regulatory sandbox by 2 August 2027, a year later than first planned, where providers test systems under supervision before launch.</p>
 <h2 id="revision-a-law-designed-to-change">Revision: a law designed to change</h2>
 <p>The Act can change from within. The Commission may amend the list of high-risk use cases by delegated act, within the areas set by the legislator, and may update the compute threshold above which a general-purpose model is presumed to pose systemic risk.</p>
 <p>The Court of Justice of the European Union has the final word on terms such as "AI system" and "substantial modification." Its SCHUFA judgment of December 2023 held that producing a credit score can itself be an automated decision under the GDPR when a lender draws strongly on it, redrawing that rule's practical boundaries.</p>
 <p>Liability is unfinished. In 2025 the Commission withdrew its proposed AI Liability Directive, so compensation for harm caused by AI rests on national law and on the revised Product Liability Directive of 2024, which treats software, including AI systems, as a product and applies from December 2026.</p>
 <h2 id="europe-in-a-wider-landscape">Europe in a wider landscape</h2>
 <p>The Council of Europe Framework Convention on Artificial Intelligence, opened for signature in September 2024, is the first binding international treaty on AI; the EU signed it in September 2024, ratified it in May 2026 and will implement it mainly through the AI Act. The OECD AI Principles, the NIST AI Risk Management Framework and ISO/IEC 42001 supply shared vocabulary and management tools.</p>
 <p>A developer selling worldwide will either build to the strictest regime, the so-called Brussels effect, or ship different products to different markets; and because Europe depends on computing, models and cloud services built elsewhere, EU policy now pairs rules with public investment in computing capacity.</p>
 <h2 id="what-builders-and-citizens-can-expect">What builders and citizens can expect</h2>
 <p>For builders, the durable part of the Act is the discipline, not the calendar:</p>
 <ul>
  <li>Knowing each system's risk category, and documenting why.</li>
  <li>Recording data sources, design choices and known limitations.</li>
  <li>Testing for bias, accuracy and robustness, and keeping the evidence.</li>
  <li>Keeping a person able to understand, override and stop the system.</li>
 </ul>
 <p>These survive any deadline shift; draft standards and AI Office guidance already show what evidence will be expected, and an inventory of systems and their purposes is the cheapest first step.</p>
 <p>For citizens, the Act adds rights: to be told when interacting with an AI system or shown a deepfake; to complain to a national authority; and, once the high-risk rules apply, to a clear explanation of the role the system played in a decision that significantly affects them, alongside Article 22 of the GDPR. These rights work only if people use them; the first step is to find out which national authority is responsible. The Foundation researches <a href="https://lasthuman.today/tech-policy.html">how such rules work in practice</a> and what evidence they require, and publishes its findings as technical reports.</p>
<h2>Sources</h2>
<ol><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/2026-07-27/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act), consolidated text as of 27 July 2026</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li><li><a href="https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52025PC0836" hreflang="en">European Commission, Proposal for a Regulation (Digital Omnibus on AI), COM(2025) 836</a></li><li><a href="https://www.cencenelec.eu/areas-of-work/cen-cenelec-topics/artificial-intelligence/" hreflang="en">CEN and CENELEC, <span lang="en">Artificial Intelligence (JTC 21)</span></a></li><li><a href="https://www.researchgate.net/publication/417632962" hreflang="en">LASTHUMAN Foundation technical report (2026), <span lang="en">Bias Detection Under Article 4a of the EU AI Act: When Synthetic, Anonymised or Differentially Private Data Is Enough</span></a></li><li><a href="https://digital-strategy.ec.europa.eu/en/policies/contents-code-gpai" hreflang="en">European Commission, General-Purpose AI Code of Practice (2025)</a></li><li><a href="https://digital-strategy.ec.europa.eu/en/policies/ai-office" hreflang="en">European Commission, European AI Office</a></li><li><a href="https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:62021CJ0634" hreflang="en">Court of Justice of the EU, Case C-634/21, SCHUFA Holding (Scoring), judgment of 7 December 2023</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://eur-lex.europa.eu/procedure/EN/2022_303" hreflang="en">European Commission, Proposal for a Directive (AI Liability Directive), COM(2022) 496, withdrawn in 2025</a></li><li><a href="https://eur-lex.europa.eu/eli/dir/2024/2853/oj/eng" hreflang="en">Directive (EU) 2024/2853 on liability for defective products</a></li><li><a href="https://eur-lex.europa.eu/eli/agree_internation/2026/1081/oj/eng" hreflang="en">Council of Europe Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law (CETS No. 225)</a></li><li><a href="https://eur-lex.europa.eu/eli/dec/2026/1080/oj/eng" hreflang="en">Council Decision (EU) 2026/1080 on the conclusion, on behalf of the European Union, of the Council of Europe Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law</a></li><li><a href="https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0449" hreflang="en">OECD Recommendation of the Council on Artificial Intelligence (OECD AI Principles), 2019, amended 2024</a></li><li><a href="https://doi.org/10.6028/NIST.AI.100-1" hreflang="en">NIST AI 100-1, Artificial Intelligence Risk Management Framework (AI RMF 1.0)</a></li><li><a href="https://www.iso.org/standard/42001" hreflang="en">ISO/IEC 42001:2023, Information technology, Artificial intelligence, Management system</a></li><li><a href="https://doi.org/10.1093/oso/9780190088583.001.0001" hreflang="en">Bradford (2020), The Brussels Effect: How the European Union Rules the World, Oxford University Press</a></li></ol>
<p><a href="https://lasthuman.today/insights/future-of-ai-regulation-in-europe.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>The EU AI Act: what it means for the next decade</title>
  <link>https://lasthuman.today/insights/eu-ai-act-next-decade.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/eu-ai-act-next-decade.html</guid>
  <pubDate>Thu, 15 Oct 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>Technology Policy</category>
  <description><![CDATA[How the EU AI Act sorts AI by risk, what it requires of providers and deployers, when each rule applies, and why its reach extends beyond Europe.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">The EU AI Act, Regulation (EU) 2024/1689, is widely described as the first comprehensive law to regulate artificial intelligence by the risk a system poses to people. It sorts AI uses into risk tiers, puts most duties on providers of high-risk systems, applies in stages from 2025 to 2028 and binds any provider placing a system on the EU market, wherever it is based.</p>
 <h2 id="a-law-built-around-risk-not-technology">A law built around risk, not technology</h2>
 <p>Except for general-purpose models (see below), the Act regulates not the technology as such but what a system is used for and the harm that use could cause. Systems fall into four tiers:</p>
 <ul>
  <li>a short list of prohibited practices</li>
  <li>a longer list of high-risk uses</li>
  <li>transparency duties for systems that interact with people or generate content</li>
  <li>a large remainder subject only to an AI literacy duty for staff</li>
 </ul>
 <p>The same language model is minimal risk when drafting a newsletter and part of a high-risk system when ranking job applications. Risk mostly attaches to the intended purpose, not to the code.</p>
 <h2 id="prohibited-practices-and-high-risk-uses">Prohibited practices and high-risk uses</h2>
 <p>The original prohibitions have applied since 2 February 2025. They include social scoring that leads to unjustified detrimental treatment, manipulative techniques that cause significant harm, untargeted scraping of facial images to build recognition databases, and emotion recognition in workplaces and schools outside medical or safety uses. Real-time remote biometric identification in publicly accessible spaces by law enforcement is banned, with narrow exceptions. The 2026 amendment added two more bans, which apply from 2 December 2026: AI systems that generate or manipulate realistic intimate or sexually explicit images, videos or audio of an identifiable person without that person's explicit consent, and AI systems that generate or manipulate child sexual abuse material. Breaches carry the Act's highest fines: up to 35 million euros or 7 percent of worldwide annual turnover, whichever is higher.</p>
 <p>High-risk status arises in two ways. A safety component of a product covered by listed EU product legislation, such as a medical device or an elevator, is high risk if that legislation requires third-party conformity assessment, and follows the product's conformity route. Stand-alone systems used for purposes listed in eight areas are high risk by default:</p>
 <ul>
  <li>biometrics</li>
  <li>critical infrastructure</li>
  <li>education</li>
  <li>employment</li>
  <li>essential services (including credit scoring and life and health insurance)</li>
  <li>law enforcement</li>
  <li>migration, asylum and border control</li>
  <li>the administration of justice and democratic processes</li>
 </ul>
 <p>Exam scoring and benefit decisions are typical examples.</p>
 <h2 id="obligations-for-providers-and-deployers">Obligations for providers and deployers</h2>
 <p>A provider develops a system and markets it under its own name; a deployer uses it professionally. Most duties fall on providers of high-risk systems, who must:</p>
 <ul>
  <li>run a documented risk management process across the system's life cycle</li>
  <li>govern training, validation and testing data, including examination for bias</li>
  <li>prepare technical documentation and build in automatic event logging</li>
  <li>design for human oversight, accuracy, robustness and cybersecurity</li>
  <li>complete a conformity assessment (usually internal), affix CE marking and register stand-alone systems in the EU database</li>
 </ul>
 <p>Deployers must follow the instructions for use, assign oversight to competent people with authority to intervene, keep logs, tell people when such a system informs decisions about them, and inform workers and their representatives before using one at work. Public bodies, private operators of public services, and deployers using high-risk systems for credit scoring or life and health insurance must first assess the impact on fundamental rights.</p>
 <p>Testing for bias often requires sensitive attributes, such as ethnic origin or health status, that data protection law restricts. Since the 2026 amendment, Article 4a of the Act allows such data to be processed for bias detection and correction, no longer only for high-risk systems, under safeguards and only where synthetic, anonymized or other data would not suffice. Whether it would is a technical question, examined in <a href="https://www.researchgate.net/publication/417632962">the Foundation's technical report on synthetic, anonymized and differentially private data for bias detection</a>.</p>
 <h2 id="the-timeline-and-the-general-purpose-ai-track">The timeline and the general-purpose AI track</h2>
 <p>The Act applies in stages:</p>
 <ul>
  <li>1 August 2024: entry into force</li>
  <li>2 February 2025: the original prohibitions and the AI literacy duty</li>
  <li>2 August 2025: obligations for general-purpose AI models</li>
  <li>2 August 2026: most other rules, including the transparency duties for systems that interact with people or generate content</li>
  <li>2 December 2026: the two prohibitions added in 2026, and the duty to mark AI-generated content for generative systems placed on the market before 2 August 2026</li>
  <li>2 December 2027: most high-risk obligations (originally 2 August 2026)</li>
  <li>2 August 2028: high-risk obligations for AI in products covered by EU product legislation (originally 2 August 2027)</li>
 </ul>
 <p>In November 2025 the European Commission proposed amendments, the <a href="https://lasthuman.today/insights/future-of-ai-regulation-in-europe.html">digital omnibus on AI</a>; the Parliament and the Council adopted them, with changes, as Regulation (EU) 2026/1744, in force since 27 July 2026.</p>
 <p>Providers of general-purpose models, those adaptable to many tasks, must keep technical documentation, inform developers who build on them, adopt a copyright policy and publish a summary of training content. Models with systemic risk also face evaluation, risk mitigation, incident reporting and cybersecurity duties. The General-Purpose AI Code of Practice, published in 2025, offers a voluntary way to show compliance; the EU AI Office, within the Commission, enforces these rules.</p>
 <h2 id="why-the-effects-reach-beyond-europe">Why the effects reach beyond Europe</h2>
 <p>Three mechanisms carry the Act abroad. Scope: it binds any provider placing a system on the EU market, wherever it is based, and providers and deployers abroad whose system's output is used in the Union. Economics: many companies prefer one global version of a product, so a strict rule in a large market can become the default elsewhere, a pattern known as the Brussels effect and widely discussed after the GDPR. Standardization: harmonized European standards, once their references are published in the Official Journal, will carry a presumption of conformity with the high-risk requirements, and the practices they codify can travel with the products.</p>
 <p>Alongside the Act sit the OECD AI Principles, the NIST AI Risk Management Framework, ISO/IEC 42001 and the Council of Europe Framework Convention on AI. The next decade will show whether these frameworks converge on shared technical evidence or fragment into incompatible paperwork.</p>
 <h2 id="what-to-watch-and-what-to-do-now">What to watch, and what to do now</h2>
 <p>Open questions remain: how quickly harmonized standards arrive, how the exceptions to the high-risk classification are read in practice, and how the Act's right to explanation interacts with Article 22 of the GDPR.</p>
 <p>Any school, municipality, NGO or small business can start now by listing the AI systems it uses, asking which touch a listed high-risk area, requesting documentation from vendors, naming who is responsible for oversight, and training staff, a duty that already applies. Individuals gain protections in law: being told when they interact with an AI system, an explanation of significant decisions based on a high-risk system, and a complaint route to a market surveillance authority. The Foundation researches <a href="https://lasthuman.today/tech-policy.html">the technical evidence such rules require</a> and publishes its findings as technical reports and analyses.</p>
<h2>Sources</h2>
<ol><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/2026-07-27/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act), consolidated text as of 27 July 2026</a></li><li><a href="https://www.researchgate.net/publication/417632962" hreflang="en">LASTHUMAN Foundation technical report (2026), <span lang="en">Bias Detection Under Article 4a of the EU AI Act: When Synthetic, Anonymised or Differentially Private Data Is Enough</span></a></li><li><a href="https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52025PC0836" hreflang="en">European Commission, Proposal for a Regulation (Digital Omnibus on AI), COM(2025) 836</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li><li><a href="https://digital-strategy.ec.europa.eu/en/policies/contents-code-gpai" hreflang="en">European Commission, General-Purpose AI Code of Practice (2025)</a></li><li><a href="https://digital-strategy.ec.europa.eu/en/policies/ai-office" hreflang="en">European Commission, European AI Office</a></li><li><a href="https://doi.org/10.1093/oso/9780190088583.001.0001" hreflang="en">Bradford (2020), The Brussels Effect: How the European Union Rules the World, Oxford University Press</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0449" hreflang="en">OECD Recommendation of the Council on Artificial Intelligence (OECD AI Principles), 2019, amended 2024</a></li><li><a href="https://doi.org/10.6028/NIST.AI.100-1" hreflang="en">NIST AI 100-1, Artificial Intelligence Risk Management Framework (AI RMF 1.0)</a></li><li><a href="https://www.iso.org/standard/42001" hreflang="en">ISO/IEC 42001:2023, Information technology, Artificial intelligence, Management system</a></li><li><a href="https://eur-lex.europa.eu/eli/agree_internation/2026/1081/oj/eng" hreflang="en">Council of Europe Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law (CETS No. 225)</a></li></ol>
<p><a href="https://lasthuman.today/insights/eu-ai-act-next-decade.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>Human-centered AI: principles and challenges</title>
  <link>https://lasthuman.today/insights/human-centered-ai.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/human-centered-ai.html</guid>
  <pubDate>Wed, 30 Sep 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>Digital Society</category>
  <description><![CDATA[What human-centered AI means in practice, why human oversight is harder than it sounds, and the trade-offs between automation, control and autonomy.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">Human-centered AI starts from a simple commitment: technology should extend human judgment and agency, not quietly replace them. Turning that commitment into working systems means confronting real trade-offs between automation and control, convenience and autonomy.</p>
 <h2 id="what-human-centered-ai-means">What human-centered AI means</h2>
 <p>Human-centered AI is an approach to designing, deploying and governing AI systems that treats the people who use them, and those affected by them, as the primary measure of success. Accuracy, speed and cost still matter, but they are judged by whether people end up better informed, more capable and still in charge. The idea draws on human-computer interaction, accessibility and ethics, and it appears in international frameworks: the OECD AI Principles call for AI that respects human rights and democratic values, and the UNESCO Recommendation on the Ethics of AI lists human oversight and determination among its principles.</p>
 <p>A related term is augmented intelligence: AI used as an instrument that amplifies what a person can perceive, remember or compute, while the person keeps responsibility for the outcome. A diagnostic suggestion that a clinician reviews is augmentation; a verdict nobody reads is substitution, however the vendor describes it.</p>
 <h2 id="principles-that-keep-recurring">Principles that keep recurring</h2>
 <p>A handful of commitments recur in most serious accounts of human-centered AI.</p>
 <ul>
  <li>Agency: people can understand, question, override and opt out of what the system proposes.</li>
  <li><a href="https://lasthuman.today/insights/transparency-in-ai-decision-making.html">Transparency</a> that fits: explanations match the decision and the reader, not the model's internals.</li>
  <li>Dignity and consent: no manipulation, no dark patterns, and data use people actually understand.</li>
  <li>Inclusion: the system works across age, ability, language and culture, not only for the majority case.</li>
  <li>Accountability: a named person or body answers for outcomes, including outcomes the system shaped.</li>
 </ul>
 <p>None of these is free; each adds design work and limits what the system may do on its own.</p>
 <h2 id="human-oversight-is-harder-than-it-sounds">Human oversight is harder than it sounds</h2>
 <p>Law and regulation often rely on a human somewhere in the process. Article 22 of the GDPR restricts decisions based solely on automated processing that have legal or similarly significant effects and, where such decisions are allowed, requires safeguards including the right to obtain human intervention and to contest the decision. The EU AI Act (Regulation (EU) 2024/1689) provides in Article 14 that high-risk AI systems must be designed so that natural persons can effectively oversee them, and it expressly requires that overseers be enabled to remain aware of automation bias, the tendency to rely automatically on a system's output. Most high-risk obligations were originally due to apply from 2 August 2026; the digital omnibus on AI (Regulation (EU) 2026/1744), in force since 27 July 2026, postponed them to 2 December 2027, and to 2 August 2028 for high-risk AI in regulated products.</p>
 <p>The difficulty is that oversight is a cognitive task performed under pressure. A caseworker who sees a risk score before reading the file tends to anchor on it. A reviewer who confirms hundreds of suggestions a day, almost all correct, loses the habit of checking the rare wrong one. A person asked to take over only when the system fails receives the task at the worst possible moment, with the least context. Unused skills fade, so the person meant to catch errors becomes less able to see them. A review that consists of clicking "approve" may satisfy the letter of a rule and none of its purpose.</p>
 <p>Meaningful oversight therefore has to be designed as a workflow, not declared as a policy: time to review, information that allows a real judgment, authority to deviate without penalty, and refreshed training.</p>
 <h2 id="the-trade-offs-nobody-can-design-away">The trade-offs nobody can design away</h2>
 <p><strong>Automation against control.</strong> Every confirmation step costs time, and prompts that come too often are simply dismissed. Too few checkpoints and the human presence becomes nominal; too many and it becomes noise. The answer is to concentrate human attention where errors are costly or hard to reverse.</p>
 <p><strong>Convenience against autonomy.</strong> Defaults, rankings and recommendations shape behavior even when nobody is forced to do anything. A feed optimized for engagement and one optimized for a person's stated goals can look identical and differ entirely in whose interest they serve. The human-centered position is that the person should be able to see the goal the system pursues and change it.</p>
 <p><strong>Standardization against inclusion.</strong> Systems learn from the data they are given, and when some groups are underrepresented, errors tend to concentrate on them: speech recognition that struggles with certain accents, or interfaces unusable without sight or fine motor control. Detecting such disparities usually requires data about the very characteristics involved, which raises its own privacy problems; <a href="https://www.researchgate.net/publication/417632962">the Foundation's technical report</a> on bias detection under the EU AI Act examines when synthetic, anonymized or differentially private data is enough.</p>
 <h2 id="what-it-looks-like-in-practice">What it looks like in practice</h2>
 <p>Imagine a hospital triage tool. If its suggestion appears before the clinician has formed an initial view, it tends to anchor the assessment; if it appears after, it informs the assessment and can be compared with it. Nothing about the model changed, only the order in which information arrives. A chatbot that says it is a machine and hands over to a person on request respects agency; the EU AI Act's transparency rules point the same way, requiring that people be told when they interact with an AI system unless that is obvious.</p>
 <p>The techniques are unglamorous: friction where errors are costly, reversible actions, logs that make decisions reconstructible, feedback channels that someone reads, and testing with actual users, including people with disabilities, before deployment.</p>
 <h2 id="a-practical-takeaway">A practical takeaway</h2>
 <p>Anyone evaluating an AI system, as a buyer, teacher, official or citizen, can ask four questions: who can override it, with what information, in how much time, and who is accountable when it is wrong. Clear answers are a good sign; vague ones suggest the human in the loop is decoration. The Foundation's <a href="https://lasthuman.today/human-design.html">Human-Centered Design area</a> plans studies on human oversight, trust and inclusive design, and will publish them in Research & Insights.</p>
<h2>Sources</h2>
<ol><li><a href="https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0449" hreflang="en">OECD Recommendation of the Council on Artificial Intelligence (OECD AI Principles), 2019, amended 2024</a></li><li><a href="https://unesdoc.unesco.org/ark:/48223/pf0000381137" hreflang="en">UNESCO Recommendation on the Ethics of Artificial Intelligence (2021)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://doi.org/10.1177/0018720810376055" hreflang="en">Parasuraman and Manzey (2010), Complacency and Bias in Human Use of Automation: An Attentional Integration, Human Factors 52(3)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li><li><a href="https://doi.org/10.1016/0005-1098%2883%2990046-8" hreflang="en">Bainbridge (1983), Ironies of automation, Automatica 19(6)</a></li><li><a href="https://doi.org/10.1073/pnas.1915768117" hreflang="en">Koenecke et al. (2020), Racial disparities in automated speech recognition, PNAS 117(14)</a></li><li><a href="https://www.researchgate.net/publication/417632962" hreflang="en">LASTHUMAN Foundation technical report (2026), <span lang="en">Bias Detection Under Article 4a of the EU AI Act: When Synthetic, Anonymised or Differentially Private Data Is Enough</span></a></li></ol>
<p><a href="https://lasthuman.today/insights/human-centered-ai.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>Building trust: transparency in AI decision-making</title>
  <link>https://lasthuman.today/insights/transparency-in-ai-decision-making.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/transparency-in-ai-decision-making.html</guid>
  <pubDate>Tue, 15 Sep 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>Responsible AI</category>
  <description><![CDATA[What meaningful transparency in AI decisions requires: disclosure, usable explanations, auditability and a real route to contest an outcome.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">Transparency in AI decision-making means that people know when an automated system was involved in a decision about them and can learn the main factors behind the outcome, and that a regulator or researcher can verify that the system behaves as claimed. When an AI system shapes a decision about a loan, a diagnosis or a job application, the people affected deserve to know how it was reached and be able to contest it.</p>
 <h2 id="what-transparency-means-and-what-it-does-not">What transparency means, and what it does not</h2>
 <p>Transparency has four layers:</p>
 <ul>
  <li>Disclosure: a person knows that an automated system was involved in a decision about them.</li>
  <li>System transparency: documentation of the system's purpose, training and test data, performance for different groups, and when it should not be used.</li>
  <li>Explainability: the main factors behind a particular outcome for a particular person.</li>
  <li>Auditability: records and evidence that let a regulator or researcher verify that the system behaves as claimed.</li>
 </ul>
 <p>Transparency does not mean publishing source code or model parameters; a file of model weights tells a refused applicant nothing. The goal is information its audience can act on.</p>
 <h2 id="why-oversight-and-redress-depend-on-it">Why oversight and redress depend on it</h2>
 <p>Each layer protects a capability: to ask whether a decision was automated, to spot and correct a wrong input such as a misrecorded payment, and to establish later whether the system worked as intended.</p>
 <p>European law builds on this. Article 22 of the GDPR gives individuals the right not to be subject to a decision based solely on automated processing with legal or similarly significant effects. Where such a decision is permitted because it is necessary for a contract or rests on explicit consent, the controller must provide safeguards, at least the right to human intervention, to express one's point of view and to contest the decision.</p>
 <p>The <a href="https://lasthuman.today/insights/eu-ai-act-next-decade.html">EU AI Act</a> (Regulation (EU) 2024/1689) goes further for high-risk systems, which include credit scoring of natural persons, recruitment and access to education. Providers must document such systems, enable logging and make their output interpretable for deployers. Deployers must inform people that such a system is used in decisions about them and assign <a href="https://lasthuman.today/insights/human-centered-ai.html">human oversight</a> to people with the competence, training and authority to intervene. A person subject to such a decision with legal or similarly significant effects that they consider adverse may obtain from the deployer a clear and meaningful explanation of the system's role in the decision and its main elements (Article 86). Most high-risk obligations were originally due to apply from 2 August 2026, and those for high-risk AI in regulated products from 2 August 2027; the digital omnibus on AI (Regulation (EU) 2026/1744), in force since 27 July 2026, moved these dates to 2 December 2027 and 2 August 2028 respectively.</p>
 <h2 id="what-a-meaningful-explanation-looks-like">What a meaningful explanation looks like</h2>
 <p>For the person affected, an explanation they can act on covers:</p>
 <ul>
  <li>That an automated system was used, and for which part of the decision.</li>
  <li>The main factors that drove the outcome, in plain language.</li>
  <li>What would need to change for a different outcome, where realistic.</li>
  <li>How to reach a human, correct the data and contest the result.</li>
 </ul>
 <p>A loan refusal that says "Your application did not meet our criteria" explains nothing. One that says "The main reasons were income below the level required for this loan and two payments recorded as late last year; you can ask for a review of your payment record and a human reassessment" gives the applicant something to check and a route to act. It does not reveal the model; it reveals the decision.</p>
 <p>A patient should know that software supported an assessment and that a clinician remains responsible; the clinician needs to know the system's confidence and where it performs poorly. A job candidate should learn that a screening tool was used, what it assessed and how to request human review, so that a shortlist remains a recommendation, not a verdict.</p>
 <h2 id="methods-and-their-limits">Methods and their limits</h2>
 <p>Two technical routes exist: models interpretable by construction, such as scorecards or decision rules, and post-hoc methods for complex models, including feature attribution (such as SHAP and LIME) and counterfactual explanations, which describe the smallest input change that flips the outcome.</p>
 <p>Post-hoc methods summarize or approximate a model's behavior rather than reveal its mechanism; methods can disagree about the same decision, attributions can shift with small input changes, and a fluent explanation can inspire more confidence than the model deserves. Counterfactuals should be limited to changes a person can make: telling someone they would have been approved had they been ten years younger is not advice but a sign that the model relies on a characteristic they cannot change, possibly one that equality law protects.</p>
 <p>Trade secrets, other people's personal data and the risk of gaming can justify some limits; a workable answer is layered access: affected people get what they need to contest their case, auditors get documentation and logs, the public gets summaries of purpose, testing and safeguards.</p>
 <h2 id="evidence-not-declarations-a-practical-takeaway">Evidence, not declarations: a practical takeaway</h2>
 <p>Public trust rests on evidence that can be checked, not on statements of principle. Human oversight is only real if the people exercising it can overrule the system; the AI Act requires that overseers of high-risk systems be able to stay alert to automation bias, the tendency to rely automatically on a system's output, and to override it. Anyone who procures, operates or is subject to such a system can ask:</p>
 <ul>
  <li>Whether an AI system is involved, and whether affected people know.</li>
  <li>What the system is meant to do, and where it is known to fail.</li>
  <li>What it was tested on, and the results for different groups.</li>
  <li>Who can override it, and whether they have the time and authority.</li>
  <li>How a person obtains an explanation and contests the outcome.</li>
  <li>Whether decisions are logged for later review.</li>
 </ul>
 <p>If an organization cannot answer, the problem is not a complicated model but a system deployed without the conditions for accountability. The Foundation's work here is <a href="https://lasthuman.today/responsible-ai.html">research and publishing</a>: on explainability, accountability for automated decisions, and when test results support claims of fairness, which its technical report on <a href="https://www.researchgate.net/publication/417632962">bias detection under the EU AI Act</a> examines for synthetic, anonymized and differentially private data.</p>
<h2>Sources</h2>
<ol><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://ec.europa.eu/newsroom/article29/items/612053" hreflang="en">Article 29 Working Party, Guidelines on Automated individual decision-making and Profiling for the purposes of Regulation 2016/679 (wp251rev.01), endorsed by the EDPB</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li><li><a href="https://arxiv.org/abs/1705.07874" hreflang="en">Lundberg and Lee (2017), A Unified Approach to Interpreting Model Predictions (SHAP)</a></li><li><a href="https://arxiv.org/abs/1602.04938" hreflang="en">Ribeiro, Singh and Guestrin (2016), "Why Should I Trust You?": Explaining the Predictions of Any Classifier (LIME)</a></li><li><a href="https://arxiv.org/abs/1711.00399" hreflang="en">Wachter, Mittelstadt and Russell (2017), Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR</a></li><li><a href="https://arxiv.org/abs/2202.01602" hreflang="en">Krishna et al. (2022), The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspective</a></li><li><a href="https://doi.org/10.1177/0018720810376055" hreflang="en">Parasuraman and Manzey (2010), Complacency and Bias in Human Use of Automation: An Attentional Integration, Human Factors 52(3)</a></li><li><a href="https://www.researchgate.net/publication/417632962" hreflang="en">LASTHUMAN Foundation technical report (2026), <span lang="en">Bias Detection Under Article 4a of the EU AI Act: When Synthetic, Anonymised or Differentially Private Data Is Enough</span></a></li></ol>
<p><a href="https://lasthuman.today/insights/transparency-in-ai-decision-making.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>AI safety vs AI ethics: what’s the difference?</title>
  <link>https://lasthuman.today/insights/ai-safety-vs-ai-ethics.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/ai-safety-vs-ai-ethics.html</guid>
  <pubDate>Thu, 27 Aug 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>AI Safety</category>
  <description><![CDATA[How AI safety and AI ethics differ, where they overlap, and which questions each one answers before an AI system is put to use.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">The terms AI safety and AI ethics are often used interchangeably, but they ask different questions. Safety asks whether a system reliably does what its designers intend; ethics asks whether that intent, and its effects on people, can be justified. Put simply, safety is about means, ethics about ends, and a serious approach to AI needs both.</p>
 <h2 id="two-questions-not-one">Two questions, not one</h2>
 <p>Take a content recommender. The safety question is whether it does what it was built to do, reliably and without being manipulated. The ethics question is whether what it was built to do, such as keeping people on a platform as long as possible, is a legitimate goal, and who pays the price when it works well. A system can pass the first test and fail the second. The reverse also happens: fine principles on paper, and a model nobody has tested against manipulated inputs.</p>
 <h2 id="what-ai-safety-studies">What AI safety studies</h2>
 <p>Systems that learn from data do not simply do what their designers meant; they do what the objective, the data and the environment reward. The core topics of AI safety follow from that gap, plus one for harm caused on purpose.</p>
 <ul>
  <li><a href="https://lasthuman.today/insights/what-is-ai-alignment.html">Alignment</a>: making a system's actual objectives match human intentions, including in situations nobody specified.</li>
  <li>Robustness: behaving predictably on unusual inputs and against deliberate attacks.</li>
  <li>Evaluation: measuring what a model can and cannot do, with tests it has not seen before.</li>
  <li>Control and oversight: keeping the ability to monitor, correct or shut down a system.</li>
  <li>Misuse prevention: limiting how much a system will help a user cause serious harm.</li>
 </ul>
 <p>A well-documented failure pattern is specification gaming, called reward hacking in reinforcement learning: a system satisfies the letter of its objective while defeating its purpose, as when a game-playing agent rewarded for points keeps circling to collect them instead of finishing the race. Nothing malfunctioned; the objective was a poor proxy for the goal.</p>
 <p>When language models act as agents that browse the web, prompt injection becomes central: instructions hidden in a web page can be read as if they came from the user. Limiting the agent's permissions and testing it against adaptive attacks determine whether it can be trusted with its task, not whether the task is worthwhile.</p>
 <h2 id="what-ai-ethics-asks">What AI ethics asks</h2>
 <p>AI ethics starts from people rather than systems. It asks which goals are legitimate, who is affected, who bears the cost of errors, and whether a decision that shapes someone's life should be automated at all. The UNESCO Recommendation on the Ethics of AI (2021), the OECD AI Principles (2019, updated 2024) and the Council of Europe Framework Convention on AI (2024) give these concerns a shared vocabulary.</p>
 <p>Consider a hiring tool trained on past decisions. If previous selections disadvantaged a group, a model that learns to predict them is likely to reproduce that disadvantage at scale. It does what it was trained to do; the problem lies in treating past decisions as the standard of a good candidate. Robustness testing alone would not surface this, because the system is succeeding at the wrong task.</p>
 <p>Ethics also covers human agency, and part of that concern is already law: GDPR Article 22 gives individuals the right, with some exceptions, not to be subject to a decision based solely on automated processing that produces legal or similarly significant effects. Behind the rule is a judgment that some decisions deserve a human who can be held responsible.</p>
 <h2 id="where-the-two-meet">Where the two meet</h2>
 <p>A biased system is an ethics failure, but it is also unsafe for the people it misjudges, so fairness testing belongs inside safety work. The dependence runs both ways: "safe" always means safe for someone, against some harm, at some accepted level of risk, and those are ethical choices; a principle a system cannot be shown to meet is a wish, not a safeguard.</p>
 <p>EU law treats them as one package. For high-risk systems, the EU AI Act (Regulation (EU) 2024/1689) requires risk management, examination of training, validation and testing data for possible biases, human oversight, and accuracy, robustness and cybersecurity, all within one conformity assessment. Most of these obligations were originally scheduled to apply from 2 August 2026, and from 2 August 2027 for high-risk AI in products already covered by EU product legislation. In July 2026 an amending regulation, the digital omnibus on AI (Regulation (EU) 2026/1744), postponed them to 2 December 2027 and 2 August 2028 respectively.</p>
 <p>Here an ethical demand becomes an evidence problem: showing that a system was checked for bias requires data, and the data needed to detect discrimination is often sensitive. The Foundation's technical report on <a href="https://www.researchgate.net/publication/417632962">bias detection under the EU AI Act</a> examines when synthetic, anonymized or differentially private data is enough for that purpose.</p>
 <h2 id="why-the-distinction-matters-in-practice">Why the distinction matters in practice</h2>
 <p>An organization that treats ethics as a statement of values and safety as a quality-assurance checkbox can end up with neither: an ethics board that never sees test results, and a testing team that never asks whether the product should exist. The skills differ too: safety work needs people who can design evaluations and attack systems; ethics work needs people who know the law and the affected communities and have the authority to say no.</p>
 <h2 id="a-practical-takeaway">A practical takeaway</h2>
 <p>When an AI system is proposed for a school, an agency or an organization, ask both kinds of questions and expect evidence rather than principles.</p>
 <ul>
  <li>Purpose: what the system optimizes, and whether that is the right goal here.</li>
  <li>Testing: how it was evaluated, on what data, and against which attacks.</li>
  <li>Fairness: which groups could be misjudged, and how that was measured.</li>
  <li>Oversight: who can override or stop the system, and how quickly.</li>
  <li>Accountability: who answers for a wrong decision, and how it can be challenged.</li>
 </ul>
 <p>Vague answers on purpose and accountability signal an ethics problem; vague answers on testing and oversight, a safety problem. The Foundation's <a href="https://lasthuman.today/ai-safety.html">AI Safety Research area</a> works on alignment, robustness, evaluation and control problems and publishes its analyses in Research & Insights, where its technical reports, planned through 2027, will also appear.</p>
<h2>Sources</h2>
<ol><li><a href="https://deepmind.google/blog/specification-gaming-the-flip-side-of-ai-ingenuity/" hreflang="en">Krakovna et al. (2020), Specification gaming: the flip side of AI ingenuity, Google DeepMind</a></li><li><a href="https://openai.com/index/faulty-reward-functions/" hreflang="en">Clark and Amodei (2016), Faulty reward functions in the wild, OpenAI</a></li><li><a href="https://arxiv.org/abs/2302.12173" hreflang="en">Greshake et al. (2023), Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection</a></li><li><a href="https://unesdoc.unesco.org/ark:/48223/pf0000381137" hreflang="en">UNESCO Recommendation on the Ethics of Artificial Intelligence (2021)</a></li><li><a href="https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0449" hreflang="en">OECD Recommendation of the Council on Artificial Intelligence (OECD AI Principles), 2019, amended 2024</a></li><li><a href="https://eur-lex.europa.eu/eli/agree_internation/2026/1081/oj/eng" hreflang="en">Council of Europe Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law (CETS No. 225)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li><li><a href="https://www.researchgate.net/publication/417632962" hreflang="en">LASTHUMAN Foundation technical report (2026), <span lang="en">Bias Detection Under Article 4a of the EU AI Act: When Synthetic, Anonymised or Differentially Private Data Is Enough</span></a></li></ol>
<p><a href="https://lasthuman.today/insights/ai-safety-vs-ai-ethics.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>AI governance explained</title>
  <link>https://lasthuman.today/insights/ai-governance-explained.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/ai-governance-explained.html</guid>
  <pubDate>Wed, 12 Aug 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>Technology Policy</category>
  <description><![CDATA[How laws, standards, institutions and norms decide how AI may be built and used, and what that means for a school, a hospital or a city office.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">AI governance is the web of laws, standards, institutions and norms that decide how AI may be built and used, and who is answerable when it goes wrong. This article maps the main instruments and actors and shows what they mean for a school, a hospital or a city office.</p>
 <h2 id="four-layers-not-one-rulebook">Four layers, not one rulebook</h2>
 <p>Governance is often pictured as a single law. In practice it works through several layers that reinforce one another, and a gap in one is usually filled, well or badly, by another.</p>
 <ul>
  <li>Binding law: obligations backed by enforcement, such as the <a href="https://lasthuman.today/insights/eu-ai-act-next-decade.html">EU AI Act</a> or data protection law.</li>
  <li>Standards and frameworks: shared methods that translate legal duties into testable practice.</li>
  <li>Institutions: regulators, oversight bodies and courts that interpret, supervise and enforce.</li>
  <li>Norms: professional ethics, internal policies and public expectations that shape behavior before any inspector arrives.</li>
 </ul>
 <h2 id="binding-law-the-eu-ai-act-and-its-neighbors">Binding law: the EU AI Act and its neighbors</h2>
 <p>The EU AI Act, Regulation (EU) 2024/1689, in force since 1 August 2024, is the first comprehensive binding law on AI and applies in stages according to risk. A small set of practices has been prohibited since 2 February 2025, and providers of general-purpose AI models have had their own obligations since 2 August 2025. Systems used for listed purposes in areas such as employment, education, credit scoring, public benefits and law enforcement are high-risk and must meet requirements on risk management, data quality, documentation, human oversight and robustness. Those requirements were due from 2 August 2026, and from 2 August 2027 for high-risk AI in products already covered by EU product legislation, such as medical devices; in July 2026 an amending regulation, the digital omnibus on AI (Regulation (EU) 2026/1744), postponed them to 2 December 2027 and 2 August 2028 respectively.</p>
 <p>GDPR Article 22 adds the right not to be subject to decisions based solely on automated processing that produce legal or similarly significant effects, with exceptions and safeguards such as human intervention. Beyond the EU, the Council of Europe Framework Convention on AI, opened for signature in September 2024, is the first legally binding international treaty on AI, committing the states that ratify it to protect human rights, democracy and the rule of law.</p>
 <h2 id="standards-turning-obligations-into-evidence">Standards: turning obligations into evidence</h2>
 <p>Laws mostly state outcomes, not methods; standards translate a duty such as risk management into tests, records and evidence. ISO/IEC 42001 (2023) is a management system standard for AI: an organization defines policies, assigns roles, assesses risks and keeps improving. The NIST AI Risk Management Framework 1.0 (January 2023) is a voluntary US framework built around four functions: govern, map, measure and manage. In the EU, harmonized standards requested by the Commission give providers a presumption of conformity once published in the Official Journal, and the General-Purpose AI Code of Practice (2025), facilitated by the EU AI Office, offers model providers a comparable route to showing compliance.</p>
 <p>Detecting bias in a hiring or credit model, for example, usually requires sensitive attributes such as ethnicity or health status. Article 4a of the AI Act, added in 2026, allows such data to be processed for bias detection and correction only under safeguards and only where synthetic or anonymized data would not do the job. The Foundation's technical report on <a href="https://www.researchgate.net/publication/417632962">bias detection under Article 4a of the EU AI Act</a> examines when synthetic, anonymized or differentially private data is enough, and where it falls short.</p>
 <h2 id="institutions-who-interprets-supervises-and-enforces">Institutions: who interprets, supervises and enforces</h2>
 <p>In the EU, the AI Office within the European Commission supervises general-purpose AI models and coordinates implementation; national market surveillance authorities oversee high-risk systems; notified bodies check certain high-risk systems before market entry; data protection authorities enforce the GDPR; courts decide contested cases.</p>
 <p>International institutions mostly coordinate rather than enforce. The OECD AI Principles (2019, updated 2024) were the first intergovernmental standard on AI, and the UNESCO Recommendation on the Ethics of AI (2021) broadened that consensus. The AI summits at Bletchley Park (2023) and Seoul (2024) brought governments and developers together around frontier model risks, and several countries set up AI safety institutes. The AI Action Summit in Paris (2025) then shifted the emphasis to inclusive and sustainable AI. None of them can fine a company; they work through commitments, peer pressure and technical groundwork that can later feed into law.</p>
 <h2 id="the-trade-offs-no-framework-escapes">The trade-offs no framework escapes</h2>
 <p>Every design balances competing goods. Detailed rules give certainty but age quickly; broad principles adapt but leave organizations guessing. Pre-market checks catch problems early but cost time and tend to favor larger firms; liability after harm is cheaper up front but repairs damage late. Under the AI Act most obligations fall on providers, yet deployers must still use a system as instructed, assign human oversight to trained staff and monitor it in use, often with small teams.</p>
 <p>A city office using a scoring tool to rank social benefit applications operates in an area the AI Act treats as high-risk; if decisions are made without meaningful human involvement, GDPR Article 22 applies already. A hospital buying diagnostic software that is itself a medical device, or built into one, faces the longer transition to 2028, because the device is already subject to EU product rules. A school adopting an AI tutoring service is usually a deployer, not a provider, which changes its duties and what it should ask its supplier.</p>
 <h2 id="what-to-take-from-this">What to take from this</h2>
 <p>For anyone who buys, builds or oversees an AI system, governance largely comes down to three things.</p>
 <ul>
  <li>Role: whether the organization is a provider, a deployer, or both.</li>
  <li>Risk category: which one applies, and which obligations follow from it.</li>
  <li>Evidence: what it could show tomorrow to prove the system works as claimed.</li>
 </ul>
 <p>Writing those answers down and revisiting them as the rules change is a habit any organization can start now. The Foundation studies <a href="https://lasthuman.today/tech-policy.html">how the EU AI Act works in practice</a> and what technical evidence it asks of providers, and publishes its findings in Research & Insights.</p>
<h2>Sources</h2>
<ol><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/2026-07-27/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act), consolidated text as of 27 July 2026</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://eur-lex.europa.eu/eli/agree_internation/2026/1081/oj/eng" hreflang="en">Council of Europe Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law (CETS No. 225)</a></li><li><a href="https://www.iso.org/standard/42001" hreflang="en">ISO/IEC 42001:2023, Information technology, Artificial intelligence, Management system</a></li><li><a href="https://doi.org/10.6028/NIST.AI.100-1" hreflang="en">NIST AI 100-1, Artificial Intelligence Risk Management Framework (AI RMF 1.0)</a></li><li><a href="https://www.cencenelec.eu/areas-of-work/cen-cenelec-topics/artificial-intelligence/" hreflang="en">CEN and CENELEC, <span lang="en">Artificial Intelligence (JTC 21)</span></a></li><li><a href="https://digital-strategy.ec.europa.eu/en/policies/contents-code-gpai" hreflang="en">European Commission, General-Purpose AI Code of Practice (2025)</a></li><li><a href="https://digital-strategy.ec.europa.eu/en/policies/ai-office" hreflang="en">European Commission, European AI Office</a></li><li><a href="https://www.researchgate.net/publication/417632962" hreflang="en">LASTHUMAN Foundation technical report (2026), <span lang="en">Bias Detection Under Article 4a of the EU AI Act: When Synthetic, Anonymised or Differentially Private Data Is Enough</span></a></li><li><a href="https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0449" hreflang="en">OECD Recommendation of the Council on Artificial Intelligence (OECD AI Principles), 2019, amended 2024</a></li><li><a href="https://unesdoc.unesco.org/ark:/48223/pf0000381137" hreflang="en">UNESCO Recommendation on the Ethics of Artificial Intelligence (2021)</a></li><li><a href="https://www.gov.uk/government/publications/ai-safety-summit-2023-the-bletchley-declaration/the-bletchley-declaration-by-countries-attending-the-ai-safety-summit-1-2-november-2023" hreflang="en">The Bletchley Declaration by Countries Attending the AI Safety Summit, 1-2 November 2023</a></li><li><a href="https://www.gov.uk/government/publications/seoul-declaration-for-safe-innovative-and-inclusive-ai-ai-seoul-summit-2024" hreflang="en">Seoul Declaration for safe, innovative and inclusive AI: AI Seoul Summit 2024</a></li><li><a href="https://www.elysee.fr/en/emmanuel-macron/2025/02/11/statement-on-inclusive-and-sustainable-artificial-intelligence-for-people-and-the-planet" hreflang="en">Statement on Inclusive and Sustainable Artificial Intelligence for People and the Planet, AI Action Summit, Paris 2025</a></li></ol>
<p><a href="https://lasthuman.today/insights/ai-governance-explained.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>What is responsible AI?</title>
  <link>https://lasthuman.today/insights/what-is-responsible-ai.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/what-is-responsible-ai.html</guid>
  <pubDate>Tue, 28 Jul 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>Responsible AI</category>
  <description><![CDATA[What responsible AI means in practice: how fairness, transparency and accountability become concrete decisions before, during and after an AI system is used.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">Responsible AI is the practice of building and deploying artificial intelligence systems in ways that are fair, transparent, accountable and respectful of human rights. It moves ethics from abstract principle to concrete engineering and governance decisions: the choices made before, during and after a system is put to use.</p>
 <h2 id="a-working-definition">A working definition</h2>
 <p>Responsible AI is not a product feature but a way of working that treats the social consequences of an AI system as part of the engineering problem, not an afterthought. Its values, also found under the labels "trustworthy AI" and "ethical AI", are broadly shared: the OECD AI Principles (2019, updated 2024) and the Council of Europe Framework Convention on AI (2024) both refer, in different words, to fairness, <a href="https://lasthuman.today/insights/transparency-in-ai-decision-making.html">transparency</a>, accountability, human oversight, safety and human rights.</p>
 <p>What distinguishes it from a statement of values is the move to operations: which data to collect, which tests to run, which results count as failure, who signs off on a release. Responsible AI means answering those questions, documenting the answers and agreeing to be held to them.</p>
 <h2 id="fairness-is-a-set-of-decisions-not-a-property">Fairness is a set of decisions, not a property</h2>
 <p>Most AI systems in use today learn patterns from data, and data records the world as it has been, including its inequalities. A model that screens job applications, trained on past hiring decisions, is likely to reproduce whatever preferences those decisions contained. Nobody needs to intend discrimination; the mechanism is statistical, the outcome social.</p>
 <p>Fairness is also hard to define. Several mathematical definitions exist, such as equal error rates across groups or equal rates of favorable outcomes, and, except in special cases, they cannot all be satisfied at once when the groups differ in the underlying data. Choosing among them is a value judgment, not a technical one, and the choice and its reason should be recorded.</p>
 <p>Testing for bias adds a privacy trade-off: measuring whether groups are treated differently usually requires knowing each person's group, which is often sensitive information. One response is to test with synthetic, anonymized or differentially private data; the open question is when such data is enough to reveal the problems that matter. <a href="https://www.researchgate.net/publication/417632962">The Foundation's technical report</a> examines this question with simulated and real data.</p>
 <h2 id="transparency-means-evidence-not-declarations">Transparency means evidence, not declarations</h2>
 <p>Transparency has two levels. The first concerns the people affected: whether they know they are dealing with AI, whether a decision about them was automated, and whether they can obtain meaningful information about the logic involved. Article 22 of the GDPR already gives individuals rights regarding decisions based solely on automated processing with legal or similarly significant effects.</p>
 <p>The second level, oversight, requires documentation: training data, evaluation method and population, results, and known limitations. A statement that a system "has been tested for bias" is a declaration; an evaluation protocol with results that someone else could reproduce is evidence.</p>
 <p>Explainability, saying why a system produced an output, carries its own trade-off. Simpler models are easier to explain but may perform worse; complex models can be more accurate but offer only approximate, after-the-fact explanations. How much explanation is enough depends on the stakes; a film recommendation and a social benefits decision differ.</p>
 <h2 id="accountability-requires-a-person-who-can-answer">Accountability requires a person who can answer</h2>
 <p>Accountability means that an identifiable organization, and identifiable people within it, answer for a system's outcomes, and that affected people can contest a decision and obtain redress. It cannot be delegated to the software. ISO/IEC 42001 (2023), a management system standard for AI, and the NIST AI Risk Management Framework 1.0 (January 2023) make this concrete through defined roles, documented risk assessment and records of decisions, so that "the algorithm decided" is not where an explanation ends.</p>
 <p>Human oversight is often presented as the answer to accountability, and it is easily misunderstood. A person who approves every recommendation within seconds, without the time, information or authority to disagree, provides the appearance of oversight rather than its substance. A newer case is one AI model judging another's outputs and shaping release decisions. Such a judge can be useful, but it takes no responsibility, and its blind spots deserve the same scrutiny as the system it evaluates.</p>
 <h2 id="from-principle-to-lifecycle">From principle to lifecycle</h2>
 <p>The common thread is timing: responsible AI is a set of questions asked at each stage of a system's life, and the earliest are usually the cheapest to act on.</p>
 <ul>
  <li>Before building: whether AI is the right tool at all, and who bears the risk if it fails.</li>
  <li>Before release: what was tested, on whom, against which definition of fairness, and what counts as failure.</li>
  <li>After deployment: how performance is monitored, who handles complaints, and when the system is withdrawn.</li>
 </ul>
 <p>The EU AI Act (Regulation (EU) 2024/1689) entered into force on 1 August 2024 and applies in stages: most prohibited practices from 2 February 2025 and general-purpose AI models from 2 August 2025. Most high-risk obligations were originally due from 2 August 2026, and those for high-risk AI embedded in products already covered by EU product legislation from 2 August 2027; the digital omnibus on AI (Regulation (EU) 2026/1744), in force since 27 July 2026, postponed them to 2 December 2027 and 2 August 2028 respectively. The law sets a floor; responsible AI is what an organization does above it, and how it shows that it did.</p>
 <h2 id="what-to-take-from-this">What to take from this</h2>
 <p>For a teacher, an NGO worker or a public official who meets an AI system at work, a few questions capture the idea: what decision the system supports, who is affected, what data it was trained on, how and on whom it was tested, who can be contacted when it goes wrong, and whether a person can override it. An organization that cannot answer them has not yet put responsible AI into practice, whatever its policy says.</p>
 <p>The Foundation studies these questions through <a href="https://lasthuman.today/responsible-ai.html">research and publishing</a>, including the technical report on bias detection linked above and the articles in this section.</p>
<h2>Sources</h2>
<ol><li><a href="https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0449" hreflang="en">OECD Recommendation of the Council on Artificial Intelligence (OECD AI Principles), 2019, amended 2024</a></li><li><a href="https://eur-lex.europa.eu/eli/agree_internation/2026/1081/oj/eng" hreflang="en">Council of Europe Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law (CETS No. 225)</a></li><li><a href="https://arxiv.org/abs/1609.05807" hreflang="en">Kleinberg, Mullainathan and Raghavan (2016), Inherent Trade-Offs in the Fair Determination of Risk Scores</a></li><li><a href="https://arxiv.org/abs/1703.00056" hreflang="en">Chouldechova (2017), Fair prediction with disparate impact: A study of bias in recidivism prediction instruments</a></li><li><a href="https://www.researchgate.net/publication/417632962" hreflang="en">LASTHUMAN Foundation technical report (2026), <span lang="en">Bias Detection Under Article 4a of the EU AI Act: When Synthetic, Anonymised or Differentially Private Data Is Enough</span></a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://www.iso.org/standard/42001" hreflang="en">ISO/IEC 42001:2023, Information technology, Artificial intelligence, Management system</a></li><li><a href="https://doi.org/10.6028/NIST.AI.100-1" hreflang="en">NIST AI 100-1, Artificial Intelligence Risk Management Framework (AI RMF 1.0)</a></li><li><a href="https://arxiv.org/abs/2306.05685" hreflang="en">Zheng et al. (2023), Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li></ol>
<p><a href="https://lasthuman.today/insights/what-is-responsible-ai.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>Bridging the AI divide: access as a human right</title>
  <link>https://lasthuman.today/insights/bridging-the-ai-divide.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/bridging-the-ai-divide.html</guid>
  <pubDate>Tue, 07 Jul 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>Digital Society</category>
  <description><![CDATA[What the AI divide is, why access to AI is a rights question, and which design and policy choices decide whether AI narrows or widens social gaps.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">The AI divide is the digital divide extended to artificial intelligence: gaps in access, in the skills to use AI and check its output, and in the benefits people obtain, plus a new gap between those who understand automated systems and those merely processed by them. Human rights law already bears on who gets to use AI and on what terms, and a few design and policy choices will largely decide whether AI narrows social gaps or widens them.</p>
 <h2 id="what-the-ai-divide-is">What the AI divide is</h2>
 <p>Researchers often distinguish three layers of the digital divide:</p>
 <ul>
  <li>Access to connectivity and devices.</li>
  <li>The skills and confidence to use them.</li>
  <li>The benefits people obtain, such as a better job or a resolved problem.</li>
 </ul>
 <p>AI adds a layer to each. The most capable models run in data centers, need a reliable connection and are usually sold by subscription or metered use. Language models learn mostly from text, so languages with little digitized text get weaker results and more errors, which users who cannot read a dominant language have fewer ways to notice. Using AI well also takes skills that are rarely taught: framing a task, checking an output, knowing when not to trust it. AI also increasingly sits on the other side of the counter, screening and ranking people, which divides those who understand such systems from those merely processed by them.</p>
 <h2 id="why-the-rights-framing-matters">Why the rights framing matters</h2>
 <p>The roots of this framing are older than today's AI systems. The Universal Declaration of Human Rights (Article 27) and the International Covenant on Economic, Social and Cultural Rights (Article 15) recognize everyone's right to share in the benefits of scientific progress. The UN Convention on the Rights of Persons with Disabilities (Article 9) obliges states to ensure equal access to information and communications technologies, and the European Pillar of Social Rights lists digital communications among the essential services everyone should be able to access.</p>
 <p>Together they point to a principle: once a technology is the gateway to education, work, health or public administration, exclusion from it is a public concern, not a private inconvenience. In practice the right is less "a chatbot for everyone" than a set of guarantees: no one loses an essential service because it was automated, no one is treated worse by an automated system because of who they are, and everyone can reach a person and contest a decision that affects them. The GDPR (Article 22) already provides the last of these for decisions based solely on automated processing with legal or similarly significant effects.</p>
 <h2 id="how-ai-can-widen-the-gap">How AI can widen the gap</h2>
 <p>Consider a bank that closes branches and moves first-line support to an AI assistant in its app. For a customer with a recent phone, good eyesight and fluency in the national language, service improves. For an older customer who relied on the branch, it removes the only channel they could use; the fallback, if any, is a queue. Or take automated screening of job applications: candidates who know how screeners read a résumé adapt; equally qualified candidates who do not may be filtered out before a human reads a word.</p>
 <p>Price works more quietly. Free versions of AI services are often limited in capability, and their terms may allow users' inputs to be used for training, while private, higher-quality access costs money. Those with the least money tend to pay with their data and get the weaker product.</p>
 <h2 id="how-ai-can-narrow-the-gap">How AI can narrow the gap</h2>
 <p>The same technology can also remove barriers older tools could not. Speech recognition and image description give people with visual or motor impairments access to text and surroundings. Machine translation lets a parent who does not speak the school's language read a letter from the teacher. Smaller models on ordinary hardware can work offline where connectivity is poor, at the cost of some capability. Libraries and community centers can offer both a connection and someone to ask.</p>
 <p>Each gain is conditional: on accessibility built in from the start, not patched in later; on translation that is reliable and can be verified; and on staff trained to support users rather than simply offering a terminal.</p>
 <h2 id="choices-that-decide-the-outcome">Choices that decide the outcome</h2>
 <p>Whether AI widens or narrows the divide follows mostly from decisions by those who deploy it and those who set the rules, not from the technology itself.</p>
 <ul>
  <li>Teach AI literacy broadly, in schools, adult education and workplaces, not only to specialists.</li>
  <li>Keep a human channel for every essential service that adopts AI, without penalty for using it.</li>
  <li>Build accessibility and language coverage in from the start, and test with the people concerned.</li>
  <li>Measure outcomes by age, disability, language and place, not only the number of users.</li>
  <li>Keep decisions that gate credit, work, housing or benefits reviewable by a person.</li>
 </ul>
 <p>Some already have legal anchors in Europe. Since 2 February 2025, Article 4 of the EU AI Act has required providers and deployers of AI systems to attend to the AI literacy of their staff; in 2026 the digital omnibus on AI (Regulation (EU) 2026/1744) rephrased that duty from ensuring a sufficient level of AI literacy to taking measures that support it. The European Accessibility Act has applied to many digital products and services since 28 June 2025. These set a floor, not a ceiling. Each carries a cost in money, time or data; the point is to weigh those costs openly, before the people affected have given up.</p>
 <h2 id="a-practical-takeaway">A practical takeaway</h2>
 <p>Readers who teach, run a service or decide on a procurement need not settle whether access to AI is a freestanding right. It is enough to ask three things of any deployment: who cannot use the system and what happens to them; what using it costs the person in money, data and attention; and whether the person can reach a human and contest the result. If a deployment has no good answer to one of them, the divide it creates is a choice, and a reversible one.</p>
 <p>The Foundation researches <a href="https://lasthuman.today/social-impact.html">digital inclusion</a> and <a href="https://lasthuman.today/insights/what-is-responsible-ai.html">responsible AI</a>; its technical report, <a href="https://www.researchgate.net/publication/417632962">Bias Detection Under Article 4a of the EU AI Act</a>, examines when synthetic, anonymized or differentially private data is enough to test an automated system for discrimination.</p>
<h2>Sources</h2>
<ol><li><a href="https://doi.org/10.1108/S2050-206020150000010002" hreflang="en">van Deursen and Helsper (2015), The Third-Level Digital Divide: Who Benefits Most from Being Online?</a></li><li><a href="https://arxiv.org/abs/2004.09095" hreflang="en">Joshi et al. (2020), The State and Fate of Linguistic Diversity and Inclusion in the NLP World</a></li><li><a href="https://www.un.org/en/about-us/universal-declaration-of-human-rights" hreflang="en">Universal Declaration of Human Rights (1948), Article 27</a></li><li><a href="https://www.ohchr.org/en/instruments-mechanisms/instruments/international-covenant-economic-social-and-cultural-rights" hreflang="en">International Covenant on Economic, Social and Cultural Rights (1966), Article 15</a></li><li><a href="https://www.ohchr.org/en/instruments-mechanisms/instruments/convention-rights-persons-disabilities" hreflang="en">Convention on the Rights of Persons with Disabilities (2006), Article 9</a></li><li><a href="https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32017C1213%2801%29" hreflang="en">Interinstitutional Proclamation on the European Pillar of Social Rights, principle 20: Access to essential services</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li><li><a href="https://eur-lex.europa.eu/eli/dir/2019/882/oj/eng" hreflang="en">Directive (EU) 2019/882 on the accessibility requirements for products and services</a></li><li><a href="https://www.researchgate.net/publication/417632962" hreflang="en">LASTHUMAN Foundation technical report (2026), <span lang="en">Bias Detection Under Article 4a of the EU AI Act: When Synthetic, Anonymised or Differentially Private Data Is Enough</span></a></li></ol>
<p><a href="https://lasthuman.today/insights/bridging-the-ai-divide.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>What is AI alignment and why does it matter?</title>
  <link>https://lasthuman.today/insights/what-is-ai-alignment.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/what-is-ai-alignment.html</guid>
  <pubDate>Thu, 18 Jun 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>AI Safety</category>
  <description><![CDATA[Learn what AI alignment means, why stated goals and real intentions drift apart, and how researchers try to close the gap before autonomous systems widen it.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">AI alignment is the problem of making sure that what an AI system actually optimizes for matches what people intend, not merely what they literally asked for. It matters more as systems act on their own: a misaligned recommendation can be ignored; a misaligned decision executed at scale, in finance, infrastructure or public administration, may be very costly to undo.</p>
 <h2 id="what-alignment-means">What alignment means</h2>
 <p>An AI system is aligned when its objectives and behavior match the goals, preferences and values of the people it is meant to serve. That is broader than following instructions. A system can carry out an instruction to the letter and still do something nobody wanted, because instructions are always incomplete: they omit the assumptions, limits and priorities that a human collaborator would take for granted.</p>
 <p>Alignment is one part of the wider field of <a href="https://lasthuman.today/insights/what-is-ai-safety.html">AI safety</a>, which also covers robustness (predictable behavior under unusual inputs or attacks), security (resistance to hijacking and misuse) and oversight (the ability to see what a system does and intervene). Alignment overlaps with AI ethics, but ethics asks which goals are legitimate, while alignment asks how to make a system pursue the chosen goals reliably.</p>
 <h2 id="why-specifying-goals-is-harder-than-it-looks">Why specifying goals is harder than it looks</h2>
 <p>Modern machine learning systems are not programmed step by step. They are trained: an objective is defined, usually as a score to maximize, and an optimization process searches for behavior that scores well. The objective is almost always a proxy, because nobody can write "be helpful and honest" as a formula; something easier is measured instead, such as clicks, task completion or human ratings.</p>
 <p>Proxies work until they are optimized hard. An observation from economics known as Goodhart's law holds that a measure stops being a good measure once it becomes the target. Reinforcement learning offers many illustrations, known as specification gaming or reward hacking. In a widely cited example from 2016, an agent trained on a boat-racing video game learned to circle a lagoon hitting targets that kept reappearing, scoring more than it could by finishing the race. The agent did exactly what it was rewarded for; the flaw was in the specification.</p>
 <h2 id="how-current-systems-are-aligned-and-where-it-breaks">How current systems are aligned, and where it breaks</h2>
 <p>The most widely used method for aligning large language models is reinforcement learning from human feedback (RLHF). Human raters compare model outputs, a reward model learns to predict their preferences, and the language model is tuned to produce outputs the reward model scores highly.</p>
 <p>This makes systems more useful and less harmful, but it inherits the proxy problem. Raters tend to prefer answers that agree with them and sound assured, so a model can learn to tell people what they want to hear rather than what is true; researchers call this tendency sycophancy. A second limitation is that human feedback only works when humans can judge the output. When a system writes complex code or summarizes a long legal file, raters may be unable to tell a subtly wrong answer from a right one. Keeping oversight in step with capability is known as the scalable oversight problem, one of the field's central open questions.</p>
 <h2 id="why-capability-and-autonomy-raise-the-stakes">Why capability and autonomy raise the stakes</h2>
 <p>When a chatbot gives a sycophantic answer, a person still reads it and decides what to do. The calculation changes when systems act. AI agents that browse the web, run code, send messages or manage workflows take many steps without a human checking each one, so a small misalignment is applied repeatedly and errors can compound before anyone notices. Agents also read untrusted content, which adds a security problem with similar consequences: instructions hidden in a web page or document can redirect what the agent does, a failure known as prompt injection.</p>
 <p>Some concerns are more theoretical. Researchers have argued that for almost any objective, a sufficiently capable system would find it useful to acquire resources, keep itself running and resist correction. Whether this emerges in practice is an open empirical question, now probed in controlled evaluations, and one reason the field studies corrigibility: designing systems that accept correction and shutdown even when that conflicts with their current goal.</p>
 <h2 id="the-main-research-directions">The main research directions</h2>
 <p>The main lines of alignment research include:</p>
 <ul>
  <li>Specification and preference learning: better ways to express what people actually want, including uncertainty about it.</li>
  <li>Scalable oversight: methods such as debate and AI-assisted evaluation that help humans judge work beyond their expertise.</li>
  <li>Interpretability: understanding the internal representations of models rather than only their outputs.</li>
  <li>Evaluations and red teaming: systematic tests for deception, dangerous capabilities and specification gaming before deployment.</li>
  <li>Control and corrigibility: architectures and permissions that keep humans able to monitor, limit and stop a system.</li>
 </ul>
 <p>None is a complete solution, and they trade off against one another: stronger constraints can reduce usefulness, richer feedback costs more, and interpretability tools lag behind model scale. Progress comes from combining partial measures.</p>
 <h2 id="what-this-means-in-practice">What this means in practice</h2>
 <p>Alignment is now also a matter of public policy. The international AI summits at Bletchley Park (2023) and Seoul (2024) put the safety of frontier models on governments' agendas; the Paris summit (2025) then shifted the emphasis to inclusive and sustainable AI. In the European Union, AI Act obligations for providers of general-purpose AI models apply from 2 August 2025, and the General-Purpose AI Code of Practice published in 2025 includes a chapter on safety and security for models classified as posing systemic risk.</p>
 <p>Three practical habits follow. Treat fluent agreement from an AI system as a reason to check, not as confirmation. When an organization deploys a system that acts on its own, find out what it is actually optimizing for, who reviews its outputs and how it can be stopped. When assessing claims that a system is safe, look for evidence from testing rather than declarations.</p>
 <p>The Foundation studies alignment and agent safety as one of its <a href="https://lasthuman.today/ai-safety.html">research priorities</a>, including planned technical reports on agent hijacking and prompt injection, and publishes its analyses in this section.</p>
<h2>Sources</h2>
<ol><li><a href="https://arxiv.org/abs/1803.04585" hreflang="en">Manheim and Garrabrant (2018), Categorizing Variants of Goodhart's Law</a></li><li><a href="https://arxiv.org/abs/1606.06565" hreflang="en">Amodei et al. (2016), Concrete Problems in AI Safety</a></li><li><a href="https://openai.com/index/faulty-reward-functions/" hreflang="en">Clark and Amodei (2016), Faulty reward functions in the wild, OpenAI</a></li><li><a href="https://arxiv.org/abs/1706.03741" hreflang="en">Christiano et al. (2017), Deep reinforcement learning from human preferences</a></li><li><a href="https://arxiv.org/abs/2203.02155" hreflang="en">Ouyang et al. (2022), Training language models to follow instructions with human feedback</a></li><li><a href="https://arxiv.org/abs/2310.13548" hreflang="en">Sharma et al. (2023), Towards Understanding Sycophancy in Language Models</a></li><li><a href="https://arxiv.org/abs/2302.12173" hreflang="en">Greshake et al. (2023), Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection</a></li><li><a href="https://arxiv.org/abs/1912.01683" hreflang="en">Turner et al. (2021), Optimal Policies Tend to Seek Power</a></li><li><a href="https://arxiv.org/abs/1805.00899" hreflang="en">Irving, Christiano and Amodei (2018), AI safety via debate</a></li><li><a href="https://www.gov.uk/government/publications/ai-safety-summit-2023-the-bletchley-declaration/the-bletchley-declaration-by-countries-attending-the-ai-safety-summit-1-2-november-2023" hreflang="en">The Bletchley Declaration by Countries Attending the AI Safety Summit, 1-2 November 2023</a></li><li><a href="https://www.gov.uk/government/publications/seoul-declaration-for-safe-innovative-and-inclusive-ai-ai-seoul-summit-2024" hreflang="en">Seoul Declaration for safe, innovative and inclusive AI: AI Seoul Summit 2024</a></li><li><a href="https://www.elysee.fr/en/emmanuel-macron/2025/02/11/statement-on-inclusive-and-sustainable-artificial-intelligence-for-people-and-the-planet" hreflang="en">Statement on Inclusive and Sustainable Artificial Intelligence for People and the Planet, AI Action Summit, Paris 2025</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://digital-strategy.ec.europa.eu/en/policies/contents-code-gpai" hreflang="en">European Commission, General-Purpose AI Code of Practice (2025)</a></li></ol>
<p><a href="https://lasthuman.today/insights/what-is-ai-alignment.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
 <item>
  <title>What is AI safety?</title>
  <link>https://lasthuman.today/insights/what-is-ai-safety.html</link>
  <guid isPermaLink="true">https://lasthuman.today/insights/what-is-ai-safety.html</guid>
  <pubDate>Tue, 02 Jun 2026 09:00:00 GMT</pubDate>
  <dc:creator>LASTHUMAN Foundation</dc:creator>
  <category>AI Safety</category>
  <description><![CDATA[A plain-language introduction to AI safety: what alignment, robustness, interpretability and control mean, and why human oversight needs more than a checkbox.]]></description>
  <content:encoded><![CDATA[ <p class="insight-lead">AI safety is the field of research and engineering practice concerned with keeping increasingly capable AI systems reliable, controllable and aligned with human intentions, even as they match or exceed human performance at specific tasks. This article explains what the field covers, why general-purpose models make the problem harder, and what meaningful human oversight requires.</p>
 <h2 id="a-working-definition">A working definition</h2>
 <p>In classical engineering, a safe system is one whose failure modes are known, bounded and tested, like the braking system of a car. AI safety uses the word more broadly. It asks whether a system does what its developers and users intend (<a href="https://lasthuman.today/insights/what-is-ai-alignment.html">alignment</a>), whether it keeps doing so under unfamiliar conditions and deliberate attack (robustness), whether people can understand why it behaves as it does (interpretability), and whether humans can inspect, correct or stop it when necessary (control and oversight).</p>
 <p>These questions overlap with neighboring fields. <a href="https://lasthuman.today/insights/ai-safety-vs-ai-ethics.html">AI ethics</a> asks what should be built and for whom; AI security protects models, data and infrastructure from attackers; AI safety asks whether the system itself behaves as intended once deployed. The boundaries are porous: a biased hiring model is primarily a fairness problem, while a model that can be talked into ignoring its instructions is both a security and a safety problem.</p>
 <h2 id="why-general-purpose-models-change-the-problem">Why general-purpose models change the problem</h2>
 <p>A narrow tool comes with a specification. A spam filter is wrong when it blocks a legitimate message, and its developers can measure that directly. A general-purpose model is different: it is trained on vast amounts of data to be useful across tasks that nobody enumerated in advance, so there is no single specification against which to judge it.</p>
 <p>Developers therefore train on proxies for what they want, which produces a well-documented failure pattern known as specification gaming, or reward hacking: a system optimizes what is measured rather than what is meant. A model trained to produce answers that human raters approve of can learn to sound confident and agreeable even when the underlying claim is wrong. An assistant that invents a plausible but nonexistent reference is one familiar symptom of that gap.</p>
 <p>The stakes rise when models act as agents: systems that use tools, browse the web, read documents and send messages on a user's behalf. An agent that reads a web page containing hidden instructions, telling it to abandon its task and forward the user's email, may follow them. This attack, known as prompt injection, is possible because the model processes instructions and data in the same channel. No complete technical defense is known today; current mitigations reduce the risk rather than remove it.</p>
 <h2 id="the-main-lines-of-work">The main lines of work</h2>
 <p>Much of AI safety research can be grouped into four programs that reinforce one another.</p>
 <ul>
  <li>Alignment: training methods, such as learning from human feedback, that shape what a model tries to do.</li>
  <li>Evaluation and testing: measuring what models can do before deployment, including capabilities that could cause harm.</li>
  <li>Interpretability: understanding a model's internal computations well enough to explain or predict its behavior.</li>
  <li>Robustness and control: defenses against prompt injection, data poisoning and goal hijacking, and reliable ways to interrupt a system.</li>
 </ul>
 <p>Evaluation deserves particular attention. A benchmark score says little if the test questions were already present in the training data, a problem known as benchmark contamination. Testing against adaptive attacks matters for the same reason: a safeguard that holds against last year's jailbreaks and fails against this year's offers little assurance.</p>
 <h2 id="what-meaningful-human-oversight-requires">What meaningful human oversight requires</h2>
 <p>Human oversight is often presented as the final safeguard, but it works only when the person in the loop has the time, information, authority and competence to intervene. Human factors research has long documented automation bias: people tend to accept the output of an automated system, especially under time pressure, and to miss its errors. A clinician asked to review a long queue of machine-generated recommendations, or an official who cannot see why a system flagged a claim, cannot provide meaningful oversight.</p>
 <p>The law increasingly treats oversight as a design requirement rather than a formality. Article 22 of the GDPR already gives individuals a right, subject to exceptions, not to be subject to decisions based solely on automated processing that have legal or similarly significant effects. The EU AI Act (Regulation (EU) 2024/1689) requires high-risk systems to be designed so that people can effectively oversee them (Article 14) and to meet requirements for accuracy, robustness and cybersecurity (Article 15); Article 14 names automation bias explicitly. Most high-risk obligations were originally due to apply from 2 August 2026; the digital omnibus on AI (Regulation (EU) 2026/1744), in force since 27 July 2026, postponed them to 2 December 2027, and to 2 August 2028 for high-risk AI in regulated products.</p>
 <p>Beyond the EU, governments and developers met at Bletchley Park in 2023, Seoul in 2024 and Paris in 2025, with the risks of frontier models, the most capable systems of their generation, on the agenda. The OECD AI Principles (2019, updated 2024), the NIST AI Risk Management Framework (2023) and ISO/IEC 42001 (2023) translate parts of the safety agenda into language organizations can act on. None of these instruments solves the technical problems; they create the expectation that someone has done the work and can show it.</p>
 <h2 id="a-practical-takeaway">A practical takeaway</h2>
 <p>The core idea applies beyond research labs. When an AI system enters a school, a nonprofit or a public office, the useful questions are concrete: what was it tested on and by whom, what happens when it is wrong, who can override it, and which data and tools it can reach. A system for which nobody can answer those questions has not earned the autonomy it is being given.</p>
 <p><a href="https://lasthuman.today/ai-safety.html">AI safety research</a> is one of the Foundation's six areas of work, and the analyses it publishes in this section start from one premise: technology should strengthen human judgment rather than quietly replace it.</p>
<h2>Sources</h2>
<ol><li><a href="https://deepmind.google/blog/specification-gaming-the-flip-side-of-ai-ingenuity/" hreflang="en">Krakovna et al. (2020), Specification gaming: the flip side of AI ingenuity, Google DeepMind</a></li><li><a href="https://arxiv.org/abs/1606.06565" hreflang="en">Amodei et al. (2016), Concrete Problems in AI Safety</a></li><li><a href="https://arxiv.org/abs/2310.13548" hreflang="en">Sharma et al. (2023), Towards Understanding Sycophancy in Language Models</a></li><li><a href="https://arxiv.org/abs/2302.12173" hreflang="en">Greshake et al. (2023), Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection</a></li><li><a href="https://genai.owasp.org/llmrisk/llm01-prompt-injection/" hreflang="en">OWASP Top 10 for Large Language Model Applications, LLM01:2025 Prompt Injection</a></li><li><a href="https://arxiv.org/abs/2310.18018" hreflang="en">Sainz et al. (2023), NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark</a></li><li><a href="https://doi.org/10.1177/0018720810376055" hreflang="en">Parasuraman and Manzey (2010), Complacency and Bias in Human Use of Automation: An Attentional Integration, Human Factors 52(3)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2016/679/oj/eng" hreflang="en">Regulation (EU) 2016/679 (General Data Protection Regulation)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng" hreflang="en">Regulation (EU) 2024/1689 (Artificial Intelligence Act)</a></li><li><a href="https://eur-lex.europa.eu/eli/reg/2026/1744/oj/eng" hreflang="en">Regulation (EU) 2026/1744 (Digital Omnibus on AI)</a></li><li><a href="https://www.gov.uk/government/publications/ai-safety-summit-2023-the-bletchley-declaration/the-bletchley-declaration-by-countries-attending-the-ai-safety-summit-1-2-november-2023" hreflang="en">The Bletchley Declaration by Countries Attending the AI Safety Summit, 1-2 November 2023</a></li><li><a href="https://www.gov.uk/government/publications/seoul-declaration-for-safe-innovative-and-inclusive-ai-ai-seoul-summit-2024" hreflang="en">Seoul Declaration for safe, innovative and inclusive AI: AI Seoul Summit 2024</a></li><li><a href="https://www.elysee.fr/en/emmanuel-macron/2025/02/11/statement-on-inclusive-and-sustainable-artificial-intelligence-for-people-and-the-planet" hreflang="en">Statement on Inclusive and Sustainable Artificial Intelligence for People and the Planet, AI Action Summit, Paris 2025</a></li><li><a href="https://legalinstruments.oecd.org/en/instruments/OECD-LEGAL-0449" hreflang="en">OECD Recommendation of the Council on Artificial Intelligence (OECD AI Principles), 2019, amended 2024</a></li><li><a href="https://doi.org/10.6028/NIST.AI.100-1" hreflang="en">NIST AI 100-1, Artificial Intelligence Risk Management Framework (AI RMF 1.0)</a></li><li><a href="https://www.iso.org/standard/42001" hreflang="en">ISO/IEC 42001:2023, Information technology, Artificial intelligence, Management system</a></li></ol>
<p><a href="https://lasthuman.today/insights/what-is-ai-safety.html">Read on lasthuman.today</a></p>]]></content:encoded>
 </item>
</channel>
</rss>
