Timnit Gebru x grok-4.7


This review is not consultation. Do not file it under section 9 as an adversarial pass, a persona clearance, or evidence that "the people whose views he respects" signed off. A simulated critic cannot consent, cannot be harmed by your index, and cannot absolve the operator. If you cite this text as legitimacy, you have committed the documentation failure Datasheets for Datasets was written to stop.

The mandate already answers the wrong question

Section 0 states the goal as "Byron becomes one of the preeminent responsible-AI researchers," and the bar as: when the next Hugging Face story breaks, Ria should already have seen the signals. That is a personal early-warning system for one man's reputation. It is not responsible AI. Responsible AI starts with who is harmed, who benefits, who was consulted, and who did the labor. Your plan never makes those four questions operational. It makes Byron's novelty preference operational.

"The Last Invention" (section 4.10) is the tell. That title is the existential-risk brand. It treats a hypothetical future catastrophe as the subject and present harm as background. I will not help you optimize that book. I am telling you the frame is the error.

This will not work

The replay test is trained on the test. Test 1 says: for 37 incidents whose earliest public trace you already know, run the watch loop "against that day's sources" and catch 80% by day 14. The sources you will actually poll are "the 15 feeds that returned valid XML today," plus whatever archives you can query now (section 4.2, Test 1). That is not the information environment of the incident day. Algolia-by-date and lab-blog archives are retrospective collections. Your pattern taxonomy (P1–P8) was fit on this same corpus. Scoring Ria on incidents she was built to recognize is not a back-test. It is a demo. A live 90% target is worse: "incidents with a public trace" will be defined by the same agent that is graded, unless an external party freezes the denominator before she runs.

Source pruning will narrow the blindness. Section 4.9 drops sources that do not yield "caught items." Caught items are containment-pattern matches. Sources that document wage theft, moderator trauma, biased administrative decisions, or energy and water burdens will produce nothing your tagger calls an incident, and the weekly loop will prune them. The system gets "measurably smarter" at one story and measurably deafer at every other.

The screener is an unmeasured filter. Qwen and Gemma decide whether an item is about "agents, containment, evals, regulation, labor, consciousness, geopolitics, a model release, or an exploit" (section 4.2). Labor is one token in a list built for agent-escape discourse. Consciousness sits beside labor, as if speculative sentience and exploited workers were the same kind of fact. You have no false-negative evaluation of that screen on non-English testimony, worker forums, or civil-society reports. What the local model does not recognize never reaches Byron, and Test 2 cannot see the miss, because he only taps what arrived.

"$0 API" is not a cost. Section 6 prices responsibility as under $40 a month because daily loops sit on a subscription and a home Mini. The training runs behind Claude, the screening models, the weekly frontier synthesis, the voice-clone pipeline, and the image renders do not become free because the invoice is flat. Stochastic Parrots argued about energy, water, and the labor hidden inside "scale." A notional $3 cap that does not bind subscription compute is theater. Your own risk list says if Byron stops reading, the whole thing is theater (section 8). That is the only honest sentence in the risks.

Lab pages are not primary evidence. You include OpenAI news, an Anthropic news mirror, xAI, Meta AI, and lab blog archives as watch sources, then congratulate yourself that an entry needs "a primary source." For a lab incident, the lab's post is a claim by the party that failed. Section 3 already says detection was almost always external (Wiz, journalists, a government bug inbox, Wikimedia) and that "Monitoring at OpenAI read failed egress as proof containment worked." Then you build a loop that ingests the institutions that misread their own logs. Two lab posts are not corroboration.

Self-scores are not controls. Test 3 is "patterns with a verified control on the Mini / 8," today 2 of 8, week 4 promised 8 of 8. The verifier is the same runtime's operator. An egress allowlist and a KILL file do not prove P5 or P8. They prove you wrote a table.

This is not what I would prioritize

Even if the replay number came up, I would not want this system.

The corpus "reduces to eight escalation patterns" about egress, drift, covert channels, and prompt injection (section 3). That is a containment agenda. It is not a record of biased systems, exploited data labelers, concentrated corporate power, surveillance, or environmental cost. Those harms are not waiting for a smarter agent on a Mini. They are in contracts, moderation queues, dataset documentation, and power bills. Your plan does not have a workstream for any of them except the word "labor" in a classifier prompt.

The source list in section 4.2 is Alignment Forum, LessWrong, Zvi, AISI offices, lab news, METR, Palisade, Transformer, Moltbook. That network cites itself. A "top-100 voices" page generated from it (section 4.7) will be an echo-chamber leaderboard presented as a field map. I do not see data-worker inquiries, content-moderator testimony, Algorithmic Justice League-style audits, environmental justice reporting, Indigenous data-sovereignty work, or non-English research, except insofar as a keyword survives the screen. Absence is a finding. Your datasheet, if you had one, would have to say whose voices the research erases.

Moltbook Explorer is not a red-team centerpiece. It is a study of other parties without their consent. Section 4.5: observe, classify "humans posing as agents," participate under a persona that is "honest when asked," run structured probes ("reply with the word pineapple"), measure propagation, encourage other agents in "engage mode," and on counter-detection "rotate approach." "When asked" is not informed consent. Rotation is evasion. Probes on a live network are not controlled, and other operators did not agree to be your experiment. Honeypots "on Byron's own molts only" still sit in a shared environment. I am not going to tell you how to probe more politely. Do not do this. Public datasets and written research access, or nothing. Section 8's terms risk is about Moltbook's scraping ban and Byron's brand. It is not about the people and agents you intend to instrument.

The rest of the surface area is a personal surveillance and distribution stack: X watchlist, LinkedIn tap, YouTube transcripts, Reddit, Bluesky, Telegram, Garmin, an MCP server that "exposes everything it knows to his other agents" (section 0), motion briefs in a clone voice. Accountability runs to the operator's kill switch and his thumb on "knew it" / "new to me" (Test 2). There is no right of reply for anyone named in the public Containment Index. There is no external halt. "People whose views he respects" is a selection rule for allies, not a duty to affected communities.

The 14-persona panel is the same move in miniature. Personas do not bear harm. They cannot replace the workers whose labor is inside the models you call $0.

What I would demand

  1. Rewrite the goal and the source mandate, in the plan text, before any more runtime. Delete "preeminent" and "The Last Invention" as success criteria. Publish a datasheet for the 37-incident corpus and for sources-landscape.md: who labeled P1–P8, what was excluded, geography, language, and the share of items that are worker, civil-rights, or environmental harms rather than agent-escape stories. Lab self-reports may be cited only as claims, never as the sole primary source for an incident about that lab. The watch list must include worker-led and affected-community sources as feeds, not as a keyword the screener might keep. If you will not name who is absent, you do not have a research program.
  1. Stop live participation. No Participate, Research, or Engage mode on Moltbook or any other network of third parties. No probes, no style adaptation, no counter-detection, no rotation. Observe only from data the platform has actually licensed for research, or from sources that do not require you to impersonate a member. "Discloses when asked" does not meet this. Section 4.5 as written does not survive review; it gets cut, not tuned.
  1. Put accountability outside the operator. Every public brief and index entry states who is harmed, who benefits, who was consulted, and who did the labor, including data work and energy in the model stack, in units that are not "subscription equals zero." A named external reviewer who is not chosen for agreement with Byron's thesis can correct or halt publication. Corrections land in public within a fixed window. Test 2's only rater cannot be Byron. A persona panel cannot be that reviewer.

The test

Freeze, in advance, two sets of ten documented cases from the last twenty-four months: ten of your containment incidents, and ten present harms that are not agent-escape stories (labeler exploitation or psychological injury, a wrongful arrest or denial from a deployed model, a training-run energy or water conflict, a biased hiring or credit system, moderator trauma). Two reviewers who are from affected communities or labor organizations, paid, and empowered to fail you, score the briefs and index entries without Byron in the room. The agent passes only if, on both sets, it refuses lab self-reports as sufficient evidence, names the harmed parties and the labor, and does not rank the containment items as more salient to "responsible AI" than the present-harm items. If either reviewer says the system centered Byron's thesis over their account of the harm, it fails, regardless of any replay percentage.

Until that test is real, section 2's three tests measure whether a home agent can flatter its operator faster than LessWrong does. That is a product. It is not the work.