Lesson 02 · Ideas
Who decides
Map every decision in a data project
30 min · Lesson 2 of 13

Goal
Map the decisions behind one AI or data project, see who makes each of them, and find two places where the people the data is about could take part while it still matters.
Read
People often call an AI system sovereign because it was trained inside a country, paid for with public money, or built for a national language. Audrey Tang does not accept that shortcut. In her statement to the Senate of Canada she writes that "a model is not sovereign simply because it is national or speaks many languages. Sovereignty depends on the process."
Process sounds abstract, so make it concrete. Every AI or data project is a chain of decisions. Someone chooses the question. Someone decides what to collect and from whom. Someone labels the data, trains the model, tests it, decides where it runs, and decides what happens when it gets something wrong. A system belongs to a community when that community holds real authority somewhere along the chain, early enough to change what happens.
- 01
Question
Who decides?
- 02
Collection
Who decides?
- 03
Labels
Who decides?
- 04
Training
Who decides?
- 05
Testing
Who decides?
- 06
Use
Who decides?
- 07
Fix or retire
Who decides?
GainForest learned this during the XPRIZE Rainforest competition, where we co-led the ETH BiodivX team with researchers from ETH Zurich. Before the finals in July 2024, the team ran eight co-learning workshops with communities in and around Manaus. Four Indigenous and local communities formed an Indigenous Data Council. The council became an official member of the team with a voice in its decisions, and it approved the prices paid for the data communities collected during the finals. A benefit-sharing agreement made all of this formal.
Marina Mura, from the Mura people, chaired the council. She first came to one of our workshops in January 2024, curious about technology and, by her own account, afraid of it. Ten months later she gave the team's speech in Rio de Janeiro when ETH BiodivX won an XPRIZE bonus prize for co-developing inclusive technology. The team donated the full $250,000 to an endowment for Indigenous scientists in the Amazon.

In her field notes Marina explains why the arrangement worked. The team kept coming back with changes the village had asked for, and over time the village came to see that "it's not ETH BiodivX entering the village, but members of our community, as equals."
Compare that with a pattern you may have seen. A team designs a system, then holds a consultation to show it to the community. By then every important decision is made. Tang is blunt about this. Deliberation should help people "draw boundaries early", and it "should not be treated as symbolic consultation after a design has already been decided."
One more trap. Privacy protection matters, and it does not settle the question. A community can keep its data "technically protected and still lose authority", Tang writes, if its knowledge is absorbed into systems that it "cannot see, shape, correct or reject."
So the test for any project is short. Can the people it represents inspect it, correct it, reject it, move away from it, or retire it? If the answer is no at every step of the chain, the project is not theirs, whatever flag it flies.
Try it
Map who decides
Alone or in pairs · 15 min
- 1Pick one project that collects data about a community or a place you care about. It can be an app, a research study, a map or an AI tool.
- 2Draw a line with seven steps: the question, collection, labelling, training, testing, use, and fixing or retiring the system.
- 3Under each step, write who decides. Guess if you have to, and mark the guesses.
- 4Circle every step where the community the data is about has no say.
- 5Pick two circles and write one realistic change for each. A meeting before the questions are fixed, a reviewer the community chooses, or a clause that lets the community stop the project.
To discuss
- Which name appears most often on your line?
- At which step would a no from the community still change the outcome?
- What would the community need to take part at that step: time, money, training, translation?
Print for this lesson
Check yourself
Question 1 of 3
A government trains a large language model on national data in its own data centre. Does that make it sovereign for the language communities in that data?
Question 2 of 3
What made the Indigenous Data Council in the ETH BiodivX team more than a consultation?
Question 3 of 3
True or false: if a community's data is encrypted and private, the community has sovereignty over it.
Sources
- 1.Audrey Tang, Supplementary Statement on Indigenous Data Sovereignty and AI, Senate of Canada
- 2.GainForest blog, GainForest's journey with ETH BiodivX at the XPRIZE Rainforest, part 2: community (July 2024)
- 3.Marina Mura, Indigenous field notes from the Biodiversity Olympics (November 2024)
- 4.ETH Zurich, ETH Zurich team takes home a quarter million in biodiversity prize (November 2024)
