Search-Only Contract
The Movement for an Open Web (MOW) publishes the Search Only Terms Contract, a contract for automated access to a website. It lets crawlers index your pages for search for free, and it sets a fee for every other access: training AI models, building embeddings and datasets, and generating AI summaries or AI-enriched answers. The contract is under the law of England and Wales.
We recommend it to every FORA publisher, whether or not you run the FORA edge function. Each one does a different job:
- The edge function stops the AI bots that name themselves, on the paths you protect, and tells them where to buy.
- The contract covers what the edge function does not see: your open paths, and scrapers that hide what they are.
- FORA is where the fee gets paid. An agent that wants more than search buys a license from your offers and gets a signed receipt, instead of running up a fee under the contract.
Adopting it means setting your fee, adding the contract and the fee to your site’s terms, and pointing robots.txt at it. Choosing it, and the fee, are your decisions. This page is not legal advice.
Adopt the contract
Section titled “Adopt the contract”You don’t edit the contract. It is one fixed document at MOW’s address, the same for every site, and you link to it. Your price goes in your own site’s terms, which the contract points to. These steps follow MOW’s implementation guide, which warns that skipping a step can leave the contract unenforceable.
-
Link the official URL; don’t host a copy. Each version of the contract has a fixed URL that never changes. The current version is
https://m4ow.uk/socw/3.txt. A new version gets a new URL. -
Set your access fee. The contract sets no default. It charges “a fee per Product accessed, in the amount set out in the Website Terms and Conditions” (clause 4.3), where a product “may include: an article, an item, an image, a video, an audio file or other media” (clause 4.3.2). Choose one fee for every product, or one per type. Set it on your own: the guide says each publisher “must set its Access Fee independently” and must not discuss or agree it with other publishers.
-
Add the contract and your fee to your site’s terms, with the guide’s two pieces of mandatory wording, one after the other. Replace only what is in square brackets: the name of your terms, your clause numbers, and the amounts. Each ● marks where your amount goes.
Wording (A) incorporates the contract:
[Clause #] These [terms of service] refer to and incorporate the followingadditional terms, which also apply to your use of our [site]:[Clause 1.1] Our Search Only Terms Contract: for Access and Use of Website(available at the version-controlled URL published by MOW, currently beingthe following link: https://m4ow.uk/socw/3.txt) governs access to theWebsite and its content.[Clause 1.2] If there is an inconsistency between any of the provisions ofthese [Terms and Conditions] and the provisions of [Search Only TermsContract: for Access and Use of Website as linked above], the provisions ofthe Search Only Terms Contract: for Access and Use of Website, the versionhosted at the referenced MOW URL shall prevail.Wording (B) sets your fee. Use clause 1.3 for one fee for every product:
[Clause 1.3] For the purposes of Clause 4.3 of the Search Only TermsContract: for Access and Use of Website, the Access Fee payable in respect ofeach Product accessed as a result of an Access Event that is UnlicencedAccess is [£● (● pounds sterling)] exclusive of VAT, which shall be payablein addition where applicable.Or this clause 1.3, for a fee per type of product:
[Clause 1.3] For the purposes of Clause 4.3 of the Search Only TermsContract: for Access and Use of Website, the Access Fee payable in respect ofeach Product accessed as a result of an Access Event that is UnlicensedAccess is: (a) for each written work, £[●]; (b) for each image orphotographic work, £[●]; (c) for each video, £[●]; (d) for each audio work,£[●]; and (e) for any other Product, £[●], in each case exclusive of VAT,which shall be payable in addition where applicable.Then clause 1.4, with either version:
[Clause 1.4] The Access Fee is a contractual debt which becomes immediatelydue and payable in accordance with Clause 4 of the Search Only TermsContract: for Access and Use of Website. Capitalised terms used in [Clauses1.3 and 1.4] and not otherwise defined in these [Terms and Conditions] havethe meanings given to them in the Search Only Terms Contract: for Access andUse of Website.Link your terms from every page, for example in the footer. When you change the fee, update your terms and archive them again.
-
Add the contract to your
robots.txt. Thetdl(Terms Document Locator) line tells every crawler where the contract is:# License https://m4ow.uk/socw/3.txtUser-agent: *tdl: https://m4ow.uk/socw/3.txtAllow: /If your
robots.txtalready has aUser-agent: *group, add thetdlline to that group instead of starting a second one. -
Keep the evidence. Take screenshots of the changes, and archive your
robots.txtwith the Internet Archive after you update it.
How a crawler finds your fee
Section titled “How a crawler finds your fee”Nothing in robots.txt carries a price. The tdl line points to the contract, and the contract points to your terms. It “is incorporated into, and forms part of, the Website Operator’s Website Terms and Conditions, published on the Website and accessible via a hyperlink or URL made available on the Website for that purpose (including, without limitation, in the website footer, navigation menu, or account registration interface)”. Its clause 4.3 then takes the fee “in the amount set out in the Website Terms and Conditions”.
So a crawler that follows the chain goes from robots.txt to the contract to your terms, and finds the fee there. The contract binds by notice rather than by a field a machine parses, which is why the guide puts it in several places at once: robots.txt, your terms, and letters to the companies that run the crawlers.
To make your terms as easy to find as the contract, link both from every page (see below). A price an agent can read, pay and get a receipt for, without a person reading your terms, is what your FORA offers are.
Mark every page
Section titled “Mark every page”The guide also allows links in each page’s HTML <head>. Its own example lists more than one, so you can link the contract and your terms together:
<link rel="terms-of-service" href="https://m4ow.uk/socw/3.txt" /><link rel="terms-of-service" href="https://publisher.example/terms" />Or, where you can set response headers at your origin or on your CDN, as one Link header per document:
Link: <https://m4ow.uk/socw/3.txt>; rel="terms-of-service"Link: <https://publisher.example/terms>; rel="terms-of-service"Keep your FORA terms in line with it
Section titled “Keep your FORA terms in line with it”The contract charges for everything beyond search. If your FORA terms give some of that away for free, they undercut the fee.
- Keep search free, as the contract does.
- Price AI input and AI training, or don’t offer them. In the publisher console, set this in Your terms: its default allows AI input for free.
A term can also name the contract as its license document, so an agent that reads your offers reads the same contract. Set License.uri to the contract’s URL, License.uri_digest to its digest, and License.immutable to true, since the text at that URL never changes. For version 3:
uri: https://m4ow.uk/socw/3.txturi_digest: sha256:0ba4cfba7f5cb74a64ad58e42b4caa575b7b6faa3b21df62ea9ff718be55b2a7immutable: trueThe contract is under English law. If you publish in several countries, adopt it on the domains where that suits you. Each domain has its own terms and its own robots.txt.
Related
Section titled “Related”- Publisher Onboarding: register your domain and set your terms
- Bot Detection: which AI bots the edge function stops
- Licensing Terms: the
Licensefields and how terms are read