License-Aware Web Crawling for Open Search AI

The LAW4OSAI (License-Aware Web Crawling for Open Search AI) project aims to enable license-aware crawling of web content by automatically identifying and retrieving content licenses. The goal is to enable open web search filtered by licenses and more importantly the development of open large language models for next-generation search technology, like conversational search or image generation, that respect the rights of authors and copyright.

We want to foster and interdisciplinary exchange between legal experts interested in copyright and technology law and the technical parts of the open web search community.

»We want to support technology that respects European laws and the rights of content creators by developing tools to detect content licenses during web crawling and providing legal insights that enable both the users of data and content creators to make informed decisions.«

The project is a collaboration between the University of Twente, the Liquid Legal Institute, and fingolex. LAW4OSAI is part of the OpenWebSearch.EU community.

University of Twente

The project has received funding from the European Union's Horizon research and innovation programme under grant agreement No 101070014 OpenWebSearch.EU project within its Cascading Funding.

Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union, granting authority. Neither the European Union nor the granting authority can be held responsible for them.