You may have heard that data is huge — changing the way science is done, enabling new kinds of consumer and business applications, furthering citizen involvement and government transparency, spawning a new class of software for processing big data and new interdisciplinary class of “data scientists” to help utilize all this data — not to mention metadata (data about data), linked data and the semantic web — there’s a whole lot of data, there’s more every day, and it’s potentially extremely valuable.
Much of the potential value of data is to society at large — more data has the potential to facilitate enhanced scientific collaboration and reproducibility, more efficient markets, increased government and corporate transparency, and overall to speed discovery and understanding of solutions to planetary and societal needs.
A big part of the potential value of data, in particular its society-wide value, is realized by use across organizational boundaries. How does this occur (legally)? Facts themselves are not covered by copyright and related restrictions, though the extent to which this is the case (e.g., for compilations of facts) varies considerably across jurisdictions. Many sites give narrow permission to use data via terms of service. Much ad hoc data sharing occurs among researchers. And increasingly, open data is facilitated by sharing under public terms, e.g. CC licenses or the CC0 public domain dedication.
CC tools, data, and databases
Since soon after the release of version 1.0 of the CC license suite (December, 2002) people have published data and databases under CC licenses. MusicBrainz is an early example (note their recognition that parts of the MusicBrainz database is strictly factual, so in the public domain, while other parts are licensible). Other examples include Freebase, DBpedia (structured information extracted from Wikipedia), OpenStreetMap, and various governments (Australia in particular has been a leader).
More recently CC0 has gained wide use for releasing data into the public domain (to the extent it isn’t already), not only in science, as expected, but also for bibliographic, social media, public sector data, and much more.
With the exception of strongly recommending CC0 (public domain) for scientific data, Creative Commons has been relatively quiet about use of our licenses for data and databases. Prior to coming to the public domain recommendation for scientific data, we published a FAQ on CC licenses and databases, which is still informative. It is important to recognize going forward that the two are complementary: one concerns what ought be done in a particular domain in line with that domain’s tradition (and public funding sources), the other what is possible with respect to CC licenses and databases.
This is/ought distinction is not out of line with CC’s general approach — to offer a range (but not an infinity) of tools to enable sharing, while encouraging use of tools that enable more sharing, in particular where institutional missions and community norms align with more sharing. For a number of reasons, now is a good time to make clear and make sure that our approach to data and databases reflects CC’s general approach rather than an exaggerated caricature:
- We occasionally encounter a misimpression that CC licenses can’t be used for data and databases, or that we don’t want CC licenses to be used for data and databases. This is largely our fault: we haven’t actively communicated about CC licenses and data since the aforementioned FAQ (until very recently), meaning our only message has been “public domain for scientific data” — leaving extrapolation to other fields to the imagination.
- Our consolidation of CC education and science “divisions” has facilitated examinations of domain-specific policies, and increased policy coherence.
- Ongoing work and discussions with CC’s global affiliate network; many CC affiliates are deeply involved in promoting open public sector information, including data.
- The existence and increasing number of users of CC licenses for data and databases (see third paragraph above).
- A sense of overwhelming competitive threat from non-open data; the main alternative to public domain is not sharing at all — absence of a strong CC presence, except for a normative one in science, creates a correspondingly large opportunity cost for society due to “failed sharing” (e.g., under custom, non-interoperable terms) and lack of sharing.
- A long-term shift in understanding of CC’s role: from CC as purveyor of a variety of tools and policies to CC as steward of the commons, and thus need to put global maximization, interoperability and standards before any single tool or policy idea that sounds good on its own, and to encourage (and sometimes push) producers of data and databases to do the same.
- We’ve thought and learned a lot about data and databases and CC’s role in open data. In 2002 data was not central to CC’s programs, now (in keeping with the times), it is.
- Ongoing confusion among providers and users of data about the copyrightability of data (it depends) and rights that may or may not exist as a result of how the data is compiled and distributed — the database.
- Later in 2011 we expect to begin a public requirements process for version 4.0 of our license suite. At the top level, we know that an absolute requirement will be to make sure the 4.0 licenses are the best possible tools (where public domain is not feasible, for whatever reason) for legally sharing data possible.
One other subtlety should be understood with respect to current (3.0) CC licenses. Data and databases are often copyrightable. When licensed under any of our licenses, the license terms apply to copyrightable data and databases, requiring adaptations that are distributed be released under the same or compatible license terms, for example, when a ShareAlike license is used.
Databases are covered by additional rights (sometimes called “sui generis” database rights) in Europe (similar database rights exist in a few other places). A few early (2.0) European jurisdiction CC license “ports” licensed database rights along with copyright. Non-EU jurisdiction and international CC licenses have heretofore been silent on database rights. We adopted a policy that version 3.0 EU jurisdiction ports must waive license requirements and prohibitions (attribution, share-alike, etc) for uses triggering database rights — so that if the use of a database published under a CC license implicated only database rights, but not copyright, the CC license requirements and prohibitions would not apply to that use. The license requirements and prohibitions, however, continued to apply to all uses triggering copyright.
CC licenses other than EU jurisdiction 3.0 ports are silent on database rights: databases and data are licensed (i.e., subject to restrictions detailed in the license) to the extent copyrightable, and if data in the database or the database itself are not copyrightable the license restrictions do not apply to those parts (though they still apply to the remainder). Perhaps this differential handling of database rights is not ideal, given that all CC licenses (including jurisdiction ports) apply worldwide and ought be easily understandable. However, those are not the only requirements for CC tools — they are also intended to be legally valid worldwide (for which they have a good track record) and produce outcomes consistent with our mission.
These requirements mandate the caution with which we approach database rights in our license suite. In particular, database rights are widely recognized to be bad policy, and instance of a general class of additional restrictions that are harmful to the commons, and thus harmful to collaboration, innovation, participation, and the overall health of the Internet, the economy, and society.
If database rights were to be somehow “exported” to non-EU jurisdictions via CC licenses, this would be a bad outcome, contrary not only to our overall mission, but also our policy that CC licenses not effectively introduce restrictions not present by default, e.g., by attempting to make license requirements and prohibitions obviate copyright exceptions and limitations (see “public domain” and “other rights” on our deeds, and the relevant FAQ). Simply licensing database rights, just like copyright, but only to the extent they apply, just like copyright, is an option — but any option we take will be taken very carefully.
What does all this mean right now?
(1) We do recommend CC0 for scientific data — and we’re thrilled to see CC0 used in other domains, for any content and data, wherever the rights holder wants to make clear such is in the public domain worldwide, to the extent that is possible (note that CC0 includes a permissive fallback license, covering jurisdictions where relinquishment is not thought possible).
(2) However, where CC0 is not desired for whatever reason (business requirements, community wishes, institutional policy…) CC licenses can and should be used for data and databases, right now (as they have been for 8 years) — with the important caveat that CC 3.0 license conditions do not extend to “protect” a database that is otherwise uncopyrightable.
(3) We are committed to an open transparent discussion and process around making CC licenses the best possible tools for sharing data (including addressing how they handle database rights), consistent with our overall mission of maximizing the value of the commons, and cognizant of the limitations of voluntary tools such as CC’s in the context of increasingly restrictive policy and overwhelming competitive threat from non-sharing (proprietary data). This will require the expertise of our affiliates and other key stakeholders, including you — we haven’t decided anything yet and will not without taking the time and doing the research that stewards of public infrastructure perform before making changes.
(4) is a corollary of (2) and (3): use CC licenses for data and databases now, participate in the 4.0 process, and upgrade when the 4.0 suite is released, or at least do not foreclose the possibility of doing so.
Regarding discussion — please subscribe to cc-licenses for a very low volume (moderated) list, intended only for specific proposals to improve CC licenses, and announcements of versioning milestones. If you’re interested in a more active, ongoing (unmoderated) discussion, join cc-community. You might also leave a comment on this post or other means of staying in touch. We’re also taking part in a variety of other open data discussions and conferences.
By the way, what is data and what are databases?
Oh right, those questions. I won’t try to answer too seriously, for that would require legal, technical, and philosophical dissertations. All information (including software and “content”) can be thought of as data; more pertinently, data might be limited to (uncopyrightable) facts, or it may include any arrangement of information, e.g., in rows, tables, or graphs, including with (copyrightable) creativity, and creative (copyrightable) arrangements of information. Some kinds of arrangements and collections of information are characterized as databases.
Data and databases might contain what one would think of as content, e.g., prose contained in a database table. Data and databases might be contained in what one would think of as content, e.g., the structured information in Wikipedia, assertions waiting to be extracted from academic papers, and annotated content on the web, intended first for humans, but also structured for computers.
(Note that CC has been very interested in and worked toward standards for mixing content and data — apparently taking off — because such mixing is a good method for ensuring that content and data are kept accurate, in sync, and usable — for example, licensing and attribution information.)
All of this highlights the need for interoperability across “content” and “data”, which means compatible (or the same) legal tools — a good reason for ensuring that CC licenses are the best tools for data, databases and content — indeed a mandate for ensuring this is the case. Thanks in advance for your help (constructive criticism counts, as does simply using our tools — experience is the best guide) in fulfilling this mandate.4 Comments »
CERN Library releases its book catalog into the public domain via CC0, and other bibliographic data news
CERN, the European Organization for Nuclear Research that is home to the Large Hadron Collider and birthplace of the web, has released its book catalog into the public domain using the CC0 public domain dedication. This is not the first time that CERN has used CC tools to open its resources; earlier this year, CERN released the first results of the Large Hadron Collider experiments under CC licenses. In addition, CERN is a strong supporter of CC, having given corporate support at the “creator” level, and is currently featured as a CC Superhero in the campaign, where you can join them in the fight for openness and innovation!
Jens Vigen, the head of CERN Library, says in the press release,
“Books should only be catalogued once. Currently the public purse pays for having the same book catalogued over and over again. Librarians should act as they preach: data sets created through public funding should be made freely available to anyone interested. Open Access is natural for us, here at CERN we believe in openness and reuse… By getting academic libraries worldwide involved in this movement, it will lead to a natural atmosphere of sharing and reusing bibliographic data in a rich landscape of so-called mash-up services, where most of the actors who will be involved, both among the users and the providers, will not even be library users or librarians.”
In related news, the Cologne-based libraries have made the 5.4 million bibliographic records they released into the public domain earlier this year, also via CC0, available in various places. See the hbz wiki, lobid.org (and their files on CKAN), and OpenDATA at the Central Library of Sport Sciences of the German Sports University in Cologne. For more information, see the case study.
The German Wikipedia has also used CC0 to dedicate data into the public domain; specifically, their PND-BEACON files are available for download. Since Wikipedia links out to quite a number of external resources, and since a lot of articles link to the same external resources, PND-BEACON files are the German Wikipedia’s way of organizing the various data. “In short a BEACON file contains a 1-to-1 (or 1-to-n) mapping from identifiers to links. Each link consists of at least an URL with optionally a link title and additional information such as the number of resources that are available behind a link.” Learn more from the English description of the project.1 Comment »
In addition to changing their default licensing policy from CC BY-NC to CC BY, the University of Michigan has enabled even greater sharing and reuse by releasing more than half a million bibliographic records into the public domain using the CC0 public domain dedication. Following on the heels of the British Library, who just released three million bibliographic records into the public domain, the University of Michigan Library has offered their Open Access bibliographic records for download, which, as of November 17, 2010, contains 684,597 records.
The University of Michigan Library has always been particularly advanced in regards to open content licensing, the public domain, and issues of copyright in the digital age. To learn more, see the John Wilkin’s post and help to improve the case study.
In addition, ever since we rolled out the CC0 public domain dedication, CC0 use for data has been on the increase. Check out the wiki for all current uses of CC0, and feel free to add case studies of any that are missing.Comments Off
The British Library has released three million records from the British National Bibliography into the public domain using the CC0 public domain waiver. The British National Bibliography contains data on publishing activity from the United Kingdom and the Republic of Ireland since 1950. JISC OpenBibliography has made this set downloadable at CKAN; in addition, the Internet Archive also offers the data for download.
This is a tremendous move on behalf of the British Library and the JISC OpenBibliography project, and we would like to congratulate them on their contributions to open data. From the JISC OpenBibliography project blog,
“Agreements such as these are crucial to our community, as developments in areas such as Linked Data are only beneficial when there is content on which to operate. We look forward to announcing further releases and developments, and to being part of a community dedicated to the future of open scholarship.”
For more information, see the case study on the British Library–and help us add to and improve it!Comments Off
The Design for America contest is the Sunlight Foundation‘s latest effort to modernize the United State’s information architecture and presentation. Their goal is “to make government data more accessible and comprehensible to the American public” by encouraging designers, artists, and programmers to reimagine government websites and to visualize government data and processes.
Provided you meet eligibility requirements, you can submit work to categories in Data Visualization, Process Transparency, and Redesigning the Government. Contests range from visualizing government data to redesigning government websites. The top prize in each contest is $5,000.Comments Off
At Creative Commons, we are always looking for new and interesting ways to find out just how much CC licensed content is out there on the web. Our latest project, the Open Database of Educational Projects and Organizations (or ODEPO), needs your help!
In 2008, ccLearn (now fully integrated into Creative Commons core) conducted a survey of educational projects online for its report to The William and Flora Hewlett Foundation entitled “What Status for Open? An Examination of the Licensing Policies of Open Educational Organizations and Projects” (pdf). Several months later it was followed up with a data supplement (pdf) that visualized some of the findings.
The report was developed in conjunction with ODEPO, which is a Semantic MediaWiki-based database of organizations involved in providing educational content online. Currently, ODEPO includes 1147 sites affiliated with various organizations, the majority of which were provided to us back in 2008 by educational repositories involved in the creation and expansion of Open Educational Resources (OER).
We’d like to continue supporting this database to help researchers, advocates, and learners find educational projects, analyze trends in online education, and become more effective advocates for open education. We hope that increased awareness of the digital education landscape will increase communication between consumers, producers, and curators of educational content which can lead to more open practices.
How to help: Browse ODEPO. If your favorite educational project or organization is missing, incomplete, or incorrect, please log in to or create a CC wiki account and follow these instructions. Alternatively, you can simply browse to your educational project and click the “Edit this data” button on the page.
Addendum: There is now an Open Tasks tracker for ODEPO where you can find lists of pages that need more data.Comments Off
In a step towards openness, the UK has opened up its data to be interoperable with the Attribution Only license (CC BY). The National Archives, a department responsible for “setting standards and supporting innovation in information and records management across the UK,” has realigned the terms and conditions of data.gov.uk to accommodate this shift. Data.gov.uk is “an online point of access for government-held non-personal data.” All content on the site is now available for reuse under CC BY. This step expresses the UK’s commitment to opening its data, as they work towards a Creative Commons model that is more open than their former Click-Use Licenses. From the blog post,
“This is the first major step towards the adoption of a non-transactional, Creative Commons style approach to licensing the re-use of government information.
The Government’s commitment in Putting the Frontline First: smarter government is to “establish a common licence to re-use data which is interoperable with the internationally recognised Creative Commons model”. This is key to supporting new information initiatives such as the beta release of data.gov.uk also launched today to promote transparency, public service improvement and economic growth.”
We at CC are thrilled by this new development and congratulate the UK for this move. Though we are confident that this shift will increase the UK’s capacity to foster reuse, collaboration, and innovation in government and the world, we hope to see the UK as well as other governments move in the future towards even fuller openness and the preferred standard for open data via CC Zero, a tool that “enables scientists, educators, artists and other creators and owners of copyright-protected content to waive copyright interests in their works and thereby place them as completely as possible in the public domain, so that others may freely build upon, enhance and reuse the works for any purposes without restriction under copyright.”
This would not have been possible without the hard work of Creative Commons teams in the UK, especially that of Dr. Prodromos Tsiavos, our CC England and Wales Legal Project Lead. Check out the press release, the PerSpectIves or data.gov.uk blog, and the Guardian article for more details.4 Comments »