commit | 8e2157f318eb490b192a4a5c1e3b8870e024e5ca | [log] [tgz] |
---|---|---|
author | Christopher Schmidt <crschmidt@google.com> | Wed Oct 10 14:06:43 2018 -0400 |
committer | Christopher Schmidt <crschmidt@google.com> | Wed Oct 10 14:57:06 2018 -0400 |
tree | 7c222abb3ca5c937dd2a16dbe98c5b63e12fc915 | |
parent | c642cb3db2d241043a145c4c8ec498ab1422d892 [diff] |
Change around the Python licenses. The "canonical" Python license actually has multiple licenses inside of it. Because of how licenseclassifier attempts to find matching text, this appears to cause low confidence matches with anything other than an *exact* match. The first license within the Python license is the Python Foundation License, which we'll treat as the "Python-2.0.txt" file; and include the "full" Python license as Python-2.0-complete for exact matching. In four recent cases this has come up, this now correctly identifies that the license text contains the Python-2.0 license. PiperOrigin-RevId: 216559486
The license classifier is a library and set of tools that can analyze text to determine what type of license it contains. It searches for license texts in a file and compares them to an archive of known licenses. These files could be, e.g., LICENSE
files with a single or multiple licenses in it, or source code files with the license text in a comment.
A “confidence level” is associated with each result indicating how close the match was. A confidence level of 1.0
indicates an exact match, while a confidence level of 0.0
indicates that no license was able to match the text.
Adding a new license is straight-forward:
Create a file in licenses/
.
.header
” to it. See licenses/README.md
for more details.Add the license name to the list in license_type.go
.
Regenerate the licenses.db
file by running the license serializer:
$ license_serializer -output licenseclassifier/licenses
Create and run appropriate tests to verify that the license is indeed present.
identify_license
is a command line tool that can identify the license(s) within a file.
$ identify_license LICENSE LICENSE: GPL-2.0 (confidence: 1, offset: 0, extent: 14794) LICENSE: LGPL-2.1 (confidence: 1, offset: 18366, extent: 23829) LICENSE: MIT (confidence: 1, offset: 17255, extent: 1059)
The license_serializer
tool regenerates the licenses.db
archive. The archive contains preprocessed license texts for quicker comparisons against unknown texts.
$ license_serializer -output licenseclassifier/licenses
This is not an official Google product (experimental or otherwise), it is just code that happens to be owned by Google.