| commit | c9f9668234bdc13df99b917d83c22e19bfb6af33 | [log] [tgz] |
|---|---|---|
| author | Joshua Haberman <jhaberman@gmail.com> | Sun Nov 01 00:06:23 2020 -0700 |
| committer | Joshua Haberman <jhaberman@gmail.com> | Sun Nov 01 00:06:23 2020 -0700 |
| tree | 501d0ccd193b761884e744f2b66733155e21a2a1 | |
| parent | 4d9a8cd67b19372c634480a5d80b202373e7d419 [diff] |
symtab: use longjmp() for errors and avoid intermediate table. We used to use a separate "add table" during the upb_symtab_addfile() operation to make it easier to back out the file if it contained errors. But this created unnecessary work of re-adding the same symbols to the main symtab once everything was validated. Instead we directly add symbols to the main symbols table. If there is an error in validation, we remove precisely the set of symbols that were already added. This also requires using a separate arena for each file. We can fuse it with the symtab's main arena if the operation is successful. LoadDescriptor_Upb 61.2µs ± 4% 53.5µs ± 1% -12.50% (p=0.000 n=12+12) LoadAdsDescriptor_Upb 4.43ms ± 1% 3.06ms ± 0% -31.00% (p=0.000 n=12+12) LoadDescriptor_Proto2 257µs ± 0% 259µs ± 0% +1.00% (p=0.000 n=12+12) LoadAdsDescriptor_Proto2 13.9ms ± 1% 13.9ms ± 1% ~ (p=0.128 n=12+12)
| Platform | Build Status |
|---|---|
| macOS |  |
| ubuntu |  |
μpb (often written ‘upb’) is a small protobuf implementation written in C.
upb generates a C API for creating, parsing, and serializing messages as declared in .proto files. upb is heavily arena-based: all messages always live in an arena (note: the arena can live in stack or static memory if desired). Here is a simple example:
#include "conformance/conformance.upb.h" void foo(const char* data, size_t size) { upb_arena *arena; /* Generated message type. */ conformance_ConformanceRequest *request; conformance_ConformanceResponse *response; arena = upb_arena_new(); request = conformance_ConformanceRequest_parse(data, size, arena); response = conformance_ConformanceResponse_new(arena); switch (conformance_ConformanceRequest_payload_case(request)) { case conformance_ConformanceRequest_payload_protobuf_payload: { upb_strview payload = conformance_ConformanceRequest_protobuf_payload(request); // ... break; } case conformance_ConformanceRequest_payload_NOT_SET: fprintf(stderr, "conformance_upb: Request didn't have payload.\n"); break; default: { static const char msg[] = "Unsupported input format."; conformance_ConformanceResponse_set_skipped( response, upb_strview_make(msg, sizeof(msg))); break; } } /* Frees all messages on the arena. */ upb_arena_free(arena); }
API and ABI are both subject to change! Please do not distribute as a shared library for this reason (for now at least).
Currently only Bazel is supported (CMake support is partial and incomplete but full CMake support is an eventual goal).
To use upb in your Bazel project, first add upb to your WORKSPACE file, either as a git_repository() or as a new_local_repository() with a Git Submodule. (For an example, see `examples/bazel/ in this repo).
# Add this to your WORKSPACE file. load("@bazel_tools//tools/build_defs/repo:git.bzl", "git_repository") git_repository( name = "upb", remote = "https://github.com/protocolbuffers/upb.git", commit = "d16bf99ac4658793748cda3251226059892b3b7b", ) load("@upb//bazel:workspace_deps.bzl", "upb_deps") upb_deps()
Then in your BUILD file you can add upb_proto_library() rules that generate code for a corresponding proto_library() rule. For example:
# Add this to your BUILD file. load("@upb//bazel:upb_proto_library.bzl", "upb_proto_library") proto_library( name = "foo_proto", srcs = ["foo.proto"], ) upb_proto_library( name = "foo_upbproto", deps = [":foo_proto"], ) cc_binary( name = "test_binary", srcs = ["test_binary.c"], deps = [":foo_upbproto"], )
Then in your .c file you can #include the generated header:
#include "foo.upb.h" /* Insert code that uses generated types. */
This library contains several semi-deprecated interfaces (see BUILD file for more info about which interfaces are deprecated). These deprecated interfaces are still used in some significant projects, such as the Ruby and PHP C bindings for protobuf in the main protobuf repo. The goal is to migrate the Ruby/PHP bindings to use the newer, simpler interfaces instead. Please do not use the old interfaces in new code.
This repo has some Lua bindings for the core library. These are experimental and very incomplete. These are currently included in order to validate that the C API is suitable for wrapping. As the project matures these Lua bindings may become publicly available.
Author: Josh Haberman (jhaberman@gmail.com, haberman@google.com)