Changes: + 4e475e2: Revert "Merge "Fixing remote compare mode to update the action result with the local run results.""
Changes: + 16831e5: Do not store cache entries for directories + 45dce2b: roll rules_go to v0.23.4 + 07ee194: kokoro/macos_extenral: enabe unit tests + f45e5be: chromium linux integration test + ab096bd: Do not add dependencies from the CLI for signapk actions + eb92c1c: Invalidate output file cache entries before uploading LERC cache outputs + 4691c35: Add verification of LERC stats in integration test + dc2894c: Hide cpp dependency scanner inside input processor + d74d8f1: Remove the need to verify timestamp set by clang binary + 9ea12a5: handle clang-cl flags + ab6e77b: Disable local fallback when LERC local execution fails with a user error. + 9780e32: refactor flagsparser + 750690c: remoteexec test: show reproxy log if failed. + 88ba17a: Fixing remote compare mode to update the action result with the local run results. + 2207a13: Bumping SDK version to propagate recent bug fixes + 175cdbe: Add Dockerfile for ubuntu container with strace for RE debugging. + 0c4fab3: Add instructions on how to fetch dev-foundry.json file + 98f89d7: Removing a no longer needed ProxyResponseMillies stat. + 1537b7f: Add reproxy option to dump input tree of all actions it receives. + 09d4d6c: kokoro: Add Mac presubmit build + 53e3c14: Fix scripts to reflect current locations of bazel binaries. + 545b29a: kokoro: Set GOPATH, GOBIN, PATH for Mac builds
Changes: + 3af712d: kokoro: Set directory in mac continuous build + 4ad36dd: Rewrite environment variables to have relative paths. + eba7afc: kokoro: Add macos_external dir with continuous build + d245833: gcp_windows: use --test_output=streamed + 6b2ce38: Centralize config_setting in BUILD.bazel file + 73e7928: gazelle: no need to exclude internal/pkg/cppdependencyscanner + 498daa8: swig is no longer needed + 7c18a43: windows presubmit builder + d989ccf: Fix kokoro windows + 854eeec: update go protobuf + 02cf17f: fix BUILD.bazel by gazelle + 54a6cfb: don't run cp command
Changes: + e0ce5e9: Update remote-apis-sdks to include fix for cache issue + 1bb305e: Switching to SDK version of Cache. + 1d54d28: use --experimental_allow_tags_propagation + 729dee1: fix build on linux + 147ae72: kokoro for windows + 856638b: enable windows build + 823753f: cppdependencyscanner: no need to link libdl + 6186c4c: inputprocessor: Add .keep_me to -sysroot, etc + 43befec: Add doc for rules_foreign_cc patch + 4dec8c3: cppcompile: fix test on windows + d48f808: reproxy: static link libstdc++ + 8a52c03: Add remote execution support for clang-tidy actions + 677ac78: Patch osx_commands.bzl in rules_foreign_cc + df50112: cppcompile: Use WorkingDirectory in unit test + 36ad52f: cppdependencyscanner: don't use -Bstatic for macosx + 52995ef: Use v3 docker image (adds cipd binaries) + b986df7: Add cipd.yaml file. + f68612c: Add depot_tools to re-client-builder DockerFile. + 7335e04: fix mac build + 0b11193: cppdependencyscanner as go_library + e709044: remove custom plugin build rule + 1f7d8c1: Fix bump-version script to ignore merge commits
Changes: + 8d702db: Parse metalava dep file if present. + 476583e: Add a script to autogenerate version bump commit + 0ef1512: Add a test to make sure version numbers dont contain undefined string + 5ef722c: cleanup //internal/pkg/bootstrap + 5f23182: inputprocessor recognizes clang '-arch' flag + f0ae1e9: clangscandeps: get rid of swig + 66741fb: Bump bazel version to 3.2. + 428104c: Add -fsanitize-blacklist argument to 'toAbsArgs' list. + c8d7682: use protocmp for cmp.Diff + 4b64c20: Revert "Revert "fix .bazelrc for windows"" + 0756620: cleanup BUILD.bazel + 5aa7bea: cleanup //pkg/cache + ca687d4: remove //internal/pkg/cli + 41e60cf: skip TestCleanIncludePaths on windows + 3e5e8bc: Remove sync.Once from feature config since its not needed.
Changes:
+ 6ef0853:
Revert "fix .bazelrc for windows"
This release fixes the re-client version number to re-include git commit sha.
Changes:
+ ac536bf:
fix //internal/pkg/inputprocessor/action/r8 test for windows
+ 9685b69:
Merge "fix //internal/pkg/reproxy test for windows"
+ 6ac7ff7:
fix //internal/pkg/inputprocessor/toolchain test on windows
+ 63007d4:
fix //internal/pkg/reproxy test for windows
+ 41a675a:
fix //pkg/inputprocessor test on windows
+ e13bf22:
Merge "Add an r8 input processor capable of parsing flags files and transitive includes."
+ 95ac626:
Merge "fix //internal/pkg/subprocess"
+ c3002a1:
Add an r8 input processor capable of parsing flags files and transitive includes.
+ 35e5cdf:
fix //pkg/filemetadata test for windows
+ 99a4d56:
fix //internal/pkg/subprocess
+ 1744d44:
remove processToolchainInputsUsingStrace
+ 48993d9:
Merge "fix internal/pkg/logger for windows"
+ 7ef55eb:
Merge "fix //internal/pkg/inputprocessor/pathtranslator test for windows"
+ a97c325:
fix internal/pkg/logger for windows
+ a932917:
fix //internal/pkg/inputprocessor/pathtranslator test for windows
+ f44a68d:
add totalRamMBs for windows
+ 5666f30:
Merge "fix //internal/pkg/deps test for windows"
+ 27f7037:
Merge "Use rules_go's bazel package to access runfiles"
+ a5c9bfe:
Merge "Linux- and Mac-specific code for reproxy/localexec"
+ 564beb4:
fix //internal/pkg/deps test for windows
+ 50ded68:
Merge "fix //internal/pkg/inputprocessor/action/cppcompile test for windows"
+ 87a022d:
Merge "fix //internal/pkg/deps test for windows"
+ 2e6868b:
Merge "fix //internal/pkg/inputprocessor/flagparser test for windows"
+ d6c91db:
Merge "fix //internal/pkg/inputprocessor/action/headerabi test for windows"
+ 45b5ed0:
Merge "Support main-dex-list flag in r8 and d8 commands."
+ 66cefb8:
fix //internal/pkg/deps test for windows
+ bf430b1:
fix //internal/pkg/inputprocessor/action/cppcompile test for windows
+ b8f5819:
fix //internal/pkg/inputprocessor/action/headerabi test for windows
+ d0bebef:
fix //internal/pkg/inputprocessor/flagparser test for windows
+ 635625b:
Use rules_go's bazel package to access runfiles
+ c83c795:
execroot: fix for windows
+ b16b64b:
Merge "don't use (*os.File).Chmod"
+ 9340e2d:
Merge "Make feature config a singleton for use throughout reproxy."
+ aff8a35:
don't use (*os.File).Chmod
+ 0d35981:
Support main-dex-list flag in r8 and d8 commands.
+ 16d3015:
update rules_go from 0.20.1 to 0.21.7
+ 5dbe23f:
Make feature config a singleton for use throughout reproxy.
+ f98951c:
Linux- and Mac-specific code for reproxy/localexec
+ de5ea79:
Merge "fix .bazelrc for windows"
+ 556277e:
Add feature for cleaning input paths.
+ c6b56a5:
fix .bazelrc for windows
+ 703a714:
Fix GoB/Gerrit URL in README.md
+ f86cb46:
Merge "Revert "Include all package html files under sourcepath for metalava actions.""
+ 9b43238:
Revert "Include all package html files under sourcepath for metalava actions."
+ ca42d0a:
Merge "Include all package html files under sourcepath for metalava actions."
+ b83225b:
Include all package html files under sourcepath for metalava actions.
+ 907ecd3:
Add new metalava flags to the metalava flagparser.
+ 1bef273:
Merge "Add file specified by -Wl,--out-implib as an output for link actions"
+ 4b9d944:
Convert shallowFallback to a configuration in reproxy
+ 405f716:
Merge "Add label-digest as well to command-id"
+ c74bf70:
Exclude metalava sourcepath from inputs and make it a virtual directory instead.
+ 6892cfa:
Add label-digest as well to command-id
+ 9a3b8ef:
Merge "Include rsp file(s) as explicit inputs if passed explicitly to rewrapper."
+ 5830ee1:
Add stat for local execution queuing time
+ 3bce8a5:
Add 'fprofile-sample-use' to the list of arguments to make absolute paths before passing to clang-scan-deps.
+ 4ec62be:
Update bazel version to 3.1.0.
+ 715602d:
Add file specified by -Wl,--out-implib as an output for link actions
+ fbc78f7:
Fix post-submits for bazelisk change.
+ c94dc5f:
Update clang plugin custom rule to pass tags to its actions.
+ 660ef01:
Merge "Change CI to use bazlisk, add new Docker image."
+ 9b15ee8:
Fix continuous android integration tests
+ a8c2ed5:
Change CI to use bazlisk, add new Docker image.
+ 5b837e8:
Include rsp file(s) as explicit inputs if passed explicitly to rewrapper.
This release includes a number of fixes to:
Changes:
+ d52f0b7:
Remove un-needed chdir and fix integration tests
+ 34c2872:
Remove -debug-info-kind flag in clang-scan-deps.
+ 0e25698:
Fix how we invoke clang++ binary to find resource directory
+ 94f70cf:
Add an rsp package for centralizing rsp file parsing.
This release primarily contains bug fixes to C++ input processor and rsp file parsing.
Changes:
+ 09a5526:
Also cache when we fail to find the resource-directory
This release fixes input processor latency for header-abi-dumper actions.
Changes:
+ 5b29aa6:
Fix compare mode for actions where some inputs are also outputs.
+ 9c31e0d:
Add .toc files as additional dependencies
+ 667c5e1:
Supporting remote execution of header ABI dump actions
+ 625fc40:
Add more details on how to build the code and run tests, and how to contribute.
+ 99426b0:
Add support for Bazelisk and pin to Bazel 2.2.0.
This release adds support for remote execution of header ABI dumper and adds a fix for compare mode of metalava actions.
Changes:
+ b2836e1:
Add output_directories and multiple rsp files flags to rewrapper.
+ 4559f40:
Log flags in rewrapper after parsing.
+ 8afef4a:
Removing flags logging from rewrapper, making it verbosity 1
+ b7447ea:
Use LOG_DIR variable in android integration tests.
+ 74ec9b9:
Add support in reproxy for link actions
This release adds support for linking, explicit output directories, and multiple input file lists. Also includes logging fixes.
Changes:
+ 3be02a4:
Fix metalava input processor.
+ 7c66991:
Add common config file with artifact definitions for log files.
+ c2a1d10:
Local execution to support non-uniform resource requirements. Bug: b/151818457
+ 000cd94:
Cache metalava version to avoid running metalava multiple times.
+ 9615ed6:
Refactor toolchain input processor and support version checks.
+ 0a5b462:
Add a metalava flag parser.
+ 13dc031:
Remove support for async artifact upload in LERC.
+ b5d8485:
Failure in the input processor should fallback to local execution.
+ 751faad:
Using SDK command proto (latest SDK commit)
+ 836d908:
Logging improvements: log all flags from all binaries, log server address on failed dial
+ 3e20ddd:
Add remote_disabled mode to reproxy.
This release mainly adds metalava support to reproxy.
Changes:
+ 0bd4e59:
Add scripts to do global setup of RBE variables to android developers
+ 3ff26d6:
Add reproxy support for cache-silo key
+ 614329a:
Dont clean command args by default
This release makes reproxy support cache silo key and does not clean arguments for remote execution to prevent bootloops on output images.
Changes:
+ 250a753:
Fix unnecessary deps validation when deep input processor succeeds.
+ 061b94c:
Add the gcno file to the output spec if --coverage is passed to clang
This release has fixes for downloading coverage file generated as part of clang compiles and fixes LERC to NOT do un-necessary dependency validation.
Changes:
+ 9d89a75:
Updated the clang flag parser to handle more general clang commands.
+ a9eddb0:
Document that --toolchain_inputs is relative to the exec root.
+ 628a60a:
Handle -B flag and add it as a dependency.
+ bd7abce:
Bump SDK version to include fix for batch download of blobs.
+ a792271:
Modify create-release script to drop CHANGELOG.md to test/ folder
This release has fixes with respect to C++ input processor and bumps RE-SDK version to include fix for batch blob downloads.
Changes:
+ e140d51:
Replace moreflag with rbeflag in the version package.
+ 290e433:
Upgrade sdk to include batch upload size fix.
+ 415cb83:
Enforce all returned paths from input processor are under exec root.
+ 80fb1b3:
Remove the -fintegrated-cc1 flag when doing clang-scan-deps.
+ 6d0e3f1:
Remove changelog from prebuilt-drop tool invocation
This release fixes a bug in reading RBE flags and includes input processor refactorings and fixes for supporting the nest/chrome builds.
Changes:
+ f4fae4d:
Pass vargs to clang-scan-deps instead of combined string
+ 1ff5530:
Remove the invalidation check in dependency scanner plugin
This release changes scan-deps interface so that it takes an unescaped list of arguments instead of a JSON database string.
Changes:
+ 9bdf5ca:
Support toolchain_inputs flag for explicitly specifying toolchain
+ 4f47570:
Handle -fsanitize-blacklist and -fprofile-sample-use similar to fprofile-use
+ b29d7a3:
Change default execution strategy to undefined
+ 52cb208:
Fix broken javac integ test.
+ 17cd328:
rbeflag package allows setting flags with RBE_ prefixed env vars.
+ faf5c1e:
Remove workaround to not delete inputs under output directories in compare mode.
+ 6abae0d:
Add escaping for spaces on clang build command.
+ 09f5abf:
toolchain: toolchain executable is workdir relative
+ 7179410:
Fixing tool commands to process inputs shallow
+ bf15e5b:
Adding ability to parse logs from multiple files, and save to separate files.
This release contains support for the toolchain_inputs flag and other fixes.
Changes:
+ cc4b9cf:
Fix log messages missing printing the error.
This release fixes missing error logs in removal of output directories in compare mode.
Changes:
+ 2ae2a7f:
Prevent deletion of inputs under output directories in compare mode.
+ 8365bbf:
Added strings replacer to properly encode quotation marks on created.
+ c8b2db9:
Change updated flags instead of actual flags.
+ 453eceb:
Added a feature to enable/disable the use of the toolchain input file.
+ f8f49b9:
Support remote execution of javac/r8/d8.
+ ee5e60c:
Propagate RBE_HTTP_PROXY value to reproxy, if set.
+ 7761b78:
Add a debug helper function for dumping inputs to a tmp directory.
+ 587f2d4:
Add working directory to the joined path of the .keep_me file.
+ 0284950:
Add a feature to enable/disable the command argument cleaning. Default is enabled.
This release fixes a breakage in D8 compare builds due to having inputs under output directories.
Changes:
+ 7af0844
Fix mismatch in ab/6089871 due to missing dependency on the --system dir.
+ 4cf6a50
Update Android internal image to 2020-01-22 snapshot.
+ 6d08ef5
Merge toolchain inputs in returned results in case of shallow fallback
+ 86630ca
Fix segmentation fault when both toolchain and clangscandeps fail
+ 5c040c2
Add javac LERC integration test.
+ fd852e5
Add feature to enable in band update of action results to test
whether it has an impact on performance.
+ 59f7155
Fix crash in stat logging when accept-cached is false
+ f4a59aa
Fix the paths returned by toolchain input processor
+ 0132e03
Add -Qunused-arguments parameter to scan-deps invocation to suppress warnings
This release adds a feature to enable synchronous upload of cached results in LERC mode and has a couple of bug-fixes for remote-execution flow.
Changes:
+ edfbaae:
Remove -verify flag before calling clang-scan-deps
+ 4930837:
Revert "Merge "Optimize the dependency scanner plugin to reuse workers""
This release reverts the clang-scan-deps optimization since we discovered a bug in clang-scan-deps caching behaviour when workers are reused.
Changes:
+ bfee822:
Fix occasional failure in Javac/R8/D8 compare builds
+ 6a54076:
Remote execution integration test for re-client
+ 3cefecc:
Optimize the dependency scanner plugin to reuse workers
+ a172d20:
Aggregating stats per label.
+ 31fbea5:
Use a random socket file in integration tests
+ 98f775a:
Per proxy invocation ID.
+ fd4a213:
Make rewrapper block until it can dial to reproxy.
+ 2b43cf9:
Part 2 of renaming continuous_android tests to continuous_android_lerc
+ b5ced78:
Updated scripts/install to run on mac as well as linux.
+ e15143f:
Updated cgo directives to selectively pick certain libraries.
+ 900dbff:
Update the dep scanning build script to run on macos as well as linux.
+ d9b6602:
Update the cpp dependency scanner integration test to explicitly
+ f5eac3c:
Update .gitignore file to ignore MacOS .DS_Store files.
+ 53b2fe8:
Add virtual inputs for all -I and -isystem dir paths
This release includes a potential fix for the flaky resource exhaustion issue as well as an optimization for the clang-scan-deps plugin.
Changes:
+ ea1b2a1:
Wireup the new toolchain input processor as part of ProcessInputs fn
+ f0ae7a8:
Script to test application default creds on Android corp buildbots
This release adds a feature to search for “remote_toolchain_inputs” file that lives alongside LLVM toolchains in Android to specify the list of files that constitute toolchain inputs.
Changes:
+ 41c7b59:
Update remote-apis-sdks commit to include the GRPC fix in SDK
+ bd18b14:
Prevent failure to load clang-scan-deps from failing actions.
This release primarily fixes the GRPC max concurrent streams issue in the SDK and goes back to using full input processor as default.
Changes:
+ d3de0ae:
Make shallow input processing the default.
+ 8ded0c8:
Fix for flakiness in logger that potentially caused b/146229435.
+ 25dab52:
Add clang-scan-deps to LERC.
+ 8e55b12:
Add verification mode to runRemote.
Changes:
+ 6882689:
Compare mode for actions with output directories.
+ 08499f0:
Add flag to enable shadow header detection.
+ 709061a:
Switching SDK to latest commit (retries)
+ 04eb160:
Add a tool action type to run any tool with the inputs/outputs
+ f6cc51b:
Add reproxy version number as a cache silo to all actions.
+ 0519b5b:
Move flags structs to a separate package: pkg/flags.
+ c16f9c8:
Simplify the signature of ProcessInputsShallow.
+ 1165068:
Fix flaky test due to non-deterministic order of include directories.
+ 4ff0a4b:
Optimize shadow headers performance.
+ 04223fe:
Refactor runLERC code to follow go readability guidelines.
+ 4087961:
Switching to latest SDK version
+ be22f0b:
Add documentation about the dependency scanner plugin
+ 996339d:
Change V(2) log to warning log when RE fails and we fallback to local
+ 689c6cb:
Update foundry-vars.sh to the correct instance name.
+ d8bcce5:
Make rewrapper retries less aggresssive and increase max retry duration
+ 356debf:
Fixing stats aggregation bug.
+ 222117f:
Pass rewrapper start time to reproxy for logging and aggregation.
+ b6b1478:
Restrict input processor parallelism to num CPU cores
+ 7b54918:
Adding include processor timing stats.
+ fe28910:
Adding end-to-end timing stats, minor refactoring
+ 9c1afd7:
Adding local execution timing stats to the proxy
+ 2cac73d:
Rename rbe_metrics file to rbe_metrics.txt
+ 82edf55:
Adding LERC deps timing metadata
+ 50d62ad:
Add dependency scanner plugin to the release script
This release adds local performance metrics and shadow header detection as an off by default feature.
Changes:
+ da676b7:
Statically link libstdc++ with the Go plugin to avoid
libstdc++ version issues on Android buildbot.
This release addresses libstdc++ loading issue on dependency scanner plugin.
Changes:
+ 7a4cc47:
Don't fail reproxy when loading of dependency scanner plugin fails.
+ efea8bf:
Add a temporary workaround suggested in rules_go to fix issue
with version number stamping.
This release makes reproxy not fail when it cannot load CPP dependency scanner plugin.
Changes:
+ 05875af:
Add dependency_scanner_go_plugin.so to Kokoro regex too
This release makes the Kokoro workflow also upload dependency scanner plugin.
Changes:
+ 2904c9d:
Implementing LERC with include directories awareness for constructing
dependency file.
+ 2c7f757:
Migrating to latest dependency versions and Bazel 1.1.
+ cc8cc63:
Wire up clang-scan-deps to input processor.
+ 13374fc:
Adding output metrics and digests to proxy log and stats.
+ a46e81f:
Support rsp files for javac compiles.
This release mainly adds dependency scanner plugin to support remote execution for C++ compile actions.
Changes:
+ ba1466e:
Add flag to control bootstrap timeout
+ 55d0ad6:
Keep track of RBE tool version in Dremel
+ 3839b37:
Renaming Dial to NewClient for clarity
This release mainly adds RBE tool version number to dumpstats.