Comments (4)
It mostly works, but there are a few patches and configuration steps needed:
- We are still in the process of splitting file vs directory artifacts, which is a requirement for the Bazel RE API.
- We use SHA1, which only BuildBarn supports.
- There is some configuration in the RE settings that needs passing which we currently hardcode to our internal API.
So we have done a small build using BuildBarn, and expect to have instructions on how to do real builds in the next month or so, but for the moment, it's probably infeasible to do so.
from buck2.
This should be mostly working, you can see some of the support for it here: https://github.com/facebookincubator/buck2/tree/main/remote_execution/oss
This is using the remote execution apis described here: https://github.com/bazelbuild/remote-apis/blob/main/build/bazel/remote/execution/v2/remote_execution.proto. AIUI, there are several open source implementations of the server components of that api (e.g. https://github.com/buildbarn/bb-remote-execution).
It doesn't look like there's an example or documentation yet about how to set that up in the open source release, but I think you can expect that that will be coming soon.
from buck2.
I can see an example here now https://github.com/facebook/buck2/tree/main/examples/remote_execution/engflow so I think the issue can be closed.
One thing I haven't figured out is how to just use a shared action cache without a remote executor. Running without engine_address
throws an error.
Jobs: In progress: 78. Finished: 42. Cache hits: 0%. Time elapsed: 2.2s
^ the Cache hits is always zero - I assume that's because there is no local cache?
from buck2.
Yep, the shared action cache currently requires the remote executor. We are looking at whether a local shared executor might be a good idea, e.g. #105
from buck2.
Related Issues (20)
- How do I depend on Buck2 targets from another project? HOT 11
- Building and running tests in a single command HOT 5
- [Docs] Comprehensive Getting Started Documentation HOT 4
- erlang_release: "failed to cleanup output directory" when setting `include_erts = True`
- Profiling dynamic analysis HOT 3
- `rust-project develop` using a whitelist for `env` overrides where it shouldn't
- Allow load to take variable string or functions that returns string HOT 1
- load starlark from target output HOT 7
- Option to include remote execution actions in chrome-trace
- Build source file owned by another BUILD file HOT 1
- Status of `compatible_with` and alternatives HOT 6
- How do I call a rule impl explicitly? HOT 1
- Per-PACKAGE transitions HOT 7
- Shadow prelude rules globally HOT 4
- compile_command.json write to root directory HOT 6
- Template variables for `cxx_genrule` do not work with `system_cxx_toolchain`
- Windows System Libraires HOT 4
- namespacing rules
- How to get an `artifact`'s parent directory? HOT 1
- Will Buck2 work with Sun Grid Engine for remote execution? HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from buck2.