Comments (11)
Hi @KaiWalter was out for a few days to repower. I have only partially repowered. :-| But YES, the objective will be to have a containerd-based integration into k8s. There are several reasons.
- customers who need a scale-out, non-proprietary control plane have by and large standardized on k8s. As a result, to reach both hyperscale and periphery compute environments k8s will be the primary early control plane that all can use in either proprietary services or connected oss.
- You should expect that early services, then, use the k8s host. But as understanding increases, other "schedulers" will be not only welcomed but sought out. Fermyon is touting Hashicorp's Nomad; in Azure, you can imagine several other orchestrators or schedulers; in oss, we know of several customers researching running real time oses that schedule wasm functions because they do not have container infra.
- containerd seems like it's for k8s but it really isn't: it's a generic process-starting system that can be integrated easily elsewhere. As example one, docker supports
docker run --runtime=io.containerd.wasmtime.v1
now and more direct work will arrive.
from spiderlightning.
Nonetheless, I also expect that standalone hosts like slight or spin or wasmcloud (which is its own orchestrator I note) will be popular in all areas in which k3s makes no sense as a control plane. As they should be.
from spiderlightning.
~check out slight (previously, wasi-cloud
) running on a PinePhone:
video link: https://user-images.githubusercontent.com/39843321/186492047-68cf490b-1629-4113-a6dc-bb8f01bc8304.mp4
P.S. might have to click on it to zoom in or view video
from spiderlightning.
@danbugs what exactly would you like to achieve with this issue? Is it just containerizing one slight
workload like in https://github.com/KaiWalter/spiderlightning/blob/hosting-service-fabric/cluster/cluster-test/Dockerfile)?
from spiderlightning.
Hey, @KaiWalter ~ Thank you for your question. I definitely should gone back and included descriptions to issues like this once we open sourced.
That said, this issue will most likely be a contribution to:
- this (https://github.com/Mossaka/containerd-wasm-shims), and, maybe,
- this (https://github.com/deislabs/runwasi).
Are you familiar with Fermyon's Spin? If you check the containerd-wasm-shims repo, you'll see we've got a shim for it that helps serve a containerized Spin app. We hope to do something similar for Slight. I hope this clarifies the scope of the issue — let me know if it doesn't!
from spiderlightning.
Hi @danbugs, I see. That was actually, what I was talking about with @squillace 2 weeks ago: "get WASM/WASI workloads running in cluster or other environments without using OCI containers". For the moment I have to admit, that the repos you listed above are technically somewhat out of my league. So don't wait for me, please.
Anyway as I want to use my vacation time for building up some Rust muscle I will definitely munch into those.
from spiderlightning.
@danbugs - After I figured out how runwasi is working, I can imagine to get slight
and a module WebAssembly packaged up with a containerd-shim approach. But still using docker buildx
to build the image.
@squillace - But then why? Why go to all the length to patch WebAssembly execution into containerd ecosystem? Just to then make it easier to hook it up with K8S based hosting? Wouldn't just aiming for a clustered process orchestrator like Service Fabric be the simpler approach here?
I did some preliminary tests and the only shortfall I currently see is, that SF up till now only supports Ubuntu up to 20.04 which makes patching some of the slight dependencies into the nodes somewhat hard. If we could get support for 22.04 nodes, that should be far more easier.
from spiderlightning.
@squillace thanks for the explanation - got it. This is fascinating stuff. You know I've not been doing kind of "systems programming" since early 90ies. This really strikes a chord. I will be off the grid for a few days - also unwinding a bit. I'd really like to contribute. Do you perhaps run a more tactical forum like Discord, Gitter, ...? Also Teams/microsoft.com tenant would work for me.
from spiderlightning.
Wait, @KaiWalter, you're on vacation but you want "tactical"? :-P
For work with slight, just post issues! everyone can see and learn, which is an advantage. For more focused issues, mail me at ralph.squillace@ .com and we'll set something up to make the vacation fun.
from spiderlightning.
@squillace I need this to unwind - https://twitter.com/ancientitguy/status/1560892996991782913 - with all those heavy duty enterprise projects I usually do, where technological challenges are easily trivialized by the complexities on organization, process or social level.
from spiderlightning.
Closed this issue as we move containerd related issues to https://github.com/deislabs/containerd-wasm-shims
from spiderlightning.
Related Issues (20)
- slight run with 0 capabilities HOT 2
- Create a builder for the WasiCtx specific to slight
- Expose wasmtime configs through slight CLI
- Template: Extend it to include more capabilities HOT 4
- Instrument `slight` to visualize telemetry data/traces
- `slight-runtime`: should be able to take preopen from slightfile
- installation fails on v0.4.1 in wsl (ubuntu 20.04) with "`GLIBC_2.32' not found (required by slight)" HOT 1
- slight.exe doesn't run on WS2019 or WS2022 due to missing dlls HOT 5
- can't install "sudo apt-add-repository ppa:mosquitto-dev/mosquitto-ppa" per `make install-deps"
- [ux] slight's version command is either long or LARGE V HOT 1
- "make build-c" fails to build sample apps HOT 3
- Add DAPR keyvalue implementor
- Running in Dev Container on Apple M1 fails: ERROR [dev_container_auto_added_stage_label 4/4] RUN bash ./setup.sh HOT 3
- Slight v0.5.1 version shows 0.5.0 HOT 1
- The install.ps1 fails (dependency issues), 'Update-SessionEnvironment' is not recognized with/without Chocolately, able to install, not able to get it to output [fixed, but needs docs or better way to check this before or during runtime at script run or source) HOT 3
- Implement a better install routine to handle required runtime dependencies of windows in install.ps1 for slight.exe HOT 1
- chore: bump wasmtime to 10
- Expose fetch's Response class to JavaScript land HOT 2
- `make run-c` not working
- [Windows] Slight.exe wont run due to missing libcrypto-1_1-x64.dll
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spiderlightning.