🤩 WasmEdge is the easiest and fastest way to run LLMs on your own devices. 🤩
WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime. It is the fastest Wasm VM. WasmEdge is an official sandbox project hosted by the CNCF. LlamaEdge is an application framework built on top of WasmEdge to run GenAI models (e.g., LLM, speech-to-text, text-to-image, and TTS) across GPUs on servers, personal computers, and edge devices. Additional use cases include microservices on the edge cloud, serverless SaaS APIs, embedded functions, smart contracts, and smart devices.
Quick start guides
🚀 Install WasmEdge
👷🏻♂️ Build and contribute to WasmEdge
⌨️ Run a standalone Wasm program or a JavaScript program from CLI or Docker
🤖 Chat with an open source LLM via LlamaEdge
🔌 Embed a Wasm function in your Go, Rust, or C app
🛠 Manage and orchestrate Wasm runtimes using Kubernetes, data streaming frameworks, and blockchains
📚 Check out our official documentation
Introduction
The WasmEdge Runtime provides a well-defined execution sandbox for its contained WebAssembly bytecode program. The runtime offers isolation and protection for operating system resources (e.g., file system, sockets, environment variables, processes) and memory space. The most important use case for WasmEdge is to safely execute user-defined or community-contributed code as plug-ins in a software product (e.g., SaaS, software-defined vehicles, edge nodes, or even blockchain nodes). It enables third-party developers, vendors, suppliers, and community members to extend and customize the software product. Learn more here
Performance
- A Lightweight Design for High-performance Serverless Computing, published on IEEE Software, Jan 2021. https://arxiv.org/abs/2010.07115
- Performance Analysis for Arm vs. x86 CPUs in the Cloud, published on infoQ.com, Jan 2021. https://www.infoq.com/articles/arm-vs-x86-cloud-performance/
- WasmEdge is the fastest WebAssembly Runtime in Suborbital Reactr test suite, Dec 2021
Features
WasmEdge can run standard WebAssembly bytecode programs compiled from C/C++, Rust, Swift, AssemblyScript, or Kotlin source code. It runs JavaScript, including 3rd party ES6, CJS, and NPM modules, in a secure, fast, lightweight, portable, and containerized sandbox. It also supports mixing of those languages (e.g., to use Rust to implement a JavaScript API), the Fetch API, and Server-side Rendering (SSR) functions on edge servers.
WasmEdge supports all standard WebAssembly features and many proposed extensions. It also supports a number of extensions tailored for cloud-native and edge computing uses (e.g., the WasmEdge network sockets,Postgres and MySQL-based database driver, and the WasmEdge AI extension).
Learn more about technical highlights of WasmEdge.
Integrations and management
WasmEdge and its contained wasm program can be started from the CLI as a new process, or from an existing process. If started from an existing process (e.g., from a running Go or Rust program), WasmEdge will simply run inside the process as a function. Currently, WasmEdge is not yet thread-safe. In order to use WasmEdge in your own application or cloud-native frameworks, please refer to the guides below.
- Embed WasmEdge into a host application
- Orchestrate and manage WasmEdge instances using container tools
- Run a WasmEdge app as a Dapr microservice
Community
Contributing
We welcome contributions from the community! Please check out our:
- Contributing Guide for how to get started
- Governance documentation for project decision-making processes
- Code of Conduct for community standards
Want to become a maintainer? See our Contributor Ladder.
Roadmap
Check out our project roadmap to see the upcoming features and plans for WasmEdge.
Contact
If you have any questions, feel free to open a GitHub issue on a related project or to join the following channels:
- Mailing list: Send an email to WasmEdge@googlegroups.com
- Discord: Join the WasmEdge Discord server!
- Slack: Join the #WasmEdge channel on the CNCF Slack
- X (formerly Twitter): Follow @realwasmedge on X
Adopters
Check out our list of Adopters who are using WasmEdge in their projects.
Community Meeting
We host a monthly community meeting to showcase new features, demo new use cases, and a Q&A part. Everyone is welcome!
Time: The first Tuesday of each month at 11PM Hong Kong Time/ 7AM PST.
Public meeting agenda/notes | Zoom link
License
