virtflex's Introduction
Virtflex is a multilayered system that allows the xen hypervisor to change guests NUMA topology dynamically and allows unmodified OpenMP applications running in the guests to adapt to topology changes automatically. The modified Xen-hypervisor is able to add or remove guest NUMA node through a combination of vCPU hotplug, superpage balloonning and guest memory migration. Once those changes are finished, the hypervisor notifies guests through xenstore. The guests then expose a proc file interface to allow userspace applications about this change. OpenMP runtimes are also modified to periodically poll on the proc file. Once OpenMP runtime notice there is a NUMA topology change, it re-distribute the running threads and issues an added syscall to request a reset of application memory. This syscall scan through the whole address space of the guest applcations and migrate application memory to the correct node. Virtflex provides enhancement across the xen-hypervisor, the Linux kernel and the gcc OpenMP runtime. This repo consists of the following parts: 1. The modified xen-hypervisor based on xen-4.11, 2. The modified Linux kernel based on Linux kernel 4.19 3. The modified openmp runtime based on gcc-7.3 4. Shell scripts for demonstration of Virtflex. The system is tested on a EPYC 7551p machine with 4 fully connected NUMA nodes. Virtflex's topology change is intiated with xenstore. There are target for different guest NUMA nodes in xenstore and there is one xenstore node that indicate whether the guest is undergoing topology changes or not. The guest_topo_change.sh script provided mainly manipulate xenstore to initiate topology changes to guests. guest_topo_change.sh will list the current running VMs and let the administrator choose the target VM and what action to take towards the target VM (expand or shrink VM's topology). Note that the domonstration requires vCPU pinning and the vCPU pinning exmaple on EPYC 7551P can be found in vcpu_pinning.sh in the script directory. The VM creation and configuration scripts can also be found in the script directory too.
virtflex's People
Forkers
sanyaade-teachingsRecommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.