Comments (5)
The same fix was applied to my (currently unmaintained) fork here and here so I can confirm it fixes this particular issue, however there are other Windows issues and just to note constants have a ~2GB limit on Windows.
from aitemplate.
Hmm, seems this line wasn't hit in your case:
The existing Windows support was contributed and maintained by one of our ex-colleagues. We don't support Windows officially. Any Windows-related patches are very welcome! Thanks.
from aitemplate.
--- a/python/aitemplate/backend/codegen.py
+++ b/python/aitemplate/backend/codegen.py
@@ -49,7 +49,7 @@ from aitemplate.utils.environ import (
multistream_mode,
)
from aitemplate.utils.graph_utils import split_simple_multistream_parallel_ops
-from aitemplate.utils.misc import is_debug
+from aitemplate.utils.misc import is_debug, is_windows
# pylint: disable=C0103,W0613,C0301
@@ -1095,8 +1095,7 @@ class ModelContainerGenerator:
set_up_constant_folding_inputs="\n".join(
self.set_up_constant_folding_inputs
),
- # # todo: enable once this feature is fully available
- # is_windows=is_windows(),
+ is_windows=is_windows(),
)
result[model_container_src_fname] = model_container_base_src
return result
--- a/python/aitemplate/backend/main_templates.py
+++ b/python/aitemplate/backend/main_templates.py
@@ -322,13 +322,13 @@ MODEL_CONTAINER_TEMPLATE = jinja2.Template(
#include "model_container.h"
#include "owned_constants.h"
-namespace ait {
-namespace {
-
{% if is_windows %}
#include "windll.h"
{% endif %}
+namespace ait {
+namespace {
+
// Contains the metadata for each constant.
constexpr std::array<ConstantInfo, {{ num_constants }}> owned_constants = {
{{ owned_constants_init }}
from aitemplate.
Thanks for the investigation and sharing the patch, @hlky ! Given the comment left by the original author of windows support, "todo: enable once this feature is fully available", I am quite hesitant to apply it to the main branch, because we don't have any test coverage nor any one is actively working on Windows support.
@joye I think you might want to try the patch shared by @hlky and see if it would work for you. Thanks!
from aitemplate.
Thanks @hlky, this patch can work in my side.
from aitemplate.
Related Issues (20)
- fx2ait install error -- c10::StorageImpl has no member named mutable_data HOT 1
- AIT seems not able to achieve max along a given dim HOT 9
- complie controlnet error HOT 2
- Stable Diffusion (GLIGEN) Download Error HOT 4
- Building rocm docker image is very slow. Is there a prebuilt docker image? HOT 1
- error during inferencing: Error: Constant embeddings_token_embedding_weight was not set! Set the value with set_constant. HOT 2
- Failed to compile the controlnet: thepowefuldeez/sd21-controlnet-canny HOT 1
- gemm_gen_profiler() takes 3 positional arguments but 4 were given HOT 2
- <class 'src.pipeline_stable_diffusion_ait.StableDiffusionAITPipeline'> is incorrectly implemented. Expected {'feature_extractor', 'scheduler', 'tokenizer', 'text_encoder', 'safety_checker', 'unet', 'vae'} to be defined HOT 3
- `Fatal Python error: Floating point exception` with `run_with_tensors` HOT 3
- gcc: internal compiler error HOT 2
- `Unsupported workload for this conv2d specialization` when using dynamic shape together with permute HOT 6
- Does AIT handle if/else in forward function? HOT 1
- multi-gpu at runtime error HOT 4
- Model is successfully compiled, but OOM when loading
- Does Concatenate order matters? HOT 1
- Docker image fails to build due to python dependency issue HOT 2
- Got cutlass error: Error Internal at: 214 HOT 1
- model_interface.cu:231: Error: Constant pretrained_model_patch_embed_proj_weight was not set! Set the value with set_constant. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aitemplate.