Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TensorRT Extension problem : Entry Point Not Found #157

Open
ccarmatic opened this issue Jun 21, 2024 · 0 comments
Open

TensorRT Extension problem : Entry Point Not Found #157

ccarmatic opened this issue Jun 21, 2024 · 0 comments

Comments

@ccarmatic
Copy link

ccarmatic commented Jun 21, 2024

CUDA 11.8, Python 3.10.14, Windows 11
Installed as per instructions:
pip3 install torch==2.1.0 torchvision==0.16.0 xformers --index-url https://download.pytorch.org/whl/cu118
pip install git+https://github.com/cumulo-autumn/StreamDiffusion.git@main#egg=streamdiffusion[tensorrt]
python -m streamdiffusion.tools.install-tensorrt

I have a Python script which contains:

import torch
from diffusers import AutoencoderTiny, StableDiffusionPipeline
from streamdiffusion import StreamDiffusion
from streamdiffusion.acceleration.tensorrt import accelerate_with_tensorrt
BATCH_SIZE = 1
WIDTH, HEIGHT = 512,512
TORCH_DEVICE  = 'cuda' # "cuda" if you have a cuda GPU
TORCH_DTYPE   = torch.float16

model_loc = "models/LCM_Dreamshaper_v7"
pipe = StableDiffusionPipeline.from_pretrained(model_loc).to(
    device=torch.device(TORCH_DEVICE),
    dtype=TORCH_DTYPE,
)
stream = StreamDiffusion(
    pipe,
    t_index_list=[32,45],
    torch_dtype=TORCH_DTYPE,
    frame_buffer_size=BATCH_SIZE,
    width=WIDTH,
    height=HEIGHT,
    do_add_noise=True,
    cfg_type='none'
)
stream = accelerate_with_tensorrt(
    stream, "engines", max_batch_size=BATCH_SIZE,
)

Running it results in this:
image
4 windows sequentially opening, about the following dll files:

cudnn_adv_infer64_8.dll
cudnn_adv_train64_8.dll
cudnn_cnn_infer64_8.dll
cudnn_cnn_train64_8.dll

@ccarmatic ccarmatic changed the title problem when installing tensorrt nvidia-cudnn-cu116 problem when installing tensorrt extension Jun 21, 2024
@ccarmatic ccarmatic changed the title nvidia-cudnn-cu116 problem when installing tensorrt extension Streamdiffusion TensorRT extension is not compatible with CUDA 12.1 Jun 22, 2024
@ccarmatic ccarmatic changed the title Streamdiffusion TensorRT extension is not compatible with CUDA 12.1 Entry Point Not Found Jun 23, 2024
@ccarmatic ccarmatic changed the title Entry Point Not Found TensorRT Extension problem : Entry Point Not Found Jun 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant