Skip to content

GPU SSD nms op cause HalideIR assert fail #1532

@janboeye

Description

@janboeye

hi,

in cuda/nms.py line 117, sort_ir will xor int32 with bool type, this will reject by Halide IR and cause a assert fail.

                    with ib.if_scope(((data_new[i+start] < data_new[i+start+1]) ^
                                      is_descend) == False):

I do not understand why xor less-than result with bool is denied by IR @tqchen @Laurawly

/HalideIR/src/ir/IR.cpp:28: Check failed: t.bits() == 8 || t.bits() == 16 || t.bits() == 32 || t.bits() == 64 IntImm must be 8, 16, 32, or 64-bit

Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions