Attention masking for diffuser version

[zerolens-service]

Hello, I'm super glad you implmented ip-adapter for diffuser. However, i'm missing the Attention masking. Is there any way to add this to the diffuser version?

[cubiq]

I'll look into it when I have a moment