feat(intel): add diffusers/transformers support - #1746

Merged

mudler merged 34 commits into

intel-gpu-support

Mar 7, 2024

Commits on Mar 6, 2024

feat(intel): add diffusers support
mudler
committed
50e23dd
try to consume upstream container image
mudler
committed
a544b8f
Debug
mudler
committed
67865aa
Manually install deps
mudler
committed
0c23fba
Map transformers/hf cache dir to modelpath if not specified
mudler
committed
7115277
fix(compel): update initialization, pass by all gRPC options
mudler
committed
e5fdcbe
fix: add dependencies, implement transformers for xpu
mudler
committed
465b029
base it from the oneapi image
mudler
committed
94789f5
Add pillow
mudler
committed
9aacbc7
set threads if specified when launching the API
mudler
committed
3878eda
Skip conda install if intel
mudler
committed
70880fc
defaults to non-intel
mudler
committed
3dfb665
ci: add to pipelines
mudler
committed
373ddd2
prepare compel only if enabled
mudler
committed
8dc6669
Skip conda install if intel
mudler
committed
2a2b4f6
fix cleanup
mudler
committed
8cabe0d
Disable compel by default
mudler
committed
8010e90
Install torch 2.1.0 with Intel
mudler
committed
aa5acfc
Skip conda on some setups
mudler
committed
09c8822
Detect python
mudler
committed
96c5fd4
Quiet output
mudler
committed
1bd4e66
Do not override system python with conda
mudler
committed
364e36e
Prefer python3
mudler
committed
5c9fa5d
Fixups
mudler
committed
2353708
exllama2: do not install without conda (overrides pytorch version)
mudler
committed
a044a18
exllama/exllama2: do not install if not using cuda
mudler
committed
293be13
Add missing dataset dependency
mudler
committed
72d1cd2
Small fixups, symlink to python, add requirements
mudler
committed
0e32ba0
Add neural_speed to the deps
mudler
committed
dc8ae92
correctly handle model offloading
mudler
committed
7f7cd68
fix: device_map == xpu
mudler
committed
f0bcfba

Commits on Mar 7, 2024

go back at calling python, fixed at dockerfile level
mudler
committed
2ee4fd2
Exllama2 restricted to only nvidia gpus
mudler
committed
9ff1cf8
Tokenizer to xpu
mudler
committed
95fb025