feat(Petals): Add support to Petals

[Aisuko]

https://github.com/bigscience-workshop/petals

[localai-bot]

⚠️⚠️⚠️⚠️⚠️

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

but.... I can also be funny or helpful 😸 and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me,
I don't support (yet) replying!

⚠️⚠️⚠️⚠️⚠️

I'm sorry, I don't understand the issue you are referring to. Could you please provide more context or clarify the problem?

Sources:

• https://localai.io/howtos/easy-request-openai/index.html
• https://localai.io/howtos/easy-setup-docker-cpu/index.html
• https://localai.io/model-compatibility/llama-cpp/index.html
• https://localai.io/integrations/kairos/index.html

[Aisuko]

It needs specific version of CUDA which I do not have. So, maybe hold on.

[tibrezus]

This is huge as it would enable the use of biggest models deployed on community swarms using inexpensive hardware.
I think this is a critical milestone in democratizing AI.