feat: migrate to PEP 621 and add uv support

[dhdaines]

Overview

The pyproject.toml was no longer valid, in particular because transformers==5.5.1 does not actually support Python 3.9. This means that though Poetry insisted on running poetry lock, that command would always fail.

Also, because it used Poetry-specific configuration, it was not usable with less broken build/package managers like uv and hatch. Now that Poetry supports the PEP 621 standard for metadata, it is possible to interoperate.

I have also add the proper configuration to use uv, so you can now simply do uv run llama-convert-hf-to-gguf from the root directory and it will Just Work (I hope!). Yes, you can do this with poetry run as well 😉

Probably fixes #21536

Requirements

• I have read and agree with the contributing guidelines
• AI usage disclosure: no AI was used whatsoever

[CISC]

Thanks, we're using poetry to publish the gguf package (see gguf-publish.yml), but no-one is maintaining the poetry artifacts any more.

In fact I think it is too much of a burden to maintain the lock files in general, if poetry does not require it I think it will be preferable to remove it (and uv.lock).

[dhdaines]

In fact I think it is too much of a burden to maintain the lock files in general, if poetry does not require it I think it will be preferable to remove it (and uv.lock).

I agree, I feel like lockfiles in anything other than a deployment situation are highly overrated... I can remove it from the PR.

[ggerganov]

What are the next steps here?

[CISC]

What are the next steps here?

It looks like poetry, the config and the dependencies need to be brought up-to-date and the lock files removed. This means we will no longer provide locked dependencies, but making sure we are updating them whenever we need to bump a dependency is too burdensome.

[danbev]

@CISC I've tried to address your comments above related to the dependencies and the lock files. I'm not sure what needs to be done for the config yet, but wondering if we could perhaps do this in a follow up PR, so that we could perhaps release gguf-py to pypi (#22664)?

[CISC]

Untested, let's hope this works. :)

[CISC]

This may also be the time to bump numpy, but we can leave that to a follow up.

[danbev]

I'm running some manual tests on macos, windows, and linux and ran into this issue #22753.
But cherry-picking that I can use poetry to convert:

• linux
• macos
• window