Support SHOW ALL VERBOSE to show settings description

[comphead]

Which issue does this PR close?

Closes #7736 .

Rationale for this change

Expand SHOW ALL stmt to show settings description. Currently it requires going through the code to find the description for the specific datafusion setting, moreover code covered by macros which makes harder to understand the full setting name.

What changes are included in this PR?

The PR is to add settings description to the SHOW ALL output

+------------------------------------------------------------+---------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| name                                                       | value                     | description                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
+------------------------------------------------------------+---------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| datafusion.catalog.create_default_catalog_and_schema       | true                      | Whether the default catalog and schema should be created automatically.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
| datafusion.catalog.default_catalog                         | datafusion                | The default catalog name - this impacts what SQL queries use if not specified                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| datafusion.catalog.default_schema                          | public                    | The default schema name - this impacts what SQL queries use if not specified                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
| datafusion.catalog.format                                  |                           | Type of `TableProvider` to use when loading `default` schema                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
| datafusion.catalog.has_header                              | false                     | If the file has a header   

Are these changes tested?

Yes

Are there any user-facing changes?

Yes, the SHOW ALL output have extra description column and confusing settings column name was renamed to value

[alamb]

Thank you @comphead -- I really like that the descriptions are now included.

I think the change to make it possible to select all the settings directly from df_settings is great 💯

select * from information_schema.df_settings

As you mention, I am not so sure about including the description in SHOW <name> and SHOW ALL as it makes the output much more verbose.

I think it would be a nicer experience if SHOW ALL kept the current behavior and we extended SHOW ALL VERBOSE and SHOW <value> VERBOSE that added the description too.

I checked and this appears to be supported by the parser so we could probably make this work without waiting on an upstream change

❯ show all verbose;
0 rows in set. Query took 0.002 seconds.

What do you think?

[comphead]

@alamb thanks. My concern with the first sentence as the developer who introducing the new param is not aware about concise first sentence requirements and this will still eventually lead to the wide output.

Having another verbose pair makes much more sense for me.

SHOW ALL VERBOSE
SHOW value VERBOSE

[alamb]

Having another verbose pair makes much more sense for me.

I agree

[comphead]

Having another verbose pair makes much more sense for me.

I agree

Added SHOW ALL VERBOSE, SHOW param VERBOSE support.
User doc updated

[alamb]

Looks really nice to me -- thank you @comphead

[alamb]

🥇

[alamb]

I like this change in column name 👍

[alamb]

cc @waitingkuo

[alamb]

Thanks again @comphead -- this is a really nice contribution