`IdentVisitor` and `GraphvizVisitor` pull statistics even when not requested

[vrongmeal]

Describe the bug

See:

https://github.com/apache/arrow-datafusion/blob/95ba48bd2291dd5c303bdaf88cbb55c79d395930/datafusion/physical-plan/src/display.rs#L263-L266

https://github.com/apache/arrow-datafusion/blob/95ba48bd2291dd5c303bdaf88cbb55c79d395930/datafusion/physical-plan/src/display.rs#L344-L349

They shouldn't be pulled unless requested. Many implementations are simply todo! or error in certain circumstances but need them to work.

To Reproduce

No response

Expected behavior

No response

Additional context

No response