[Quality] Readability improvements in value estimation

[itwasabhi]

Description

Describe your changes in detail.

Motivation and Context

• I have raised an issue to propose this change (required for new features and bug fixes)

Types of changes

Readability

Checklist

Go over all the following points, and put an x in all the boxes that apply.
If you are unsure about any of these, don't hesitate to ask. We are here to help!

• I have read the CONTRIBUTION guide (required)
• My change requires a change to the documentation.
• I have updated the tests accordingly (required for a bug fix or a new feature).
• I have updated the documentation accordingly.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3088

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• linux.aws.h100.8 instance is down, potentially longer queue on linux.aws.h100

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[vmoens]

LGTM thanks