[WIP] Ray Data + Ray Train tutorial

[crypdick]

Adds a new tutorial showcasing streaming data loading using Ray Data with Ray Train. Will move out of draft once I get reviews from the Data and Train teams.

cc @pcmoritz @robertnishihara @matthewdeng @richardliaw @akshay-anyscale

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/tutorials/3763

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Cancelled Job

As of commit d8b40fb with merge base 6e608db ():

NEW FAILURE - The following job has failed:

• Lintrunner / lintrunner (gh)
  >>> Lint for beginner_source/distributed_training_with_ray_tutorial.py:

CANCELLED JOB - The following job was cancelled. Please retry:

• Build tutorials / build / pytorch_tutorial_build_worker (12, 15, linux.g5.4xlarge.nvidia.gpu) (gh)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[crypdick]

debating whether I should slim this section down, given that I'm not checkpointing in the tutorial

[justinvyu]

Let's remove this section and point to the checkpointing user guide in Ray Docs. That way we can direct people to new features and avoid showing outdated apis (ex: the TorchTrainer.restore() API is deprecated).

[crypdick]

Makes sense @justinvyu . I rewrote it without code, but kept the section because I wanted to discuss some of the nice checkpointing features. Lmk what you think.

[justinvyu]

Let's remove this section and point to the checkpointing user guide in Ray Docs. That way we can direct people to new features and avoid showing outdated apis (ex: the TorchTrainer.restore() API is deprecated).