Skip to content

Commit fccb049

Browse files
authored
[docs] TP blog post (#42637)
blog link
1 parent 4ad279f commit fccb049

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/source/en/perf_infer_gpu_multi.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -306,3 +306,7 @@ The most important part of DTensor is the `placement` attribute because it tells
306306
```
307307

308308
- `Partial()` - Indicates a tensor is pending a reduction operation (not typically relevant for usage in Transformers).
309+
310+
## Resources
311+
312+
Read the [Tensor Parallelism (TP) in Transformers: 5 Minutes to Understand](https://huggingface.co/blog/qgallouedec/tp) blog post for a quick overview of tensor parallelism and learn how column and row parallel setups differ.

0 commit comments

Comments
 (0)