George Stykalin 52b8680d95 Enable InfiniBand for TensorFlow distributed training ...

- Set NCCL IB env vars before TF import (IB_DISABLE=0, GPU Direct RDMA)
- Use NCCL_DEBUG_FILE approach for transport logging (same as PyTorch DAG)
- Add IB pre-flight diagnostics (dev/infiniband, sys/class/infiniband, ibv_devinfo)
- Add per-epoch logging with timing for all workers
- Add NCCL transport summary after training (NET/IB, GPU Direct, Channel info)

Co-Authored-By: Claude <noreply@anthropic.com>

2026-04-16 16:47:23 +03:00

..

connection-check-default.py

update graphs

2026-01-26 16:13:01 +03:00

connection-check.py

update dags

2026-01-26 15:49:45 +03:00

test-train-pytorch.py

Use NCCL_DEBUG_FILE for transport logging

2026-04-16 16:38:58 +03:00

test-train-tensorflow.py

Enable InfiniBand for TensorFlow distributed training

2026-04-16 16:47:23 +03:00

train.py

update dags

2026-04-15 12:10:19 +03:00