device_mpi_reduce.h File Reference

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Functions
void	device_mpi_allreduce (void *buf_d, void *buf, int count, size_t nbytes, int op)
void	device_mpi_allreduce_inplace (void *buf_d, int count, size_t nbytes, int op)

Function Documentation

device_mpi_allreduce()

void device_mpi_allreduce	(	void *	buf_d,
		void *	buf,
		int	count,
		size_t	nbytes,
		int	op
	)

C wrapper for MPI calls, until we integrate with NCCL/RCCL

device_mpi_allreduce_inplace()

void device_mpi_allreduce_inplace	(	void *	buf_d,
		int	count,
		size_t	nbytes,
		int	op
	)