OOM when transfer big size file from minio to another minio

[wangs70]

OOM when transfer big size file from minio to another minio

[klauspost]

Yes. What part of the documentation is unclear?

	// ConcurrentStreamParts will create NumThreads buffers of PartSize bytes,
	// fill them serially and upload them in parallel.

[wangs70]

Thanks for your reply. we use it as comments, code as below, and i passed the file size to the function PutObject, but the function “putObjectMultipartStreamParallel” did not use this size and instead used '-1'. I am not sure if it cause the large memory usage. and how to use it.

putopt := minio.PutObjectOptions{
ConcurrentStreamParts: true,
NumThreads: uint(base.S3MinioDownloadConcurrency),
}

// add mime type
mime := CheckMimeType(filename)
if mime != "" {
putopt.ContentType = mime
}

	info, err := client.PutObject(context.Background(), bucket, path, reader, size, putopt)

[wangs70]

why the function “https://github.com/minio/minio-go/blob/6c2c69f9e8f50b2f65a337ec5e98044e9d558e79/api-put-object-streaming.go#L478” use '-1' as file size not real file size? @klauspost