Memory Issue when testing splice

[cloudwego]

Memory Issue when testing splice

[Hchenn]

From the flame graph provided, the memory usage mainly comes from two parts:

1. netpoll(*connection).init:
   1. indicates that a lot of connections are Accepted and maintained, not closed.
   2. If so, the memory performance may be normal.
2. netpoll(*LinkBuffer).growth:
   1. indicates that the memory is growing. Please confirm whether you have actively called Release to release the memory. for example
   2. If you have done so, the memory performance may be normal.

[da-tai]

My code looks like this

var eventLoop netpoll.EventLoop

func handler(ctx context.Context, conn netpoll.Connection) error {

    data, err := conn.Reader().ReadBinary(conn.Reader().Len())
        if err != nil {
		logging...
		return conn.Close()
	}
    ....business logic......
     conn.Reader().Release()
     remote := net.Dial(remote server)
     go func () {
         _, err := io.Copy(remote,conn)
      }
      io.Copy(conn,remote)
}

What I am noticing is on a specific VPS provider, I get the memory issue but on another, i don't.
Here is the flame graph of another.

[Hchenn]

PS: The first graph is abbreviated as Fig 1, the second as Fig 2

I found that in the two graphs, the difference lies in the proportion of netpoll(*LinkBuffer).growth
The handleTCPProxy in Fig 2 is inlined but not in Fig 1. Is there a difference here ?

Sorry for not finding other useful help.

[da-tai]

This is helpful thanks. I will reopen this issue if I find something more defined.

Thanks again.