Skip to content

Trouble Shooting

Memory Consuming Issue of Logging Lib

One of users reported he found the RPC logging interceptor consumes a lot of memory, so we checked the profiler first and then found the image below and the blabla is the underlying log library.

img.png

This blog records how to do troubleshooting this issue. However, as lacking more details, I handed over the issue to the log team for further checking.

Go Program Out of Memory

Last week, during on duty, one user reported his program exited silently without any useful information during deployment, the process is aborted with a killed information:

[1]    90616 killed     ./bin/server

This is an intrigue question as why the program is killed by OOM killer instead of a fatal stack overflow error.

Tar Wrapped by Cli Tool Fails to Write

Our internal CLI tool will try to download a proto file by git achieve command, and then tar it to /usr/local/include. One user reported in his desktop tar cannot unzip file:

xxx.proto: Can't create 'xxx.proto'
tar: Error exit delayed from previous errors.
ERROR fail to extract xxx.proto into '/usr/local/include/xxx.proto' 
via this script: 'tar -xf xxx.tar -C /usr/local/include'.