How to estimate the materialized model size
When we heard about Large Language Models, we always hear about the parameter size of the model. E.g. GPT-3.5 has 175 billion parameters, Deepseek R-1 has 671 billion parameters and GPT-4 is rumored to even have 1.8 trillion parameters. What exactly does that mean? A fundamental knowledge is, for most part, the model is composed of the model’s parameters (often called weights and biases). Each parameter is a numerical value that the model learned during training and the precision of these numbers dictates how much space they occupy. ...
Clipboard Issue with Tmux on Remote Server
Clipboard Issue with Tmux on Remote Server Recently I discovered a fix for the clipboard issue that bother me for years. And I want to log it here. For context, my development flow is always: remote ssh to my workstation start/attach to a tmux session sometimes open neovim to do some editing work. Occasionally, I need to copy large chunk of context from my terminal/neovim content in remote server, and then search or record it to my note using my laptop client. ...
My First Post
Hello, World! This is the content of my very first blog post. Welcome!