Download the desired .zip file for your platform. It is recommended you download the latest version of the game, as older versions may contain bugs or be missing features from the new,er versions. However, if you enjoy one of an older versions more, feel free to play it! Extract all the files from the .zip file, making sure all the files are in the same folder. The easiest way to do this on Windows is to right click the "BALDI_X.X.X_Windows.zip" file, select "Extract All..." and then click the "Extract" button on the window the pops up. This will put all the files in a new folder of the same name as the .zip file. Activate the game from this new folder, and feel free to move the folder wherever you want, so long as you don't move any files out of the folder.

Linux users, you may have to access the game's permissions and check "Allow executing file as program" to launch the game.