You can make Sublime Text 4 behave like other programs by disabling “remember_workspace” setting.

Go to Preferences → Settings, which will open default settings in a left panel and customized settings in the right panel.
Add “remember_workspace”: false to the JSON file in the right panel. Sublime Text behaves normally now.