No, you don't need to remember your app passwords. Once you enter an app password into an application, the application will remember it for future use. If you lose an app password or think it may have been compromised, you can simply revoke it and create a new one.