Any somewhat serious web app will not get its user data from a file, but from a repository like a DB or LDAP - in which case a password change should take effect right away.
Basic authentication credentials are generally cached by the browser, though, so you need to restart that.
If you open the box, you will find Heisenberg strangling Shrodenger's cat. And waving this tiny ad:
Gift giving made easy with the permaculture playing cards