It could be an issue with the codecs (browsers are usually pretty limited in what they support). You could try to use a client like Jellyfin Media Player instead. It bundles libmpv, so it plays almost any video format there is.