Thanks for the tips. I think I managed to pinpoint it. Before I had Cloudflare with their own SSL feature so my browsers cached the 301 from cloudflare.
Because the https was on cloudflare and my own server was still using http. Clearing the cache completely from the browser (a hard reload doesn’t work) did the trick. Thanks again for your article.