You are correct. And programming Actors is much more powerful than EF :-)
I don’t have experience with Service Fabric personally, but you can run an Orleans solution on top of it, SF will provide fault tolerance. Use the the official Microsoft.Orleans.ServiceFabric package for this. It is also possible to use SF Reliable Actors, this provides the same programming model as Orleans, but it’s not maintained as actively and not as open and flexible. For an in-depth comparison between the two see this blog by Richard Astbury.