There’s one major problem with averages over time. After a few attempts to find workarounds, players tend to stay away from gameplay loops that they are unlikely to be able to complete. But you’ve probably already thought of that.
Yup, this is definitely one of the problems with using averages over time. Even from one build to another, an issue that’s a frequent offender on one PTU build might not be a top offender in the next release because players avoid the game systems that it’s affiliated with. I try to advocate to get as many stability issues fixed as possible because I want our players to have a stable game experience.
When we run into issues where our data isn’t able to help us properly prioritize data, we ask ourselves what we can do to improve that. For this specific example, one possible solution would be to create graphs that shows what kind of crashes players run into sorted by what kind of vehicle their using. We could do something like make a graph per profession so all the cargo ships on one graph, combat ships on another, mining ships on another. With data organized in this way, we would be able to have a fair idea of what crashes might be having an impact on specific types of gameplay.