You cannot tell whether the universe indeed is presenting itself ordered or chaotic, for we have no chance to find that out, ultimately.
But we can tell. At least to the extent that we recognize the order of the universe in accordance to the order our pattern-seeking nature has discovered. There will always be unknowns, thank the heavens for that, but we need, for our basic survival, order in the model of the universe we build in our mind. We can't escape this, so trying to argue otherwise is fruitless. Recognizing faces is something we're very good at, it's simply how we've evolved. Consequently we see face-patterns literally everywhere; our mind needs only two dots and a line to see a face. We see patterns in space and in time, we have no choice in the matter; the cadence of day and night, and of the seasons, are patterns essential to our survival. I hate the calendar and the clock, I feel restrained in my freedom by them, but on the other hand I'm fully aware of the fact that there's no possible way we would have evolved without them.
...this same pattern might be distorted or false...
That doesn't matter though. Like I said: we have no choice in the matter.
For one it's awesome and mind blowing, for the other it's not relevant and for the next one it's frightening.
Again: that doesn't matter. And what's more, I'd say that it's awesome, mind blowing and relevant for almost all of us. Without our pattern-seeking behavior we wouldn't have the wheel, engines or the computers we're currently using to have this conversation.
Your comparison to a library is on point. And I'll say this: the reader who is not in a hurry, does not look for something specifically but randomly, likes to have more than one experience at the time, likes to be surprised and must not read for the purpose of earning money or another given task or duty will also be just fine in a library that's ordered in a way that leads me efficiently to the material I'm specifically looking for. Just like I can choose to ignore the clock and calendar, this visitor of the library can choose to not mind the presented order.
Explanation, as I see it, is not an ultimate tool, either.
The brightest minds have dealt with the matter over the course of hundreds and thousands of years. Still, I think, we are lost in explanations.
I feel the opposite. Explanation is an ultimate tool. Not the only one, but one we sorely need. And I don't think we're lost in explanations, but in individualist fundamentalism. What we're lost in, is the idea that there's no such thing as universal truth, that there's only 7.5 billion individual truths; this kind of culminated in the Trump press-secretary talking about "alternative facts". And in millions embracing QAnon conspiracy theories as their personal truth. Now, don't get me wrong here and think that I'm not keeping open the possibility that we're all just brains in vats connected to a virtual-world creating machine. Maybe consciousness comes before tangible reality; we ultimately can not know, like you've said several times there will always be gaps, even in the patterns we're forced to recognize by our minds. But, and I'll repeat it, that doesn't matter because we have no choice but the accept the model of the universe as it is presented to us by our inner eyes. And we can rest assured in the knowledge that this model is one that has allowed us to survive and prosper for hundreds of thousands of years.
I've dug up an old post of mine from three years ago and reposted it yesterday; I believe that does a better job at explaining how I feel about the other side of this medal. Have a peek at it here if you're interested :-)