After reading the comments I went back to the darkroom yesterday.
First thing I did is I cut a number of 5x7 papers in half, to get 3.5x5 (quite nonstandard) format. And it turns out this is actually important! 5x7 print on a wall, to me at least, is saying "look at me, i'm special". Smaller print is less of a "show-off". It's more like "hey, this is just a little something I found interesting". And it works better!
Then what I also did is I crop like mad, and really focus on the details. Amazing, how much cropping 400tx allows!
The idea is to use the good looking print as a central point, and surround it with multiple smaller prints on the wall. I think that will work nicely!
I still had some issues controlling contrast, but I think a part of the problem is using LED light in my enlarger. I remember having more control with a hallogen, so I'll try to go back.