I can easily hear differences between dxd and dsd upsampling. Some filters are also quite obviously different-sounding, while others are less so. As the previous post indicates, different sources will impart a different degree of detectability when changing filters. Additionally, I found to prefer certain combinations (map/upsampling/filter) for certain songs and playback methods (speakers vs headphones)
Bottom line, it takes time and patience to arrive at one’s preference, and those may change over time, mood, or with different material. I deem this a fantastic opportunity—not unlike tube rolling—to experiment with different renditions of recordings, all from the convenience of the Mosaic app. One day I may prefer a crisp, “be there” sound, some other just a laid back DSDx2/M1/F5 sound.