At the moment, Samsung's top offerings appear to surpass everything else on the market. Not because of stupid bench tests, but because of fundamentals such as display quality and overall utility.
In 2012, I was tempted by the Note 2, but was swayed by the practicality and lower price of the S3. Six months ago, I passed on the S5 and went for the Note 3. Not because there was anything wrong with the S5 - good grief, I'm not aware of any weaknesses at all - but because I found the Note screen to be slightly less reflective and obviously the larger display was a handy bonus for someone with deteriorating vision. I haven't had the slightest cause to regret my decision. The original plan was to upgrade to the Note 4 when it came out, but I haven't bothered to even look at one. The Note 3 is a huge improvement over the S3, thanks to one of the best displays on the market (I checked out everything available), more than twice the battery life, and no Bluetooth problems after using 3G (which may have been unique to my phone).
Yes, the bundled software can leave a lot to be desired, but so far I haven't been motivated enough to upgrade them (apart from email, which is a no-brainer). The only software problem that really annoys me is that S-Voice sometimes comes to life even when I have carefully disabled it and its ilk in the Settings. Stupid zombie apps.
So even though I haven't looked at a Note 4 yet, I'd have to suggest you check one out. The extra display resolution is obviously useless, but the overall package is undoubtedly the best available right now.