This can be a tricky calculation. My rule of thumb is to consider five years the tipping point.
If you think you will be staying in place for five years or more, go ahead and make it your dream project. You can't predict what people will like in five years anyway.
If, on the other hand, you expect to move sooner than that, keep the unique features and luxury upgrades for your future, longer term home. A home that is more of a blank canvas will appeal to a wider audience of prospective buyers.
Everyone wants to put their personal touch on their home. Think of any renovation as an investment into the future value of the house.