When notification needed that does not launch app

I have an (Android) app that has a background service. This service is persistent and even runs in a different process to the man UI app. It serves a specific propose for the user. However, if it runs when not needed, it may result in unnecessary battery drain. It is not possible always to know if its function is needed, without user assistance.

In order to help deal with this case, the service will push a notification whenever it is running and the UI process is not active. This notification is a "Touch to stop me" type. This enables the user to stop it when they know that they do not need it, without actually disabling the related functionality altogether (via Settings).

The problem is that many (most?) user's just see the notification with the app's icon and think that touching it will bring the app to the front again. This is actually pretty reasonable behaviour and it is clear that the current solution is inappropriate. I would be interested in suggestions for a better interaction design.