How do I go about cleaning the edges of pages in a book?

When I was reading this book one day, my thumbs were a bit dirty (I guess). While I was reading, some of the residue made it’s way to the long side of the page edges.

Now, looking at the book, the edges (not anything on the inside) has kind of a greenish brown color. Anyone have a way of cleaning this up? All help is appreciated.