Strange Tickling Like Pain about 3 inches above my belly on?

Yesterday I had a slight stitch in my right side off and on all day (almost like I did when I had an ovarian cyst). This morning I woke up and that pain was gone but now have a new weird pain. If you have ever had any one poke your belly on it usually gives a weird twinge/tickling like pain. That's the type of pain that has been off and on all day today but about 3 inches above my belly on. On a pain scale of 1-10 it is only about a 4. Is this something I should be worried about?