Your situation is puzzling. It looks like you still have wp-piclens activated, not wp-piclens-plus. Note: wp-piclens and wp-piclens-plus are two different plugins and can't be used together.
But neither of these plugins could delete images, so I'm confused as to how that happened. Seems more like it might be an incompatibility between an image upload or gallery plugin and WP2.5. But I really don't know.
Anyway, the plugin that is currently displaying blue arrows is wp-piclens. Make sure that you've deactivated wp-piclens. If you have deactivated it, then you are probably using a caching plugin such as wp-cache or wp-super-cache. Make sure that you clear the cache. If that doesn't work, then delete the wp-piclens directory in plugins. WordPress will automatically deactivate the plugin if you remove its directory. If you've deleted the wp-piclens directory and it is still giving you the blue arrow, then clear the cache again (if you're using wp-cache or wp-super-cache). If you are running Firefox as your browser, you might also have to clear its cache. If you've done all of that and still get the blue arrow, post a list of your activated plugins and I'll try to suggest what the problem could be.
Before you try either of the piclens plugins again, make sure that everything on your blog is working well. Some of this could be related to plugin incompatibilities with WordPress 2.5. Make sure that you have the latest versions of all your plugins and that they are working well.
I wish I could be more helpful, but hopefully this will help get things back to normal. Please post again to let me know how things are going and I'll try to help further. Best of Luck!
–Shack