I'm using the Qstarz BT-Q1000X travel recorder to import tracks into OSM. The Qstarz has a more modern and better GPS chip than the widely used SirfStar III. POI's are recorded by pressing a button. You can view the POI's in JOSM as well as in a program supplied with the Qstarz. That program also has the possibility to combine it (by time stamp) with the photo's you made.

Try to get the GPS receiver to the far most rear of your bike, for example by putting it in a bag. I noticed that carrying it in a coat or something other in close proximity to your body causes interference in the reception of the sattelites creating mistakes in tracking of 2 till 10 meters.