What kind of oil are you using?
Bar and chain oil contains additives to increase tackiness. Motor oil, new or used, will sling a lot more mess.
NOTE: There are 3 grades of bar oil: summer, all-season, and winter. Oddly, not every vendor labels their bar oil appropriately. I assume they would be...