The question of legal liability is an important one, and is something that would need to be solved before widespread use. Does the liability rest with the owner or the manufacturer (hardware and software)? How would insurance handle this? Even with a human driver, if the road markings are misleading and determined to be a partial cause of the accident, then DOT is probably partly responsible.
Self-driving vehicles rely on far more than road signs and marking. They will get better over time. They already do well with ambiguous or incorrect road markings.
In the near future, computer-assisted driving will be a lot easier to role out than driver-less cars. With a driver in the car, you can push a button to have the computer take over the task of driving, but still watch the road and take over if necessary. I suspect that if you have taken hundreds of trips that way without a problem caused by the computer, you might be more open to driver-less vehicles.
If someone you love is killed in an auto accident, it is very personal regardless of who or what is doing the driving. How many people lose a loved one each year due to drunk driving? What if the person who was drunk could rely on the car to drive him/her home?
I'm not trying to be a proponent of driver-less cars, but most of the discussion here has been on only one side, and I felt that there were some valid points that could be made for the "pro" position.