Actually they were viewed by 11 other men who gave their testimony of the veracity of what they saw. And in every case - not one man ever denied his testimony even though many of them became disaffected with the church. Here are their testimonies: http://lds.org/scriptures/bofm/introduction?lang=eng 
 
To answer your question - No, it does not. Faith is an extremely important part of the gospel. Plus I have experienced so many faith-building things in my life that my faith in the veracity of the Book of Mormon has only been strengthened as the years go by. It is true.

Actually there was 12 Witnesses to the Golden Plates. Joseph Smith Jr., Oliver Cowdery, David Withmer, Martin Harris, Christian Whitmer, Jacob Whitmer, Peter Whitmer Jr., John Whitmer, Hiram Page, Joseph Smith Sr., Hyrum Smith, Samuel H. Smith.  
 
All twelve of these men testified there entire lives that the Golden Plates were real. The Plates were taken by the Angel Moroni for protection once the translation was complete, but there is far from only 1 witness to the plates.  
 
Whoever gave you this information wasn't a good source for information about the plates or the Church of Jesus Christ of Latter-day Saints.  
 
For accurate information feel free to visit mormon.org 
 
Thank you for the question I hope my answer helps!