A group of academic publishers is challenging Google’s plan to scan millions of library books into its web search engine index, highlighting fears the ambitious project will violate copyrights and stifle future sales.