I have been working with some SharePoint crawl errors today that look something like this [error] The SharePoint item being crawled returned an error when attempting to download the item [/error] There are a couple of solutions that need to be implemented to resolve this crawling failure. First off we need to tweak the registry to use the correct user-agent string
- Open Regedit on your search server(s)
- Navigate to this registry key: HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Office Server\14.0\Search\Global\Gathering Manager
- Change the value of “UserAgent” from “MSIE 4.01″ to “MSIE 8.0″
- Restart the SharePoint Search Service.
Secondly we need to ensure we have the Sessions State Service enabled so that reporting in Access Services works without error.
- Open a SharePoint PowerShell
- Get-SPSessionStateService
- If this returns false then we need to deploy one
- Enable-SPSessionStateService -DatabaseName “NameOfDatabase”
Now lets go back and re-run that crawl