User-agent: *
Disallow: /pdf/

User-agent: wget
Allow: /pdf/