SpiderMonki 1.0 Tips
- Read the readme.htm file. This contains the documentation and tutorial.
- SpiderMonki only does http. It does not do other protocols.
- Some sites use VB Script or Java script to prevent you from spidering their site. If you really want the content,
you can create a queue file with the URLs. This will bypass all scripting, but it will involve some work on your part.
|