log4j.properties are all at DEBUG.ĭEBUG Queued for processing: The Collector is not responding to the 401 with authentication at all, just ACK and FIN ACK. It is rejected with 401 Unauthorized, and it is an internal intranet, so you will not be able to access it. INFO Running Norconex Complex Libro Test : END (Fri Nov 04 14:04:48 CDT collector]# INFO Norconex Complex Libro Test : Crawler executed in 1 second. INFO Norconex Complex Libro Test : Crawler completed. INFO Norconex Complex Libro Test : 1 reference(s) processed. INFO Norconex Complex Libro Test : Crawler finishing: committing documents. INFO Norconex Complex Libro Test : Deleted 0 orphan references.
INFO Norconex Complex Libro Test : Deleting orphan references (if any). INFO Norconex Complex Libro Test : Crawling references. INFO Norconex Complex Libro Test : Done initializing sitemap store. INFO Norconex Complex Libro Test : Initializing sitemap store. INFO Norconex Complex Libro Test : User-Agent: APL-Norconex-Collector Agent INFO Norconex Complex Libro Test : Canonical links support: true INFO Norconex Complex Libro Test : Sitemap support: false INFO Norconex Complex Libro Test : RobotsMeta support: false INFO Norconex Complex Libro Test : RobotsTxt support: false INFO Running Norconex Complex Libro Test : BEGIN (Fri Nov 04 14:04:) INFO Version: Norconex Committer Core 2.0.5 (Norconex Inc.) INFO Version: Norconex JEF 4.0.7 (Norconex Inc.) INFO Version: Norconex Importer 2.6.0 (Norconex Inc.) INFO Version: Norconex Collector Core 1.6.0 (Norconex Inc.) INFO Version: Norconex HTTP Collector 2.6.0 (Norconex Inc.) INFO Backing up previous execution status and log files. INFO JEF job status store is : FileJobStatusStore INFO Configuration loaded: id=Norconex Complex Collector logsDir=./libro-output/complex/logs progressDir=./libro-output/complex/progress INFO Reference filter loaded: RegexReferenceFilter INFO Reference filter loaded: ExtensionReferenceFilter collector-http.sh -a start -c libro/complex/complex-config.xml I have wireshark running, and it is just doing the following:Ĭrawler => site collector]#. I am attempting to use the httpClientFactory in a complex-config.xml and I am not seeing any attempt by the crawler to authenticate at the server.
0 kommentar(er)
