CSS allows you to select elements based on the structure of the page. To construct the selectors, view the source HTML of the pages that you need to clip. The Web Connector supports standard CSS selectors. The ClipPageUsingCssSelect parameter is applied before ClipPageUsingCssUnslect, so you can use this parameter to remove unwanted descendants of elements identified by ClipPageUsingCssSelect. The connector also removes all descendents of these elements. The connector also keeps all descendents of these elements.Ī comma-separated list of CSS selectors that specify parts of the page to remove. ClipPageUsingCssSelectĪ comma-separated list of CSS selectors that specify parts of the page to keep. To clip pages with CSS selectors, add Clipped=TRUE to your task configuration, and then set the parameters ClipPageUsingCssSelect and ClipPageUsingCssUnselect. For this reason, you can use CSS selectors to choose which parts of the page to keep and which to discard. The automatic clipping algorithm has been designed to work with many different pages, but this means that automatic clipping might not give the best results for every page. To clip pages automatically, add Clipped=TRUE to your task configuration.
Web Connector can clip pages automatically, using an algorithm to decide which parts of the page to keep and which to discard.
You can configure Web Connector to remove irrelevant content from pages before they are ingested. Unless these are removed from pages, the text from these items could reduce the quality of the documents indexed into IDOL Server and reduce the effectiveness of operations such as categorization. The content on most web pages includes headers, footers, navigation bars, and advertisements.
0 kommentar(er)
