通过xpath抓取网页内容代码,Perl代码库,德仔网

代码语言

代码分类

【Perl】通过xpath抓取网页内容

作者:dezai / 发布于2014/9/12/ 1102


	#!/usr/bin/perl
	use strict;
	use warnings;
	use HTTP::Request;
	use LWP::Simple;
	use Data::Dumper;
	use HTML::TreeBuilder::XPath;
	use Web::Scraper;
	use URI;
	
	
	my $dest = 'http://www.sharejs.com/';
	get_parse_result($dest);
	
	
	##############################################################
	
	sub get_parse_result {
	
	 my ($url) = @_;
	 return unless $url;
	
	 my $xpath = '/html/body/div[2]/div/form/span[2]';
	
	 my $html = get($url);
	 my $tree = new HTML::TreeBuilder::XPath;
	 $tree->parse( $html );
	 $tree->eof;
	 #$tree->dump;
	
	 my $items = $tree->findnodes( $xpath );
	 for my $item ( $items->get_nodelist() ){
	 print $item->as_HTML;
	 }
	 print "\n=========\n";
	
	
	 my $scraper = scraper {
	 process "$xpath",'key' => 'HTML';
	 };
	
	 my $uri = URI->new($url);
	 my $result = $scraper->scrape($uri);
	 print $result->{key};
	
	}

试试其它关键字

　xpath　　抓取网页内容　

同语言下

可能有用的

dezai贡献的其它代码(1065)