org.jsoup.HttpStatusException: HTTP error fetching URL. Status=403 爬取网站出现403错误
jilongliang:
String url = "";
Map headers = new HashMap();
headers.put("Accept", "text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8");
headers.put("Accept-Encoding", "gzip, deflate, sdch");
headers.put("Accept-Language", "zh-CN,zh;q=0.8");
headers.put("User-Agent", "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36");
Connection connection = Jsoup.connect(url).timeout(5 * 1000);
for (Map.Entry stringStringEntry : headers.entrySet()) {
connection.header(stringStringEntry.getKey(), stringStringEntry.getValue());
}
Document document = connection
.get();
|