使用htmlunit的好處有兩點,相比httpclient,htmlunit是對瀏覽器的模擬,比如你定位一個按鈕,就可以執行click()方法,此外不需要象在httpclient中一樣編寫復雜的代碼,如一堆request header還有一大堆請求參數,你只需要填寫用戶名,密碼,驗證碼即可,就象在使用一個沒有界面的瀏覽器,當然更重要的是htmlunit對js的支持設置極其簡單

1.添加maven的htmlunit(標紅)依賴

 1　 <dependencies>
 2     <dependency>
 3         <groupId>junit</groupId>
 4
 
         <artifactId>junit</artifactId>
 5         <version>${junit.version}</version>
 6         <scope>test</scope>
 7     </dependency>
 8     <dependency>
 9         <groupId>com.alibaba</groupId>
10         <artifactId>fastjson</artifactId>
11
 
         <version>1.2.47</version>
12     </dependency>
13     <dependency>
14         <groupId>org.jsoup</groupId>
15         <artifactId>jsoup</artifactId>
16         <version>1.11.3</version>
17     </dependency>
18     <dependency>
19         <groupId>net.sourceforge.htmlunit</groupId>
20         <artifactId>htmlunit</artifactId>
21         <version>2.18</version>
22     </dependency>
 

23     
24   </dependencies>

2.思路

定位用戶名,密碼,驗證碼框等元素,填寫即可,驗證碼可以先把圖片下載下來然後手動輸入,也可以使用tess4j進行圖片識別,這裏是手動輸入

測試的網站,是一個偽ajaxsubmit,測試多次發現需要二次輸入驗證碼才能正確登錄,但令人疑惑的是兩次生成的驗證碼一樣(如果不一樣說明你第一次輸入錯誤)

 1 public static void main(String[] args) throws Exception {
 2         WebClient webClient = new WebClient(BrowserVersion.CHROME);
 3         webClient.getOptions().setJavaScriptEnabled(true);
 4         webClient.getOptions().setCssEnabled(true);
 5         webClient.getOptions().setThrowExceptionOnScriptError(false);
 6     //    webClient.getOptions().setThrowExceptionOnFailingStatusCode(true);
 7         webClient.getOptions().setActiveXNative(true);
 8         
 9         
10         //ajax
11         webClient.setAjaxController(new NicelyResynchronizingAjaxController());
12         webClient.getOptions().setUseInsecureSSL(false);
13         
14         
15         //允許重定向
16         webClient.getOptions().setRedirectEnabled(true);
17                 
18         
19         //連接超時
20         webClient.getOptions().setTimeout(5000);
21         
22         //js執行超時
23         webClient.setJavaScriptTimeout(10000*3);
24         
25         //對於此網站務必開啟
26         webClient.getCookieManager().setCookiesEnabled(true);
27         
28         String url = "https://www.zuhaowan.com/login/";
29         HtmlPage page = webClient.getPage(url);
30         webClient.waitForBackgroundJavaScript(5000);
31         
32         
33         
34 
35         HtmlPage newPage = readyPage(page, webClient);
36     //    String content1 = newPage.asXml();
37     //    IOUtils.write(content1.getBytes(),new FileWriter(new File("f:/content1.txt")));
38         
39         //如果頁面url沒有變化重新進行一次登錄
40         if(newPage.getUrl().toString().equals(url)) {
41             System.out.println("出現錯誤請重新登錄-------------");
42             HtmlPage result = readyPage(newPage,webClient);
43             System.out.println("url----------------"+result.getUrl());
44             System.out.println("頁面----" + result.asXml());
45         //    IOUtils.write(result.asXml(),new FileWriter(new File("f:/content2.txt")));
46             
47         }
48         
49         webClient.close();
50     }
51     
52     
53     
54     public static HtmlPage readyPage(HtmlPage page,WebClient webClient) throws Exception {
55         //封裝頁面元素
56         HtmlForm form  = page.getHtmlElementById("form2");
57         HtmlTextInput loginname = form.getInputByName("loginname");
58         loginname.setValueAttribute("用戶名");
59         HtmlPasswordInput loginpwd = form.getInputByName("loginpwd");
60         loginpwd.setValueAttribute("密碼");
61         
62         //驗證碼輸入框
63         HtmlTextInput verify_code = form.getInputByName("verify_code");
64         
65         //驗證碼圖片
66         HtmlImage verify_img = (HtmlImage) page.getElementById("verify_img");
67         UUID randomUUID = UUID.randomUUID();
68         //保存
69         verify_img.saveAs(new File("./src/main/resources/image/verifyimg"+ randomUUID.toString() +".png"));
70         
71         System.out.println("驗證碼圖片已保存!");
72         System.out.println("請輸入驗證碼");
73         //手動輸入驗證碼
74         Scanner scanner = new Scanner(System.in);
75         String code = scanner.nextLine();
76         System.out.println("驗證碼-------------" + code);
77         verify_code.setValueAttribute(code);
78         
79     
80         //登錄按鈕
81         HtmlAnchor login = page.getHtmlElementById("loginsubmit");
82         HtmlPage newPage = login.click();
83         
84         //等待js加載
85         webClient.waitForBackgroundJavaScript(5000);
86         return newPage;
87             
88     }
89     

3.控制臺部分輸出截圖

htmlunit 模擬登錄 數字驗證碼